If your old pads were really worn down thin, then the piston was coming out a good bit to apply your brake pressure. When you put on new thick pads, you really push that old piston and seal way back in to the caliper housing where it hasn't been in a long time. It may just be bound up and not relaxing. It might be time to build the calipers now too. Something to think about.