IK bones drifting around

I’m trying to set up a character and whenever I draw bones through his legs, his shin and foot will go out of place by a tiny bit, causing things to look wonky when he bends his legs and whatnot.

Has anyone else had a problem with symbols drifting out of position when you add bones?