Captions sticking in one place

i am using captions on a site and they work fine except that when you click they stick in a particular spot. To see what i mean
http://www.solidhang.com/tonyoursler/main.html then click on SCRAPS, then click on POSTERS / FLIERS and roll over any of the icons. It works fine, but then click on the button to bring up the image big and when you go back to the main site and roll over a thumbnail the caption sticks to where it was previously clicked. Any help would be appreciated

thanks
pithcell