Remove Program

I always go into Windows XP’s control panel to remove programs. Then I restart the computer when necessary. The thing that bugs me is that the program folder still remains in C:/Program Files with a bunch - if not all - of the program files. Is this only happening on my computer?