Performance Implications of Installations

When I install a program on my PC, does it make the PC slower (even while that specific App isn’t being ran)? If it does decrease my PC speed, will using Add/Remove programs on windows recover all lost speed.