Em or % or px

I am really kind of confused right know, some of the people use em for everything, Some use % for font-size. And I am used to use px. But when do we really need to use these?

Or if we start with em we should go with em in all the design or what?