Too many levels?

Is there such a thing as using too many levels? In one project I did it seemed like the more I loaded external swfs into lower levels the slower the presentation got.