Loading mp3 makes animation very slow

I’ve got a flash animation with a play button that loads an external mp3. But when the mp3 starts playing I experience a major framedrop (to about 10 - 15 fps). Can this be fixed?