Complex responsive design

Hello everybody,

I am trying to achieve the kind of design as you see in the attached image.
As you can see some of the elements go all the way trough to the sides which makes it quiet complex.
Would it to be possible to create this in a kind of fluid responsive design where all elements scale when window scales or will I have to check and fix on all different sizes with a design like this?

I don’t have much experience with responsive webdesign, suggestions are very welcome!

for those interested in the actual design: