As Silverlight is a browser side technology, you would have no problem serving Silverlight content from our servers as long as you add the proper MIME type settings to the site via .htaccess rules such as:
AddType application/xaml+xml .xaml
AddType application/x-silverlight-app .xap
AddType application/x-ms-xbap .xbap