I know that you’ll never reveal me all the secrets but I hope You’ll help me: what is a good method to make my sites appear in Search Engines ? How have I to use “robots.txt”?
Did you ever read the Kirupa Tutorial entitled “Submitting to Search Engines”? If you didn’t, it can be found at…
http://www.kirupa.com/developer/mx/searchengines.asp
It gives you the dos and don’ts of a web-site being submitted to a search engine.