# Bots Crawlers and all the Rest **URL:** \ **Category:** random\ **Created:** [April 21, 2006, 1:58am UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407 "2006-04-21T01:58:21Z")\ **Posts on this page:** 13\ **Page:** 1
**Author:** ![liam\_mt](https://avatars.discourse-cdn.com/v4/letter/l/8baadc/32.png) [@liam\_mt](https://forum.kirupa.com/u/liam_mt)\ **Post date:** [April 21, 2006, 1:58am UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/1 "2006-04-21T01:58:21Z")
hello there, i’ve had my website published recently and i listed the website for indexing with google msn and yahoo. the problem is that none of them has crawled my site yet. is there any answer to this?? ---
**Author:** ![esnetni](https://avatars.discourse-cdn.com/v4/letter/e/b5a626/32.png) [@esnetni](https://forum.kirupa.com/u/esnetni)\ **Post date:** [April 21, 2006, 2:01am UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/2 "2006-04-21T02:01:18Z")
I think it takes a while like months but I am not sure. ---
**Author:** ![Templarian](https://yyz1.discourse-cdn.com/flex011/user_avatar/forum.kirupa.com/templarian/32/7152_2.png) [@Templarian](https://forum.kirupa.com/u/Templarian)\ **Post date:** [April 21, 2006, 2:06am UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/3 "2006-04-21T02:06:21Z")
Change around your meta tags? … it took a month to get mine to first over kirupa when you typed templarian. how recent have you listed it? ---
**Author:** ![mathew\_er](https://avatars.discourse-cdn.com/v4/letter/m/94ad74/32.png) [@mathew\_er](https://forum.kirupa.com/u/mathew_er)\ **Post date:** [April 21, 2006, 7:34am UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/4 "2006-04-21T07:34:09Z")
How long is it since you published your site? Getting small sites into the Google is sometimes hard. If you have access into logs check if googlebot already visited your site. If so and if its more than a week or so search for site:yourSiteUrl to see if you have to wait more or optimise your site… Google doesnt show everything it ever indexed. You have to show it, that your site is important… mostly by linking to your site. ---
**Author:** ![hybrid101](https://avatars.discourse-cdn.com/v4/letter/h/7993a0/32.png) [@hybrid101](https://forum.kirupa.com/u/hybrid101)\ **Post date:** [April 21, 2006, 9:11am UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/5 "2006-04-21T09:11:38Z")
lol:P i had mine after a day of submitting it. maybe i was lucky that google had crawled at the precisely right moment:) it may take about a month normally btw;) ---
**Author:** ![bwh2](https://avatars.discourse-cdn.com/v4/letter/b/8c91f0/32.png) [@bwh2](https://forum.kirupa.com/u/bwh2)\ **Post date:** [April 21, 2006, 7:50pm UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/6 "2006-04-21T19:50:36Z")
well, you probably don’t have many (if any) other sites linking to you. and on top of that, it’s a flash site, which search engines can’t grab the content from. so you don’t have any real content as far as the search engines are concerned, so you’re probably going to struggle. ---
**Author:** ![Phenex](https://yyz1.discourse-cdn.com/flex011/user_avatar/forum.kirupa.com/phenex/32/686_2.png) [@Phenex](https://forum.kirupa.com/u/Phenex)\ **Post date:** [April 21, 2006, 7:57pm UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/7 "2006-04-21T19:57:21Z")
So you mean, if site:mySiteUrl shows a result, then Google’s spyder has indexed it? ---
**Author:** ![bwh2](https://avatars.discourse-cdn.com/v4/letter/b/8c91f0/32.png) [@bwh2](https://forum.kirupa.com/u/bwh2)\ **Post date:** [April 21, 2006, 8:46pm UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/8 "2006-04-21T20:46:46Z")
> [@thelonephoenix](#): > > So you mean, if site:mySiteUrl shows a result, then Google’s spyder has indexed it? not necessarily, but most likely. ---
**Author:** ![Phenex](https://yyz1.discourse-cdn.com/flex011/user_avatar/forum.kirupa.com/phenex/32/686_2.png) [@Phenex](https://forum.kirupa.com/u/Phenex)\ **Post date:** [April 21, 2006, 9:23pm UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/9 "2006-04-21T21:23:19Z")
Hmmm… I need to get it indexed at like one of the topmost… It’s hard 😛 ---
**Author:** ![evildrummer](https://yyz1.discourse-cdn.com/flex011/user_avatar/forum.kirupa.com/evildrummer/32/2308_2.png) [@evildrummer](https://forum.kirupa.com/u/evildrummer)\ **Post date:** [April 21, 2006, 9:37pm UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/10 "2006-04-21T21:37:16Z")
make sub-pages which arent flash, that helps ---
**Author:** ![Phenex](https://yyz1.discourse-cdn.com/flex011/user_avatar/forum.kirupa.com/phenex/32/686_2.png) [@Phenex](https://forum.kirupa.com/u/Phenex)\ **Post date:** [April 21, 2006, 9:44pm UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/11 "2006-04-21T21:44:51Z")
Well my forums have only the banner and my media player in flash… The rest is all CSS and PHP 😛 ---
**Author:** ![Stratification](https://avatars.discourse-cdn.com/v4/letter/s/bc8723/32.png) [@Stratification](https://forum.kirupa.com/u/Stratification)\ **Post date:** [April 21, 2006, 9:47pm UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/12 "2006-04-21T21:47:45Z")
Making a Google Sitemap can help. More info here: [https://www.google.com/webmasters/sitemaps/](https://www.google.com/webmasters/sitemaps/) ---
**Author:** ![Phenex](https://yyz1.discourse-cdn.com/flex011/user_avatar/forum.kirupa.com/phenex/32/686_2.png) [@Phenex](https://forum.kirupa.com/u/Phenex)\ **Post date:** [April 21, 2006, 10:52pm UTC](https://forum.kirupa.com/t/bots-crawlers-and-all-the-rest/186407/13 "2006-04-21T22:52:57Z")
Thank you! 😃