1. To date, The googlebot spiders are much more active than the Yahoo Slurp spiders. Check the server logs of most sites and compare the total numbers of googlebots vs. Yahoo Slurp spider visits, typically the googlebots will have been out to crawl pages three to four times as often as Yahoo.

The googlebot spiders do prefer smaller pages as they are easier to compress, cache, and store. However, to suggest that keyword searchers will not find larger pages in Google is a little misleading.

Thousands of large, dynamic, database-driven URLs, can be found at the top of most major search engine results pages, including Google.

Posted at 4:40AM on Dec 19th 2005 by Jack Roberts

2. At first it seemed like slurp was more active but all the activity seems to be on new individual pages. Once you get about 2 visits from slurp then you go into that yahoo black hole where you can wait forever to have your site crawled again. I have seen postings all over and lots of people are still waiting for a return visit from slurp. I will agree that google seems to prefer small pages. The problem lately is that google comes a lot but leave such small traces when you check your listings in their engine. Yahoo doesn't come very often but when it does, every single page is added to the engine.

Posted at 4:40AM on Dec 19th 2005 by Syd Johnson

3. At first it seemed like slurp was more active but all the activity seems to be on new individual pages. Once you get about 2 visits from slurp then you go into that yahoo black hole where you can wait forever to have your site crawled again. I have seen postings all over and lots of people are still waiting for a return visit from slurp. I will agree that google seems to prefer small pages. The problem lately is that google comes a lot but leave such small traces when you check your listings in their engine. Yahoo doesn't come very often but when it does, every single page is added to the engine.

Posted at 4:40AM on Dec 19th 2005 by Syd Johnson