Yahoo/Inktomi Spider A question for Admin.

ADMIN,

Can you enlightnen us as to what this user name is ?

[FailingEnterpriseAdmin]

Originally Posted by Yahoo/Inktomi Spider

ADMIN,

Can you enlightnen us as to what this user name is ?

Search engines (like Google, Yahoo, and MSN Search, as well as many others) use "spiders" (they crawl all over the web, get it?) to roam around and retrieve web pages so they can be indexed. Our discussion board now has over 36,000 messages, each of which can be displayed as a single page, or in various other combinations, so the total number of "pages" here is probably over 40,000.

Yahoo and Inktomi are partners in some way when it comes to this searching and their spiders are regular visitors here. Unlike human visitors, they tend to retrieve one page and then disappear. The discussion board software considers the connection "live" for 15 minutes after the last activity, so at any given time there are lots of search engine spiders showing current connections to us.

The total bandwidth they consume is fairly minor, and we benefit from the accurate and up-to-date indexing they provide, so I let them visit freely. There are things I could do to block them or throttle them, but they're harmless helpful spiders as far as I can tell.

Originally Posted by FailingEnterpriseAdmin

Search engines (like Google, Yahoo, and MSN Search, as well as many others) use "spiders" (they crawl all over the web, get it?) to roam around and retrieve web pages so they can be indexed. Our discussion board now has over 36,000 messages, each of which can be displayed as a single page, or in various other combinations, so the total number of "pages" here is probably over 40,000.

Yahoo and Inktomi are partners in some way when it comes to this searching and their spiders are regular visitors here. Unlike human visitors, they tend to retrieve one page and then disappear. The discussion board software considers the connection "live" for 15 minutes after the last activity, so at any given time there are lots of search engine spiders showing current connections to us.

The total bandwidth they consume is fairly minor, and we benefit from the accurate and up-to-date indexing they provide, so I let them visit freely. There are things I could do to block them or throttle them, but they're harmless helpful spiders as far as I can tell.

Sounds great, another way of increasing traffic !