Prepared for the BingBot?
As already announced in July, solves the BingBot the MSNBot on Oct 01, 2010 from. Now is the Webmaster for question whether the website is not prepared for it, and what steps are necessary.
The technical definitions of BingBots was submitted in July.
* Entry in the log files:
Mozilla/5.0 (compatible; bingbot/2.0 + http://www.bing.com/bingbot.htm)
* New Header name:
From: bingbot (at) microsoft.com
Webmasters of the MSNBot have been no mandatory practices need not worry about the changes. Only when it comes to the behavior of BingBots control, appropriate instructions in the robots.txt file. Htaccess file, the file header, or right in the head region of individual websites with the robots meta tag (noindex, nofollow ) are written.
Influence on the crawl behavior means, for example:
* No access to the entire website
* Not have access to selected pages, files
* Crawl Delay – speed of access control on files
More information for influencing the crawl behavior, see the note to the file robots.txt.
Instructions in the robots.txt for the MSNBot be after 1 October run. The most optimal variant is sure to leave some time identical instructions for MSNBot and BingBot run in parallel. Microsoft, however, assured to consider both specifications. Per instructions. Htaccess, which were previously dedicated to the MSNBot, must be formulated for BingBot from October 1.
Instructions for the Yahoo! Slurp Crawler
Based on the 10-year-old Search alliance between Microsoft and Yahoo! are now already in the U.S. and Canada (English only) is shown Bing-connected in the results of Yahoo!. For 2011, this transition for all other countries is planned to be operated by Bing.
Instructions for the Yahoo! Slurp crawler after the transition have no effects on the listing in the results of Yahoo! For example, if the Yahoo! Slurp Crawler blocked, MSNBot does not mean it to consider whether BingBot to block.
Even after the transition, the Slurp crawler will remain active. Shashi Seth, senior vice president for search products Yahoo! explains
Yahoo! will always be a search engine:
Yahoo! will continue enriching the results of Bing with content from their own and other sources, such as Twitter and social networks.
We maintain the technology, the scientific work and the infrastructure for crawling, indexing and ranking the data, and all in real time (less than one second)
IP addresses for BingBot:
The IP addresses for BingBot be unchanged from MSNBot. All Masnahmen to influence the crawl, based on IP addresses, will remain in effect.
The Bing Webmaster Team recommends the use of Bing Webmaster Tools to control the BingBots and clarification of crawling problems.
Bing Webmaster Blog:
BingBot is coming to town