«前の日記(Tue, 23 Apr 2013 (平成25年)) 最新 次の日記(Thu, 25 Apr 2013 (平成25年))» 編集 RSS with tsukkomi RSS without tsukkomi

実験的「実験的日記」


Wed, 24 Apr 2013 (平成25年) [長年日記]

_ bingbot がひどかった

こんなアクセスを十五分くらい続けられてしまったためにサーバがパンクしたのだった。

[24/Apr/2013:08:06:01 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:02 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:03 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:04 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:04 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:05 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:05 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:06 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:06 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:07 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:07 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:07 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:08 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:09 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:10 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:12 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:13 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:14 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:14 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:17 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:18 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:18 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:18 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:18 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:18 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:18 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:22 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:22 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:22 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:22 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:22 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:22 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:23 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:26 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:26 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:27 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:27 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:27 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:31 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:31 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:32 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:32 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:32 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:32 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:34 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:35 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:36 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:36 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:36 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:37 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:37 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:37 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:37 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:38 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:42 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:42 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:42 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:43 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:43 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:44 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:45 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:45 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:46 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:46 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:48 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:48 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:49 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:49 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:50 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:52 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:52 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:52 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:53 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:54 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:55 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:55 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:55 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:56 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:58 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:58 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:58 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
[24/Apr/2013:08:06:59 +0900] "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"

完全拒否することもないかなと思うので robots.txt に

User-agent: BingBot
Crawl-delay: 10

と書いて様子見。

目次

«前の日記(Tue, 23 Apr 2013 (平成25年)) 最新 次の日記(Thu, 25 Apr 2013 (平成25年))» 編集