Yandex/Google 机器人垃圾邮件

Yandex/Google 机器人垃圾邮件

我最近登录了我拥有的一台 vps(使用 vultr,如果这值得关注的话)。发现大量的 nginx 日志和高于预期的平均负载。这台服务器实际上什么也没做,只是在端口 80 上提供默认的 nginx 页面。

日志内容摘录如下:

    178.154.200.16 - - [05/May/2017:00:22:11 +0000] "GET /philips-nivea-men-anti-irritation-moisturising-shaving-conditioner HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
37.9.113.30 - - [05/May/2017:00:22:12 +0000] "GET /reach-across-stream-catherine-stephenson HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
95.108.179.22 - - [05/May/2017:00:22:14 +0000] "GET /bt-orange-wood-dual-roller-plastic-fingers-mabtage-tool-hand-joint-mabtagee HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
37.9.113.30 - - [05/May/2017:00:22:15 +0000] "GET /timur-dvatz-art-catalogue-book HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
37.9.113.30 - - [05/May/2017:00:22:17 +0000] "GET /small-nativity-scene-set-christmas-ornament-stable-miniature-birth-jesus HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
141.8.183.25 - - [05/May/2017:00:22:18 +0000] "GET /biotique-fruit-whitening-lip-balm-lightens-evens-lip-tones-12-grams HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
95.108.213.13 - - [05/May/2017:00:22:22 +0000] "GET /pro-nail-files-trapetz-grain-100-180-set-nails-nail-salon-nail-set HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
141.8.183.19 - - [05/May/2017:00:22:25 +0000] "GET /30-x-100mg-strongest-genuine-herbal-blue-male-sex-aid-men-best-one-market HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
5.255.253.67 - - [05/May/2017:00:22:29 +0000] "GET /ew-natural-loofah-sponge-bath-massage-brush-body-face-cleaning-scrubber-pad-uk06 HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
93.158.152.40 - - [05/May/2017:00:22:33 +0000] "GET /ponds-sandal-radiance-talc-sunscreen-powder-50-gm-100-gm-300-gm HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
37.9.113.30 - - [05/May/2017:00:24:34 +0000] "GET /betelnut-container-mortar-end-papua-new-guinea HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
37.9.113.30 - - [05/May/2017:00:24:34 +0000] "GET /antique-map-nouvelle-carte-de-lafrique HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
178.154.200.49 - - [05/May/2017:00:24:34 +0000] "GET /dswa-keetmanshoop-deutsche-suedwest-afrika-germany-sw-africa-herero-war-ma-48924 HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
178.154.200.31 - - [05/May/2017:00:24:35 +0000] "GET /old-k HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
37.9.113.30 - - [05/May/2017:00:24:35 +0000] "GET /mauchline-tartan-ware-thimble-case-c-1880-cameron-surname-silver-thimble-ch HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
178.154.200.31 - - [05/May/2017:00:24:35 +0000] "GET /antique-20thc-art-deco-platinum-sapphire-diamond-bracelet-c-1930 HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
141.8.142.180 - - [05/May/2017:00:24:36 +0000] "GET /ancient-egyptian-carnelian-fish-amulet-18th-dynasty-c-1340-bc-amarna-period HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
37.9.113.30 - - [05/May/2017:00:24:36 +0000] "GET /papua-new-guinea-grain-bag-holder HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
178.154.200.49 - - [05/May/2017:00:24:36 +0000] "GET /1779-bonne-map-isle-de-cuba-havana-manzanillo-guantanamo-bay-santiago-yago HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
178.154.200.31 - - [05/May/2017:00:24:37 +0000] "GET /carte-dune-partie-de-lamerique-pour-la-navigation-caribbean-buache-1740-map HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
141.8.142.180 - - [05/May/2017:00:24:37 +0000] "GET /antique-furniture/dressing-tables?page=8 HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
37.9.113.30 - - [05/May/2017:00:24:37 +0000] "GET /17th-18th-century-beautiful-hand-carved-rustic-dug-bowl HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
178.154.200.38 - - [05/May/2017:00:24:41 +0000] "GET /gilbert-ellice-sg57-8-1949-silver-wedding-mtd-mint HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
141.8.142.58 - - [05/May/2017:00:24:42 +0000] "GET /leather-case-billiards-quiver-madison-black-2-4 HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
5.255.253.47 - - [05/May/2017:00:24:45 +0000] "GET /latvia-1923-early-issue-fine-used-15s-120869 HTTP/1.1" 404 152 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"

事实证明这种情况已经持续了几个月,包括 googlebot 也一样。检查 IP 地址时,它们似乎解析为 yandex/google 名称服务器,因此当我的服务器对所有请求都返回 404 时,机器人继续爬行,这让我感到很奇怪。

这可能是由于服务器继承了某个购物网站的旧 IP 吗?还是另有原因?

答案1

你是对的。

这可能是因为服务器继承了某个看起来像是购物网站的旧 IP

相关内容