Алексей Колосов - Drupal для хостинга

Drupal for web-hostingDrupal for web-hosting

Kolosov Alexey (Softovick)administratorIT Patrol inc.

The Main Causes of Overload

- DDoS attack;

- active scanning by bots;

- Slashdot effect (хабраэффект);

- troubled modules;

- incorrect use of modules;

- growing popularity of website;

Active Scanning by Bots

AhrefsBot

aport

asterias BackDoorBot/1.0

BecomeBot

BotALotCherryPickerSE/1.0

dumbot

EroCrawler

FreeFind

grub-clienthumanlinks

Jetbot

LinkWalkerMIIxpc

suzuran

see access log (Apache, nginx, etc...)softovick.org 66.249.64.24 - - [17/May/2014:05:09:37 +0400] "GET /robots.txt HTTP/1.1" 200 649 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"softovick.org 66.249.64.199 - - [17/May/2014:05:09:37 +0400] "GET /juick/1358241603 HTTP/1.1" 200 6020 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"softovick.org 64.246.165.10 - - [17/May/2014:05:25:38 +0400] "GET /robots.txt HTTP/1.0" 200 1561 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)"softovick.org 64.246.165.10 - - [17/May/2014:05:25:38 +0400] "GET / HTTP/1.1" 200 6102 "http://whois.domaintools.com/softovick.org" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)"softovick.org 217.69.133.190 - - [17/May/2014:09:32:19 +0400] "GET /robots.txt HTTP/1.1" 200 1561 "-" "Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)"softovick.org 217.69.133.190 - - [17/May/2014:09:32:20 +0400] "GET /tegi-zhuyka/rabota HTTP/1.1" 200 46938 "-" "Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)"softovick.org 217.69.133.244 - - [17/May/2014:09:34:36 +0400] "GET /tegi-zhuyka/pogoda HTTP/1.1" 200 20030 "-" "Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)"softovick.org 217.69.133.242 - - [17/May/2014:12:52:42 +0400] "GET /robots.txt HTTP/1.1" 200 1561 "-" "Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)"softovick.org 217.69.133.247 - - [17/May/2014:12:52:43 +0400] "GET /comment/160 HTTP/1.1" 200 33752 "-" "Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)"softovick.org 217.69.133.246 - - [17/May/2014:15:48:53 +0400] "GET /robots.txt HTTP/1.1" 200 1561 "-" "Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)"softovick.org 217.69.133.190 - - [17/May/2014:15:48:54 +0400] "GET /tegi-zhuyka/elba HTTP/1.1" 200 20066 "-" "Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)"softovick.org 95.108.216.252 - - [17/May/2014:16:20:45 +0400] "GET /robots.txt HTTP/1.1" 200 1561 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"softovick.org 95.108.216.252 - - [17/May/2014:16:20:48 +0400] "GET /robots.txt HTTP/1.1" 200 1561 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"softovick.org 95.108.216.252 - - [17/May/2014:16:20:56 +0400] "GET / HTTP/1.1" 200 6096 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"softovick.org 95.108.216.252 - - [17/May/2014:16:20:59 +0400] "GET / HTTP/1.1" 200 6097 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"softovick.org 95.108.216.252 - - [17/May/2014:16:21:08 +0400] "GET /content/kto-ya HTTP/1.1" 200 6097 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"softovick.org 95.108.216.252 - - [17/May/2014:16:21:11 +0400] "GET /content/kto-ya HTTP/1.1" 200 6099 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"softovick.org 95.108.216.252 - - [17/May/2014:16:21:19 +0400] "GET / HTTP/1.1" 200 6096 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"softovick.org 95.108.216.252 - - [17/May/2014:16:21:22 +0400] "GET / HTTP/1.1" 200 6097 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"

DDoS Attack

Slashdot Effect (Хабраэффект)

Troubled Modules

Incorrect Use of Modules

Growing Popularity of Your Website

New materials are often created

A lot of authorized users

Attendance is growing

seldom visited site < 1000

low activity< 10000

main activity - search engines90%

SLA

contractregion

THANK YOU!

ANY QUESTIONS?

Kolosov Alexey (Softovick)administratorIT Patrol inc.

[email protected]: Softovick

mailto:[email protected]

Technology

Алексей Колосов - Drupal для хостинга