Robots |
1 | 1888 | 37.71 | compatible Mozilla/5.0 |
2 | 1133 | 22.63 | DotBot/1.2 |
3 | 935 | 18.68 | claudebot |
4 | 755 | 15.08 | MJ12bot/v1.4.8 |
5 | 111 | 2.22 | SemrushBot/7~bl |
6 | 42 | 0.84 | YandexBot/3.0 |
7 | 39 | 0.78 | Googlebot/2.1 |
8 | 32 | 0.64 | AhrefsBot/7.0 |
9 | 17 | 0.34 | Linux x86_64 |
10 | 11 | 0.22 | Barkrowler/0.9 |
11 | 8 | 0.16 | FriendlyCrawler/Nutch-1.20-SNAPSHOT |
12 | 7 | 0.14 | BLEXBot/1.0 |
13 | 6 | 0.12 | Friendly_Crawler/Nutch-1.20-SNAPSHOT |
14 | 5 | 0.10 | DataForSeoBot/1.0 |
15 | 5 | 0.10 | CCBot/2.0 (https://commoncrawl.org/faq/) |
16 | 4 | 0.08 | wpbot/1.0 |
17 | 2 | 0.04 | netEstate NE Crawler (+http://www.websit... |
18 | 2 | 0.04 | DotBot/1.1 |
19 | 2 | 0.04 | SeekportBot |
20 | 1 | 0.02 | facebookexternalhit/1.1 (+http://www.fac... |
21 | 1 | 0.02 | python-requests/2.31.0 |