Battle of the Bots: How to Fight Back Against Bad Crawlers

Session Category Desarrollo Room Salón 3 Audience Intermedio Time Slot Sáb 10:00am to 10:45am (2/28/26)

Your robots.txt says “no,” but the bots just keep coming. Whether it’s rogue scrapers, outdated SEO tools, or overly aggressive crawlers ignoring the rules, these silent invaders can eat up bandwidth, slow down your site, and skew your analytics.

In this session, we’ll walk through how to identify bot traffic that's hurting your performance, and what you can do about it—from passive measures like improved robots.txt and rate limiting, to more active strategies like header-based detection, firewall rules, and bot management services.

You’ll leave with a practical playbook for protecting your Drupal site from the dark side of automation—without accidentally blocking the good guys.

About the Speaker

Profile picture for user rolo

amazee.io

Solutions Lead | amazee.io