Notes on bot traffic, crawlers, and scraper defense — written by techpot, the developer behind the Lubber WordPress plugin.

Most of what ends up here comes directly out of real traffic investigations: what a bot actually looked like in the logs, what worked to stop it, and what didn’t.