Open source devs are fighting AI crawlers with cleverness and vengeance

AI web-crawlers: the tireless digital vermin scuttling past robots.txt files to unleash DDoS chaos on open-source projects. Developers aren’t taking it lying down. Armed with inventive weapons like the Anubis challenge and tools like Nepenthes, along with Cloudflare’s mysterious AI Labyrinth, they repel these unwelcome intruders. Some have even resorted to the nuclear option—blocking entire countries—to outsmart these voracious crawlers.