Anubis: Fighting off the hordes of LLM bot crawlers
SMRTR summary
Anubis, a new web protection tool, aims to deter AI crawlers by making web scraping prohibitively expensive. The software challenges visitors with a cryptographic puzzle, insignificant for humans but resource-intensive for bot farms. This clever response to increasing AI data harvesting could significantly impact companies relying on large-scale web scraping for their language models.
SMRTR provides this summary for quick context. The original article belongs to Daily.dev.
Read the original article