Wikipedia is struggling with voracious AI bot crawlers
SMRTR summary
Wikimedia reports a 50% increase in bandwidth usage since January 2024, primarily due to AI crawlers scraping content for generative AI models. This surge in bot traffic, accounting for 65% of resource-consuming traffic, risks slowing page access and increasing costs for the foundation, prompting efforts to establish sustainable content access methods.
SMRTR provides this summary for quick context. The original article belongs to Hacker News.
Read the original article