AI crawlers haven't learned to play nice with websites
SMRTR summary
SourceHut and other online services are blocking some cloud providers and implementing mitigations to combat excessive data requests from AI web crawlers, which have been causing service disruptions and slowing down access for users.
SMRTR provides this summary for quick context. The original article belongs to Hacker News.
Read the original article