SMRTR AISep 10, 2025Ars Technica

Pay-per-output? AI firms blindsided by beefed up robots.txt instructions.

SMRTR summary

Major websites like Reddit, Yahoo, and Medium have introduced "Really Simple Licensing" (RSL), an open protocol expanding robots.txt to include licensing terms for AI companies using their content. RSL offers compensation models such as pay-per-crawl and pay-per-inference. Founded by former executives from Ask.com and Yahoo, RSL addresses publishers' traffic decline issues and AI companies' need for fresh content. Publishers can implement RSL immediately, with enforcement through technical measures and potential legal action.

SMRTR provides this summary for quick context. The original article belongs to Ars Technica.

Read the original article
SMRTR AI

Get the next batch of curated stories in your inbox.

This archive is built from SMRTR newsletter stories. Subscribe for hand-picked stories without the extra noise.

Related Stories

Browse AI
AIAug 27, 2026

SpaceKit AI

SpaceKit AI is a public research hub for Growformer, an ML system with a promote-freeze neural substrate, language model experiments, neural cellular automata, and reproducible...

AIAug 27, 2026

Small Models Have Arrived

Small AI models are now 10x cheaper than before, making high-volume consumer and business AI apps financially viable—tasks costing $1 now cost ~$0.10, enabling affordable,...

AIAug 27, 2026

Why I Am Right About AI

The piece satirizes tech-bro certainty about AI replacing writers, using absurd logic and fake statistics to parody real thought leaders—exposing how hollow and self-serving those...