Pay-per-output? AI firms blindsided by beefed up robots.txt instructions.
Major websites like Reddit, Yahoo, and Medium have introduced "Really Simple Licensing" (RSL), an open protocol expanding robots.txt to include licensing terms for AI companies using their content. RSL offers compensation models such as pay-per-crawl and pay-per-inference. Founded by former executives from Ask.com and Yahoo, RSL addresses publishers' traffic decline issues and AI companies' need for fresh content....