Google, OpenAI, Anthropic and Microsoft pledge to support a new common signal for robots. txt that blocks scraping for AI training.

Source: [Engadget](https://www.engadget.com/2303225/google-openai-anthropic-ai-crawling-controls/)

Sponsored