I have a scraper that watches ten sites I consider adjacent to my work. It has been running since early July. The output goes into a vector store that nothing currently reads, which is the only reason this story ends without a lawyer in it.
Source: [Dev.to](https://dev.to/mk023/a-permissive-robotstxt-is-not-a-licence-2m3i)