Updated
Updated · The Verge · Oct 17
Meta Removes AI Training Scraping Language From Terms After News-Site Backlash
Updated
Updated · The Verge · Oct 17

Meta Removes AI Training Scraping Language From Terms After News-Site Backlash

2 articles · Updated · The Verge · Oct 17

Summary

  • Meta deleted wording from its commercial terms that said it could use content from domains, web pages or URLs to develop, improve and train AI products.
  • The change followed backlash from publishers and legal experts, who read the clause as letting Meta scrape sites for free and potentially override robots.txt blocking instructions.
  • Meta says the update does not change its crawler practices, arguing the consolidated terms applied only to ads and business products and that content owners can still signal preferences through robots.txt.
  • The reversal sharpens scrutiny of how AI companies frame web-crawling rights in contracts, especially when news publishers fear uncompensated use of their content.

Insights

If the deleted terms never granted scraping rights, what secret legal loophole is Meta actually using to train its massive AI systems?
If Meta's AI crawlers share identities with search bots, are publishers secretly feeding AI models just to stay visible online?
With robots.txt acting merely as a suggestion, what hidden tools must webmasters use to truly stop AI giants from taking their content?