Updated
Updated · Ars Technica · Jul 17
Google Suspends 5 AI Nudification Apps After San Francisco Demand
Updated
Updated · Ars Technica · Jul 17

Google Suspends 5 AI Nudification Apps After San Francisco Demand

3 articles · Updated · Ars Technica · Jul 17

Summary

  • Five apps flagged by San Francisco City Attorney David Chiu were suspended from Google Play after his office demanded Apple and Google remove 13 AI nudification apps.
  • Chiu’s cease-and-desist letters said the stores were violating California laws barring support for deepfake pornography services that generate non-consensual explicit images.
  • Google said the apps breached its harmful-content rules and that it has already suspended hundreds of similar apps while restricting search terms such as “nudify” in the store.
  • Wired reported one unnamed app had more than 1 million downloads, underscoring Chiu’s warning that the tools are widely used to bully, humiliate and threaten women and children.
  • Chiu’s office estimates Apple and Google likely made millions of dollars in fees from the apps, widening pressure on app stores to improve detection and enforcement.

Insights

With a new federal deepfake law in effect, why are platforms still profiting from these harmful apps?
Beyond banning a few apps, can tech giants ever truly control the powerful AI tools they host?