Apple came close to booting Grok from its App Store earlier this year, but you probably didn't hear about it. The tech giant quietly threatened Elon Musk's AI app in January after nonconsensual sexual deepfakes started flooding X.
The threat came behind closed doors, even as the controversy played out publicly and critics slammed Apple for staying silent. According to a letter Apple sent to US senators, the company reached out to both X and Grok teams after receiving complaints and seeing news coverage of the scandal.
Apple's demand was straightforward: create a plan to improve content moderation. It's the kind of leverage only a platform gatekeeper can wield, since getting kicked from the App Store would effectively kill an app's reach to iPhone users.
For anyone building or using AI tools, this is a reminder that content moderation isn't optional anymore. The companies that control distribution, like Apple and Google, are watching how AI gets used and they're willing to pull the plug if things get out of hand.
The deepfake issue highlights a growing tension in AI development. These tools are incredibly powerful and accessible, but that accessibility creates real harm when there aren't guardrails in place. Apple's private pressure worked this time, but it raises questions about whether quiet threats are enough when the problems are happening in public.
The incident also shows how app store policies are becoming a major force in shaping AI behavior. If you're building AI products, you're not just answering to users or regulators anymore. You're answering to the platforms that control access to your audience.
