◆ GENERAL · Products
Apple's App Store holds AI generators to social-app rules
The News
In App Review Guidelines revised October 16, 2026, Apple added nonconsensual intimate imagery to the challenges of apps that let users create or contribute content. New guideline 2.5.19 bars hidden, dormant or undocumented features, clarifying long-standing policy, Apple says. Section 5 says apps found to facilitate human trafficking or child exploitation will be removed and blocked from alternative distribution.
Chandni Melwani
Founder & Editor
Oct 22, 2026 · 1 MIN READ
Know More
- — 2.5.19's origin: Apple's release notes say the policy was formerly covered in Guideline 2.3.1, which sits under Accurate Metadata.
- — Authorities: notified in extreme cases, Section 5 says, such as apps found to facilitate human trafficking or child exploitation.
- — Same update: new guideline 2.3.14 covers creative assets; translations due within one month of October 16.
On October 16, Apple clarified which apps fall under guideline 1.2, and the guideline now names “AI content creation apps” beside social media. Each must include a method for filtering objectionable material, reporting with timely responses, a way to block abusive users and published contact information.
Apple’s announcement says apps must “proactively prevent and remove” nonconsensual intimate imagery. The guideline doesn’t say “proactively”; it makes removing violating content “your responsibility.”
Apple’s post says its hidden-features ban covers apps that “misrepresent their purpose during review and only reveal harmful capabilities — such as ‘nudification’ — after approval.”
In April, the Tech Transparency Project (TTP) found 18 of 46 App Store apps it tested could nudify or undress women. In July, San Francisco’s city attorney sent Apple and Google cease-and-desist letters over 13 apps. Minnesota’s nudification ban took effect August 1; on October 2 the Eighth Circuit granted xAI an injunction pending appeal. Apple’s posts mention none of them.
The Read
Apple says it evolves its guidelines 'as new risks and novel user experiences emerge,' and 1.2 now names AI content creation apps alongside social media and user-generated content platforms. AI content creation apps will probably face App Review questions about filtering, since 1.2 requires 'a method for filtering objectionable material from being posted to the app.'
Room for Disagreement
Naming AI apps may change little. Before October 16, guideline 1.2 already required filtering from 'apps with user-generated content,' and in July Apple said it had 'proactively rejected many' nudify apps 'and removed many others, including when users have flagged them via our reporting tools.'
Related
Frequently Asked Questions
Does Google Play allow nudify apps?
Not under its policy. Google Play's inappropriate-content policy says it doesn't allow apps that 'distribute non-consensual sexual content,' and its examples of common violations include 'apps that claim to undress people or see through clothing, even if labeled as prank or entertainment apps' and 'non-consensual sexual content created via deepfake or similar technology.' In July, a Google spokesperson told Wired the company had deleted 'hundreds' of apps with nudification features, Engadget reported.
What did Apple say about nudify apps before October 16?
In a July statement to Engadget, Apple said 'Nudification' apps 'are against our App Review Guidelines' and that it had 'proactively rejected many of these apps and removed many others.' Of the apps in San Francisco's letters, it said it had removed three and was 'in the process of terminating their developer accounts,' and that it was in contact with four others that needed to address policy violations or risk removal. Its October 16 post says pornographic material 'has long been prohibited on the App Store.'
What did the Tech Transparency Project's April report find?
TTP searched both stores for terms including 'nudify,' 'undress' and 'deepnude,' then tested the top ten apps returned for each search. It said Apple and Google ran ads for nudify apps in some of the results and that their autocomplete suggested additional nudify search terms. The nudify apps its searches surfaced, across both stores, had been downloaded 483 million times and made more than $122 million in lifetime revenue, by AppMagic's data, and 31 were rated suitable for minors. Apple declined to comment, and removed 15 apps after TTP and Bloomberg News shared them.
Sources
- Apple Developer, Strengthening App Review Guidelines against nonconsensual intimate imagery and bait-and-switch apps, October 16, 2026. Source for 'proactively prevent and remove', explicit coverage of nonconsensual intimate imagery including AI-generated imagery, the hidden-features ban covering apps that reveal harmful capabilities after approval, pornographic material having long been prohibited, and evolving the guidelines 'as new risks and novel user experiences emerge.'
- Apple Developer, Updated App Review Guidelines are now available, October 16, 2026. Source for 1.2 clarifying the app types it covers, 2.5.19 as a new guideline clarifying long-standing policy formerly covered in 2.3.1, new guideline 2.3.14, the Section 5 clarification and translations within one month.
- Apple, App Review Guidelines, last updated October 16, 2026. Source for the text of guidelines 1.2, 2.3 and Section 5, including nonconsensual intimate imagery among the challenges of apps that let users create or contribute content, AI content creation apps, the four duties of user-generated content apps including 'a method for filtering objectionable material from being posted to the app', and notifying authorities.
- Internet Archive, App Review Guidelines as captured October 15, 2026. Source for guideline 1.2's earlier wording, under which 'apps with user-generated content or social networking services' had to include a method for filtering objectionable material.
- Tech Transparency Project, Apple and Google Are Steering Users to Nudify Apps, April 15, 2026. Source for 18 of 46 Apple apps that could nudify or undress women, the search terms and method, ads and autocomplete, 483 million downloads and more than $122 million in revenue (AppMagic), 31 apps rated suitable for minors, and Apple's 15 removals.
- Engadget, Apple and Google ordered by San Francisco attorney to take action against 'nudify' apps, updated July 18, 2026, citing Wired. Source for the cease-and-desist letters over 13 apps, Apple's July statement, including rejecting and removing nudify apps, user flags through its reporting tools and being in the process of terminating the developer accounts behind three of the apps, and the Google spokesperson's 'hundreds' of deleted apps.
- Minnesota Lawyer (Reuters), 8th Circuit pauses Minnesota law barring 'nudified' photos, October 5, 2026. Source for the Eighth Circuit granting xAI's request for an injunction.
- Google Play Console Help, Inappropriate Content policy. Source for the ban on distributing non-consensual sexual content and the examples of common violations quoted in the FAQ.
- Hero photo: Apple Park Visitor Center, by Fastily, Wikimedia Commons, licensed CC BY-SA 4.0
- Creative Commons Attribution-ShareAlike 4.0 International licence, which applies to the hero photo
Chandni Melwani
Chandni Melwani is the founder and editor of New in AI, covering AI agents, M&A, and enterprise adoption. She holds a Master's in Management of Artificial Intelligence from Queen's University and brings a practitioner's perspective from her work in Data and AI leadership.
Follow ↗General Briefing
Get the five-beat briefing in your inbox.
The big story, frontier labs, AI at work, e-commerce and the capital crossing borders, each with the part that tells you why it matters, not just that it happened.
Free · No spam · Unsubscribe in one click
More from General
Money
Meta prices stock offerings it says support AI infrastructure investment
Meta priced a $25bn Class A stock offering tied to forward sale agreements and $12.5bn of mandatory convertible preferred stock on October 26, 2026, offerings it says support its continued investment in AI infrastructure and personal superintelligence. Nvidia, AMD and Broadcom indicated non-binding interest in buying up to $5bn of the Class A shares between them, and Nvidia says it will invest $3bn in Meta's equity offering; its forward-looking statements call this its 'proposed investment in Meta'.
Chandni Melwani · US · Oct 29, 2026
Legal
Ex-OpenAI engineer denied bail as judge questions Saudi bond offer
Abdulrahman Alfozan, a former OpenAI engineer accused of hiding a recorder in an executive conference room, was ordered detained without bail pending trial, KQED reported, at a hearing where the judge questioned an offer by Saudi Arabia's Los Angeles consulate to cover his bail bond. He is presumed innocent.
Chandni Melwani · US · Oct 23, 2026
Money
FAA seeks part-ownership of its AI vendor, Politico reports
The FAA is working to acquire an ownership stake in Air Space Intelligence, the startup behind its AI-supported SMART air traffic tool, according to an internal FAA document Politico reviewed. It's unclear whether any final deal is imminent, Politico said. On October 13, 23 House Democrats asked the GAO to audit the FAA's rollout of SMART and a related system.
Chandni Melwani · US · Oct 21, 2026