Apple and Google's Parental Controls Fail to Block Nudification Apps

Researchers found that Apple and Google's parental controls are ineffective in blocking access to nudification apps, which can be used to create non-consensual intimate images.

File photo: Apple Has New Parental Controls for Your Kid's iPhone. Here Are ...
· www.nytimes.com / License metadata unavailable · Image source & licence

A recent report by The Guardian found that Apple and Google's parental controls are ineffective in blocking access to nudification apps. Researchers were able to access and use these apps despite the controls being activated. One face-swapping app, which was advertised with an image of a woman performing oral sex, was rated appropriate for ages four and up. The free version of the app prompted users to superimpose real women’s faces on to templates of women in lingerie or, if users paid, in pornographic situations.

Apple and Google have implemented changes to strengthen content moderation guidelines. Apple now requires developers to preemptively prevent and remove nonconsensual intimate imagery, including AI-generated images. Apple also reviews every app before it is published and removes those that misrepresent features. Google regularly takes proactive steps to detect and remove apps with harmful content.

Sources1
Claim connections2

Researchers found that one face-swapping app, which was advertised to them with an image of a woman performing oral sex, was rated appropriate for ages four and up.

confirmed
Connected sources1

Apple and Google have implemented changes to strengthen content moderation guidelines.

confirmed
Connected sources1