The Australian eSafety Commission reports a 167% year-over-year increase in complaints regarding AI-generated deepfake abuse. In response, the Australian government has introduced criminal penalties and is increasing pressure on technology platforms and app stores to restrict access to non-consensual 'nudify' generative AI tools.
The immediate implication is a shift in liability from individual abusers to the distribution layer, including search engines and app stores. For the streaming and digital media ecosystem, this signals a transition where 'safe harbor' protections for hosting platforms are eroding in favor of proactive moderation mandates. The aggressive stance by Commissioner Julie Inman Grant mirrors global trends where regulators demand that platforms detect and remove synthetic abuse before circulation. Watch for the Australian government to formalize specific accountability standards for gatekeeper services by September 2025, which could serve as a blueprint for other Western markets.
The Australian crackdown aligns with a broader international movement to criminalize synthetic image-based abuse. In the United States, the federal TAKE IT DOWN Act, signed in May 2025, established the first nationwide criminal penalties for publishing non-consensual intimate deepfakes, according to aivortex.io (April 2026). The Act mandates that social media platforms and websites remove such imagery within 48 hours of a valid request, with the Federal Trade Commission already issuing warning letters to 15 major platforms as of May 2026. Per multistate.us, 48 U.S. states have now enacted deepfake-specific statutes, with Minnesota becoming the first to hold AI platform owners directly liable for generated content.
Regulators are increasingly targeting the commercial distribution of these tools. In July 2026, San Francisco City Attorney David Chiu sent cease-and-desist letters to Apple and Google, naming 13 specific nudify and face-swapping apps and demanding their removal from app stores. According to Malwarebytes, research from the Tech Transparency Project (TTP) identified dozens of these apps that had collectively generated over $122 million in lifetime revenue. While Apple and Google have removed hundreds of identified apps, the TTP report noted that roughly 40% of related search results still directed users to services capable of generating non-consensual content.
In the United Kingdom, Ofcom demands immediate Online Safety Act compliance in January 2026, specifically examining the use of the Grok AI tool to generate sexualized imagery. Per The Guardian (August 2026), UK safety watchdogs reported a surge in explicit deepfake reports from children, with the IWF's 'Report Remove' service receiving over 420 complaints in the first half of 2026 alone—already exceeding the total for 2025. These concurrent moves in Australia, the US, and the UK indicate a synchronized global effort to force technology providers to implement robust generative AI safeguards, a trend further evidenced by seven major platforms adopting new policies to protect their reach. This regulatory pressure is mirrored in the Aylo Pornhub settlement which mandates strict ID verification to curb illicit content, while with legal action over similar AI deepfake scams. Such further underscore the growing legislative focus on model accountability.
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source