A GNET research report highlights that current AI-based content moderation systems are failing to detect cartel-related content due to a reliance on training data optimized for traditional terrorist propaganda. The study notes that criminal groups are successfully exploiting these detection gaps through coded language and cultural signaling, posing significant safety risks to minors on major streaming and social platforms.
The failure to detect cartel activity creates significant legal exposure for streaming and social platforms under the EU Digital Services Act and U.S. material support statutes. As criminal syndicates like CJNG and the Sinaloa Cartel adopt the decentralized digital strategies of ISIS, existing automated filters are proving insufficient for the nuanced cultural signaling used to groom minors. This misalignment suggests that current trust and safety budgets are not keeping pace with the formal expansion of terrorist designations. Industry observers should monitor whether the European Commission issues further non-compliance findings against Meta and TikTok regarding their recommendation algorithms and default safety settings for vulnerable users.
As platforms struggle with these moderation gaps, the industry is increasingly looking toward Open Agent Safety Platform initiatives to better quarantine harmful automated content.
Latin American cartels are bypassing safety filters on TikTok and Meta by using coded language and cultural signaling to recruit minors. A GNET report highlights that AI systems trained on traditional terrorist propaganda fail to detect these criminal tactics, creating significant legal exposure for platforms under the EU Digital Services Act.
Automated systems are primarily optimized for English and Arabic content related to traditional terrorist groups like ISIS and al-Qaeda, making them ineffective at identifying the specific regional slang, narcocorrido audio, and emojis used by cartels.
Platforms face potential legal exposure under the EU Digital Services Act and U.S. material support statutes due to their failure to adequately moderate criminal recruitment content that targets vulnerable users.
Cartels use disguised job postings for security guards to lure individuals, which has led to forced conscription at locations like the Rancho Izaguirre extermination camp.
TikTok closed its Nashville office, resulting in the loss of 250 roles, including moderators who were essential for providing culturally specific oversight of content.
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source
