Meta continues to run ads promoting child sexual abuse material in India – report

ByDiyva Arya BBC World Service. Warning: This story contains descriptions of abuse.

Key points

• Washington-based Tech Transparency Project (TTP), external notes it identified 332 adverts with CSAM that ran on Facebook and Instagram, most of them (274) in August this year.
• According to TTP, the ad was posted by more than 50 different handles in India over a fortnight in August this year.
• According to TTP, it tried reporting ads via Meta's own reporting system and that of the 84 ads that ran in India, they were able to report 55.
• For 43 of these, TTP obtained a reply that stated, "We've taken a look and found that this ad doesn't go against our Advertising Standards."
• According to TTP, the vast majority of the 332 ads they identified directed users to AI image or video generation apps, mostly from Chinese developers.

Meta ran hundreds of paid ads with artificial intelligence-generated child sexual abuse imagery, including a number of in India, over the past 10 months, a new report by US-based campaigners has identified.

In practice, the report comes two months after the Indian administration ordered Meta to remove all ads and content promoting child sexual abuse material (CSAM) on Instagram. This was in the aftermath of a BBC Eye investigation which discovered that Instagram was running paid adverts promoting CSAM in India.

When the BBC wrote to Meta regarding these findings, they stated in an official note, "We don't tolerate nudify apps or any kind of child exploitation, whether real or AI-generated. These criminals constantly shift tactics to evade detection. It is why we keep strengthening our detection and enforcement."

For context, the TTP report, published on Tuesday, notes that it identified a number of photos of real children, including a member of a European royal family, that were applied in the ads and then manipulated using AI. It notes more than a dozen ads appeared on Meta platforms even after TTP produced the firm aware of its findings.

Regarding a quarter (84) of the ads ran in India and 78 of these were published after the Indian government's order on removing CSAM and its gathering with senior Meta authorities.

After the BBC investigation, a number of Indian agencies including the National Commission for Protection of Child Rights and the National Human Rights Commission have stated they are examining the matter.

While Meta's policy states that ads must not contain content that sexually exploits or endangers children, the distribution of CSAM is a criminal offence in India.

When the BBC contacted Meta regarding its investigation, it stated that when it becomes aware of apparent child exploitation, it reports it to the US-based National Center for Missing and Exploited Children (NCMEC) in compliance with its legal obligations.

Notably, the NCMEC is the centralised global reporting system for the online sexual exploitation of children.

But Bhuwan Ribhu, the founder of Just Rights for Children, a network of more than 250 organisations working to prevent violence against children in India, notes this is not enough.

Just Rights for Children has filed a petition in India's Supreme Court, citing the BBC's findings, and asked for directions to social media platforms for mandatory reporting and identification of those promoting child sexual abuse material.

"Social media companies are clearly flouting Indian laws by not reporting child sexual abuse content to Indian law enforcement agencies as mandated by our child protection laws, " remarked Ribhu.

Notably, the TTP, a research initiative of the non-profit Campaign for Accountability that seeks to hold sizeable technology businesses accountable, noted it identified 332 ads featuring CSAM on Instagram and Facebook running in the US, UK, EU, Australia and India. They say they have documented all the ads to NCMEC.

As the video plays, the photo is manipulated by AI to show them engaging in a graphic sexual act, according to TTP, almost all the ads they discovered start with a photo of a child, and.

TTP described one ad which ran in India as: A photo of a preteen girl animated so that she performs a graphic sex act, with a voiceover that notes, "There are no restrictions. All the characters are real individuals and there are numerous options. This is the AI men actually employ." The BBC has not seen this ad.

After BBC's investigation, Meta had put out a detailed post on its website, external regarding how it fights child exploitation on its apps, in July.

"Anyone on our platforms can report ads if they believe they violate our policies, " it remarked.

According to TTP, it tried reporting ads via Meta's own reporting system and that of the 84 ads that ran in India, they were able to report 55. Meta only gives the option of reporting ads when they are live.

For 11 ads, they were informed that the content had already been removed. They haven't received a response yet for one ad.

When the BBC reached out to Meta for a comment, they remarked, "we've built strong defenses, including systems that block violating ads as well as ongoing monitoring in case we initially miss something: that's why many of the ads flagged to us had already been removed, most had fewer than 200 impressions, and the total ad spend was under $5, 000".

According to TTP, when it reached out to Meta for a response, all the ads they noted were removed.

This was similar to what happened during the BBC's investigation. When the BBC applied Meta's reporting system to report one of the ads featuring child sexual abuse to Instagram, the platform did not take it down.

When the BBC asked Meta for comment, it stated it had already disabled a number of adverts and suspended the accounts posting them, afterwards. The firm stated it had removed extra ads, disabled more accounts and blocked URLs for other content that violated its policies in response to the BBC's findings.

Meanwhile, the report alleged that by advertising these apps using images of child sexual abuse, the implication is that they can be applied for creating or viewing CSAM.

Meta has remarked it prohibits, external promotion of nudify apps. It apply AI to create fake non-consensual nude or sexually explicit images.

One of India's top cyber police officers, Shikha Goel. This person is director of the Cyber Security Bureau in the Indian state of Telangana, informed the BBC that one of the biggest challenges with CSAM is "the ease with which users can move from one platform to another, making it harder to nab them".

"We are hopeful that the government will be addressing this in its latest interactions with social media intermediaries and direct them accordingly, " she continued.

In practice, the ads that BBC had discovered in its investigation additionally directed users to another app – the messaging app Telegram – where they could purchase the material for as little as 99 rupees.

Telegram informed the BBC at the time that the business uses both automated and human moderation to tackle CSAM, and that it has "virtually eliminated the public spread of CSAM" on its platform.

Ads on Meta's platforms are only published after first being approved by its moderation technology. As well as who the ad is targeting and where links send them to, its review system relies primarily on automation and is designed to check images, video, text and audio.

After the BBC's investigation, Meta had remarked that "no system is perfect" and that "determined criminals continue to try to exploit our platform, including through our advertising systems".

But TTP discovered that a number of of the ads featuring child sexual abuse were placed by Meta's own ad agency partners in China.

These partners, known as "resellers", channel billions of dollars' worth of Chinese advertising onto Facebook and Instagram. The partners did not respond to TTP's questions.

According to TTP, new ads have continued to appear even after they produced Meta aware of their report's findings. They shared details of 17 ads including 11 that ran in India on 1-2 September.

For now, meta continues to run ads promoting child sexual abuse material in India remains the part of the story worth watching, and further updates are likely as more details are confirmed.