Tech giants STILL aiding predators, putting young girls at risk

Predators target preteens on Instagram + Etsy child sex abuse material

Fifty-nine child protection organisations and experts sign open letter to Zuckerberg 

We’ve had another #WakeUpInstagram campaign win, with Instagram announcing the following new measures to help protect young people from predators:

We were pleased to make a submission to the European Commission's public consultation on Child sexual abuse online - detection, removal and reporting.

We've had another major #WakeUpInstagram win, with Instagram's rollout of new tools to help protect underage users from predators on the platform including:

Update: UN adopts General Comment on children's online rights (February 11, 2021)

The United Nations now recognises that children’s rights extend to the online realm. These rights - and the responsibilities they invoke on world governments and corporates regarding issues such as children’s online safety - are outlined in the Committee on the Rights of the Child's General Comment 25.

*Content warning: child exploitation references

UK children’s charity says platforms have duty of care to keep kids safe

[UPDATED] Finally - after action from eSafety - Instagram has deleted three accounts we reported for child exploitation. The accounts posted explicit imagery of young girls in lingerie and swimwear, with with captions like 'hot young teen booty'. One account promoted a 'lingerie contest' using an image of a 14 year old Australian model in a g-string bikini, advertised a link to the deepnude website (read more about this exploitative app here) and sold spots in a private chat group for access to 'uncensored content', referring to images of teens as 'jerk-off material'.

These accounts are exploitative and degrading. This isn't Pornhub - it's mainstream social media.

Girls deserve better than the so-called 'dedication' to child safety Facebook is offering. We've heard enough talk. It's time for Facebook to stop facilitating child exploitation on its platforms.

Just overnight, Facebook announced a 'renewed commitment' to child safety. We hope this isn’t more PR spin.

Last year, Minister for Home Affairs Peter Dutton labelled Facebook cofounder and CEO Mark Zuckerberg ‘morally bankrupt’ for plans to introduce end-to-end encryption across all Facebook-platform private communication tools - a move which would aid sex predators and the exchange of child exploitation material, and endanger children further.

We’ll be watching to see how Facebook’s commitment plays out.

Between April 2017 and October 2019 police recorded over 10,000 incidents of online grooming in England and Wales. Where the communication method was known, fifty-five per cent occurred on Facebook-owned platforms, with more recorded on Instagram than any other individual platform. The UK’s National Society for the Prevention of Cruelty to Children has used this data to bolster a call for regulatory measures to hold social media platforms to account for facilitating these crimes.

Source: NSPCC via BBC

Facebook responded:

There is no place for grooming or child exploitation on our platforms and we use technology to proactively find and quickly remove it.

Facebook served up similar public relations spin last year in response to our collaborative, international #WakeUpInstagram campaign. But for almost a year, we’ve documented the failures of Facebook’s proactive tech and content-moderating system to keep kids safe from predators, harassment, exploitation and abuse. Earlier this year we pointed out that by giving predators unfettered access to underage girls, Instagram is complicit in normalising the idea that they are available for sexual gratification - an idea that has real-world consequences for girls. 

Last month Facebook released its latest Community Standards Enforcement Report, including data on takedown of content that violated Community Guidelines. It reported a proactive takedown rate of 97.7% of content that exploits children, and said that the other 2.3% was removed by human moderators. Facebook said that views of child exploitation content were ‘infrequent’,  estimating that there were no more than five views of violating content for every 10,000 views.

These figures related only to the violating content that Facebook actioned. What about all the violating content they didn't action, or the content that wasn't reported, or even found, because it was hidden behind private accounts, in unsaved stories and live posts, or in DMs and messenger rooms? Is Facebook keeping tabs on those views of child exploitation?

On May 20 we reported an account which posts explicit imagery of children - imagery which Facebook's 'proactive tech' failed to detect and remove. At the time of writing - two weeks later - the account (with nearly 2000 followers and 65 posts) is still active and posting child exploitation material. The longer this page is up, the more followers it gains and the more images it posts, the higher the number of views of child exploitation. Will these be counted?

How does Facebook defend its claim that, regarding content that exploits children, they 'do not find enough violating samples to precisely estimate prevalence'? Is turning a blind eye to it really a defense? Whose interests are served by pretending it doesn't exist?

While Facebook has a clear and comprehensive child nudity/exploitation policy, the sexualisation, harassment and exploitation of children on Instagram is rampant. Users don't heed the policy, and moderators don't consistently enforce it.

COVID-19 is having an exacerbating effect. As experts have warned, children are now at more risk of online sexual exploitation than ever. In keeping with this tragic trend, we recently discovered and reported hundreds of Instagram accounts for child exploitation activity - many of which were created after the start of COVID-19 lockdowns.

Just last week we reported a new Instagram account which was posting images of a pre-teen girl dressed in pink lingerie and advertising images for sale on Patreon and Boosty (read more about this - including our action and win - here).  Instagram's response to reports is generally slow, though, and most often consists of a standardised reply that says due to COVID-19 they 'can't prioritise all reports right now'. 

Undoubtedly, Facebook's 'transparency' data for the COVID-19 period will present outliers. But as our investigations and NSPCC's data show, Instagram's serious child predator and exploitation problems and failure to keep kids safe long predate the current global pandemic.  

Facebook recently appointed an Oversight Board to arbitrate content takedown decisions. It's unclear whether this will improve child safety on its platforms. What is clear is that big tech and social media companies like Facebook are part of the child sexual exploitation supply chain. And through its public relations spin, lack of transparency and weak policy enforcement, Facebook is aiding predators and hurting children.

Read more about NSPCC's call for regulatory measures to hold tech and social media heads accountable for child exploitation here.

See also:

No Facebook, you're not doing enough to protect children.

Instagram CEO says 'can't post nudity'. Why did we have to repeatedly report content to police?

Instagram a “predator’s paradise”: Collective Shout joins anti sexploitation groups in global campaign

Instagram hosts sharing of child sex abuse fantasies

Graphic rape comments fuel #WakeUpInstagram campaign

Instagram's 'nudity' rules don't keep kids safe

Recently Instagram CEO Adam Mosseri was questioned by online celebrity news group The Shade Room over the removal of a live post, hosted by Tory Lanez' 'Quarantine Radio' account. In his response Mosseri stated: 

How Instagram broadcasts live sex acts to kids

*Content warning: this article describes real events that may be distressing for readers

As a researcher and campaigner advocating for an end to the objectification of women and sexualisation of girls, I follow dozens of underage girls on Instagram. They are aspiring models, gymnasts and dancers. They pose in swimwear and leotards. I watch how they use Instagram to promote a new brand-name bikini, or to exhibit their latest ventures in flexibility: an attempt at oversplits or a contorted backbend. Some of the girls have hundreds of thousands of followers. We - their followers - didn't have to look for them: Instagram’s search , ‘Explore’ and ‘Suggested for you’ features served them to us in an algorithm-procured gallery of pre-pubescents and young teens that caters to the predator’s eye.

An Instagram feed filled with prepubescent girls in bikinis

The setting is a picture of after-school normality: an average kitchen in a home in Australian suburbia. Two girls in school uniform do what kids up and down the eastern seaboard are doing: arriving home after a long day of school, they dump their school bags and head to the kitchen to make a snack. 

One of the girls - 14 according to information on her Instagram account - casually picks up her phone. Still in her uniform (easily providing information about what school she attends and where) she opens Instagram and with a tap of an icon starts a live post: a livestream video that her followers can watch. Instagram even promotes the live broadcast. I, one of her 12,000 algorithm-procured followers - and one of hordes of strangers whose identities, whereabouts and motives for watching a 14 year old girl are unknown - get  an Instagram notification that she’s started a ‘live’. I click her avatar to start the livestream, and instantly I’m transported into the family kitchen. The girl and her friend occupy the foreground, creating a soundtrack with teenage chatter. In the background is a fridge plastered with photos, bills and reminders – artefacts of average family life. 

One of the 50+ viewers makes a request to ‘be in’ the ‘live’. This request is one of Instagram’s built-in live-post features that allows viewers to interact with the host via a simultaneous, live video broadcast which the other viewers can see. The girl accepts the request, smiling curiously at the screen as she scans viewers’ incoming comments. As she does, my screen splits horizontally, making way for the viewer’s live video broadcast. 

The viewer is a man. He is naked. And he is masturbating.

The girl bursts into nervous laughter and steps out of view, leaving viewers to watch the fridge and the man. He repositions his phone to show his genitals from a different angle before his school girl host returns, hand over mouth, and ends his live video. With the screen to herself again, she continues her live post giggling, while, from off-camera, her friend makes a comment to the effect that they shouldn’t be laughing: it’s not funny.  But they don’t appear all that shocked. It’s almost as if this isn’t the first time a stranger has made a sexual approach this way, as though this after-school event is also normal. Parents aren’t told, no alarm is raised. They continue with their live post - even accepting another viewer’s request to be in the live post.

An underage girl has just – with no moderation or intervention from the global multi-billion dollar Facebook-owned platform - broadcast a live video of a naked man masturbating. She and her friend - and fifty other people - just witnessed a serious criminal act, prohibited by Australia’s Commonwealth, state and territory child exploitation material laws.  

Who else witnessed the live sex act? Other school friends? Perhaps younger children – cousins or neighbours who tuned in to catch up on some big-girl news? How widely did Instagram disseminate this piece of child exploitation material that it failed to moderate and helped produce? How many times is this scene being played out in Australia each day? How many kitchens and bathrooms and bedrooms of Australian homes are being infiltrated by predators who want to abuse underage girls in this way? How many men are using Instagram to broadcast live sex acts to children? Has this type of criminal behaviour become ‘normal’ for girls who have been desensitised to predatory advances because sexual objectification, harassment and predation are so entrenched in their everyday, lived experiences? Why - in flagrant disregard of human rights, law, child safety principles and common sense - is Instagram connecting predators to minors?

Four days later our concerns that this event was not a one-off, that predators are targeting underage girls for the purpose of broadcasting live sex acts to them and that this is 'normal' for some girls were confirmed when we found the public Instagram account of a 9 year old girl based in Europe. She had saved a live post to her profile, allowing anyone to watch it for the 24-hour period that followed. We watched the video and saw that it was interupted several times as the young girl accepted requests from different viewers to be in the broadcast. We counted three different viewers who filmed themselves masturbating. We then followed the girl. Within an hour we received a notification from Instagram that she had started a live post. We began viewing the video immediately and within seconds she accepted a viewer's request to be in the broadcast. It was another naked, masturbating man.

In the week since I first saw men masturbating via live videofeed at those girls, I have not been able to erase the images from my mind. These are among the most disturbing things I’ve come across since my colleagues and I began investigating hundreds of predatory approaches to underage girls through their Instagram pages. Within a short time of making a report to Instagram about the 9 year old girl her account was removed. But how many backup accounts does she have? How long until she creates a new account? How long until Instagram reconnects her old followers to her? How long before they're again using Instagram as a webcam to broadcast live sex acts to her and other children? How many other victims are there? And what does the future hold for these girls who have been groomed by Instagram's predators to believe that men exposing and rubbing their genitals at them is normal? Will they be safe from unwanted sexual advances from their bosses and colleagues? From strangers? Will the #MeToo movement mean anything for them? Will others enable men to harass or commit other heinous, sexual crimes against them, the way Instagram did in their childhood?

Our investigation began last July and demonstrated how Instagram serves as a pedophile directory and forum. We reported web-based pedophile forums containing direct links to underages girls’ Instagram accounts, in which pedophiles described violent sex abuse fantasies involving Instagram’s child models, gymnasts and dancers - girls as young as one. We reported multiple examples of child exploitation material. 

In November 2019, Collective Shout, in coalition with the National Centre on Sexual Exploitation in the US and Defend Dignity in Canada, launched #WakeUpInstagram - an international campaign to hold Instagram and Facebook executives accountable for the exploitation and predation of underage girls on their platform to try to leverage our combined weight to force the platforms to act. 

We then wrote to Instagram’s Head of Global Policy with some of our key discoveries, including countless sexualised and predatory comments made by men to underage girls, and to ask Instagram to address its widespread child predator problem. In the letter we made several recommendations and asked Instagram to stop adults from contacting minors during live posts. Having viewed several live posts hosted by girls as young as 11, we knew that men were using ‘lives’ to harass and solicit sexualised content from minors. 

Three months later – while Instagram’s investigations continued - we witnessed yet another example of how Instagram caters to predators and even facilitates criminal behaviour, and how girls’ safety and well-being are sidelined. Instead of safeguarding children, Instagram is bringing child predators - naked and masturbating in real-time - into their homes. 

Instagram’s catchphrase rings of utopian ideals of boundless connectivity: “Bringing you closer to the people and things you love”. When juxtaposed against our discoveries which show that the ‘people’ are often predators, and the ‘things’ they love are underage girls, the slogan rings sinister. Nowhere in society are we fostering connections between child predators and children. In fact we are vigilant in our efforts to prevent such connections. Why are the rules different for social media companies? Shouldn’t Instagram not only stop connecting predators to children but work fastidiously to prevent these connections? 

Instagram does prevent certain adult-child connections: those between parents and their children. According to its “Tips for Parents” Instagram can’t - due to privacy laws - give a parent access to their 13+ year old child’s account. But an Instagram-procured predator who wants to masturbate at a child has the freedom to do so. 

In a timely report, the United Nations Special Rapporteur on the sale and sexual exploitation of children highlighted some of the dangers of social media that we - through the #WakeUpInstagram campaign - are calling on Instagram's corporate leaders to address:

'Offenders, traffickers and criminal groups use Internet tools, such as social media, to identify child victims more easily and establish relationships, subsequently intimidating them into exploitative situations.'

The report further pointed out that offenders are empowered by impunity:

'Ultimately, the essential feature of most offenders is their knowledge or belief that their actions will go unpunished'. 

Our investigations have shown that predators are fed a steady stream of victims via Instagram’s algorithms and that predators are free to roam and prey at will, not just with impunity but with the endorsement of moderators who tell us their behaviour ‘doesn’t go against community guidelines’. 

Australia is at the forefront of global efforts to improve online safety. The Office of the eSafety Commissioner’s user-centred initiative, Safety by Design, was the outcome of consultation with industry, service providers, parents and young people and resulted in a set of principles that prioritises user rights and safety. Safety by Design highlights the imperative role of service providers like Instagram in the broader context of shared responsibility for online safety. It spells out eight initiatives designed to 'ensure that known and anticipated harms have been evaluated in the design and provision of an online service'. 

In the same week we witnessed how Instagram is used by sex predators to broadcast live sex acts to children, its parent company Facebook committed to a set of new, voluntary standards developed by the Five Country Ministerial (represented by government Ministers of Australia, the United States, the United Kingdom, Canada and New Zealand) to combat online child sexual exploitation and abuse.

Can Instagram abide by these principles and standards without a drastic overhaul to its ethos and operations? While it is underpinned by ideals like boundless connectivity which connects child predators to children? While it stands by community guidelines that accommodate the sexual harassment of little girls? While it indiscriminately gives its users tools - like 'Explore' and live posts - which predators can use to find child victims and commit sexual crimes against them? 

As Campaigns Manager Caitlin Roper warned:

'We cannot overlook the significance of a wider culture that sexualises children and treats them as appropriate objects of men’s sexual desire.'

Instagram - through its predator-friendly policies and practises - has fostered a community that fetishises underage girls and helped fuel a culture that normalises their sexualisation and harassment. Now - as well as upholding the principles it has committed to, Instagram must work to eradicate its child predator community, and to foster a culture in which the sexualisation, harassment, exploitation and abuse of children is unthinkable. We owe it to girls and women - this and future generations - to make sure they do.

Note:

• If you are concerned about suspected online child exploitation material, make a report to the eSafety Office.
• If you are concerned about an adult behaving inappropriately online toward a child, make a report to the Australian Federal Police.
• Make an anonymous report to Crime Stoppers or phone their toll free number 1800 333 000.

See also:

Insta must act on predators: Collective Shout letter to platform heads

eSafety commissioner backs Collective Shout's call for Instagram overhaul

I was so concerned about porn-themed portrayals of young girls on Instagram I reported to police

Melinda Tankard Reist on ABC Radio National discussing the #WakeUpInstagram campaign

If Instagram can restrict diet products they can stop child sexual exploitation

‘Sexy girl’: How Instagram allows the offering of young girls as fetishised flesh

Tech companies turn a blind eye to child sexual abuse material