‘Minion accounts’ mean de-platforming Facebook conspiracy theorists has limited impact, Cardiff Uni research shows
Removing high-profile Covid conspiracy theorists from Facebook has had only limited impact upon the spread of misleading information, research from Cardiff University has found.
Fan pages, affiliated groups and other secondary accounts set up by devoted believers continue to share problematic content about the causes and consequences of Covid-19 long after primary accounts have been taken down, the findings reveal.
The team, from Cardiff University’s Crime and Security Research Institute (CSRI), say these “minion accounts” also increase the resilience of conspiracists by encouraging them to diversify their presence across an alternative network of platforms, personal websites and subscription services.
Published in the peer-reviewed journal Information, Communication and Society, the study examines Facebook’s de-platforming of David Icke and Kate Shemirani for repeatedly violating its policies on harmful disinformation during the pandemic, and how followers of these individuals responded to the interventions to limit their overall effectiveness.
Lead author Dr Helen Innes, Research Fellow at the CSRI, said: “Our research shows how de-platforming can sometimes reinforce support for charismatic conspiracists like Icke and Shemirani amongst their adherents. Their removal from Facebook, Twitter and YouTube is framed as a badge of honour, evidence that their actions worried mainstream big tech enough to act against them.
“When this happens, our data shows how their followers mobilise by setting up new fan pages, public and private groups, sharing links and videos, and setting social media challenges in order to continue a mission which they feel is being censored.
“In this context, de-platforming has limited success in actually disrupting and suppressing the harmful behaviour. Instead, for many it actually reinforces their conspiratorial beliefs, as what we term ’minion accounts’ double down on spreading the disinforming material on behalf of those who have been de-platformed.”
In the four weeks following the de-platforming of Icke, a well-established conspiracy theorist, researchers analysed 11,877 public posts which mentioned him. These posts yielded 2.2 million user interactions. In the seven days following his account removal on 30 April, his public mentions on Facebook increased by 84%.
The team analysed 1,636 post mentions of Kate Shemirani during 2020. Her profile grew in prominence during the pandemic before she was de-platformed on 4 September 2020.
In the two months following her removal, post mentions and user engagement on Facebook decreased markedly. However, the suppression effect appeared to be temporary, with signs of revival from the end of 2020, where the number of Facebook video shares increased from approximately ten in October and November 2020 to over 60 in the next two months.
Facebook’s measures to stop misleading information were ramped up in 2020 in response to the pandemic and prior to the US Election. De-platforming, which is Facebook’s ultimate sanction, was applied to accounts assessed as posing risks to public safety, defined under its Dangerous Individuals and Organizations Policy.
In the year to September 2020, Facebook took down more than 1 million groups for repeat violations, implementing new countermeasures intended to prevent the administrators of those groups from creating new ones.
Co-author Professor Martin Innes, Director of the CSRI, said: “There is little doubt that despite Facebook’s efforts to combat the spread of harmful misinformation, more effective action is required from big tech in order to combat the deluge of conspiracy theories that we’ve seen over the course of the pandemic.
“If, as our study suggests, de-platforming can have complex effects in terms of both constraining the public reach of harmful content, whilst simultaneously inducing greater resilience among these groups, then further measures will need to be introduced to ensure misleading information is not allowed to thrive online.”
Support our Nation today
For the price of a cup of coffee a month you can help us create an independent, not-for-profit, national news service for the people of Wales, by the people of Wales.
This is such a fascinating read, and so presumptuous in its use of language like ‘harmful content’ and ‘misleading information’. I don’t follow David Icke and haven’t heard of Kate Sherimani. However I have been increasingly forced off Facebook and on to alternative platforms as people who I follow, and deeply respect, have either been forced off themselves, lost their jobs in mainstream publications, or know that it is only a matter of time until they have to migrate. These are journalists like Glenn Greenwald, Matt Taibbi, and Chris Hedges. Novara Media lost their entire Youtube platform for ‘breaches’ (which… Read more »
I’m not really surprised that the individuals you mention have been suppressed by mainstream social media.It’s likely that such critical voices are taken as far more of a serious threat to the status quo than those figures and groups on the right who have pretty much been excluded merely for forms sake than any fundamental disagreement with the content they post. The right’s message will prevail anyway, as that is pretty much in alignment with the values of the platform capitalist owners. Social media is the epitome of platform capitalism, and it doesn’t do to scare the cattle, or cause… Read more »