Hidden resilience and adaptive dynamics of the global online hate ecology

Nature. 2019 Sep;573(7773):261-265. doi: 10.1038/s41586-019-1494-7. Epub 2019 Aug 21.

Abstract

Online hate and extremist narratives have been linked to abhorrent real-world events, including a current surge in hate crimes1-6 and an alarming increase in youth suicides that result from social media vitriol7; inciting mass shootings such as the 2019 attack in Christchurch, stabbings and bombings8-11; recruitment of extremists12-16, including entrapment and sex-trafficking of girls as fighter brides17; threats against public figures, including the 2019 verbal attack against an anti-Brexit politician, and hybrid (racist-anti-women-anti-immigrant) hate threats against a US member of the British royal family18; and renewed anti-western hate in the 2019 post-ISIS landscape associated with support for Osama Bin Laden's son and Al Qaeda. Social media platforms seem to be losing the battle against online hate19,20 and urgently need new insights. Here we show that the key to understanding the resilience of online hate lies in its global network-of-network dynamics. Interconnected hate clusters form global 'hate highways' that-assisted by collective online adaptations-cross social media platforms, sometimes using 'back doors' even after being banned, as well as jumping between countries, continents and languages. Our mathematical model predicts that policing within a single platform (such as Facebook) can make matters worse, and will eventually generate global 'dark pools' in which online hate will flourish. We observe the current hate network rapidly rewiring and self-repairing at the micro level when attacked, in a way that mimics the formation of covalent bonds in chemistry. This understanding enables us to propose a policy matrix that can help to defeat online hate, classified by the preferred (or legally allowed) granularity of the intervention and top-down versus bottom-up nature. We provide quantitative assessments for the effects of each intervention. This policy matrix also offers a tool for tackling a broader class of illicit online behaviours21,22 such as financial fraud.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Global Health
  • Hate*
  • Humans
  • Social Media / standards
  • Social Media / statistics & numerical data*
  • Social Media / trends