Experiments reveal content moderators are influenced by online misinformation, but accuracy mindset may help

by

Editors' notes

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

fact-checked

peer-reviewed publication

proofread

Study design. The first experiment included only the control condition (Top). The next two experiments included both the control and treatment conditions. In all experiments, participants first rated the interestingness or accuracy of 16 headlines (8 true and 8 false), completed a distractor task (e.g. questionnaires), and then rated the accuracy of 48 headlines (the 16 repeated headlines from the interestingness task plus 32 new, nonrepeated, headlines). Credit: PNAS Nexus (2024). DOI: 10.1093/pnasnexus/pgae481

Repeated exposure to lies online may influence the beliefs of professional content moderators, with consequences for online platforms. Hundreds of thousands of content moderators, typically based in non-Western countries, identify and weed out problematic and false content on social platforms. However, constant exposure to misinformation could convince some content moderators that false claims are true, in what is known as the "illusory truth effect."

Hause Lin and colleagues assessed the extent of this effect among professional content moderators in India and the Philippines and explored whether encouraging an accuracy mindset reduces the effect. The work is published in the journal PNAS Nexus.

The authors asked 199 content moderators to rate 16 COVID-19 news headlines, first on their interestingness and then, after a break, on their accuracy—along with 32 new COVID-19 news headlines. As predicted by the illusory truth effect, headlines seen for the second time were 7.1% more likely to be judged as accurate than non-repeated headlines.

However, in a similar experiment in which content moderators were asked to rate accuracy first—thereby encouraging an accuracy mindset—repeated headlines were not rated as more accurate than new headlines. Similar experiments with members of the public in India and the Philippines found similar effects.

According to the authors, the results suggest that the illusory truth effect is not idiosyncratic to Western populations, suggesting that content moderators may become less effective over time due to being chronically exposed to falsehoods, which could compromise the safety and integrity of online platforms. Accuracy mindset prompts could help, the authors note.

More information: Hause Lin et al, Accuracy prompts protect professional content moderators from the illusory truth effect, PNAS Nexus (2024). DOI: 10.1093/pnasnexus/pgae481

Journal information: PNAS Nexus

Provided by PNAS Nexus