Do You Really Know if It’s True? How Asking Users to Rate Stories Affects Belief in Fake News on Social Media

Research shows that consuming ratings influences purchase decisions in e-commerce and also has modest effects on belief in news articles on social media. We find that the act of producing ratings reduces belief in news articles on social media and induces social media users to think more critically. We propose this intervention as a method to encourage users to realize that, unlike in the product rating setting, social media users who submit their ratings for news articles typically lack firsthand knowledge of the events reported in the news, making it difficult for most users to rate news articles accurately. We asked 68 social media users to assess the believability of 42 social media articles and measured their cognitive activity using electroencephalography. We found that asking users to rate articles using a self-referential question induced them to think more critically—as indicated by increased activation in the medial prefrontal cortex and dorsolateral prefrontal cortex—and made them less likely to believe the articles. The effect extended to subsequent articles; after being asked to rate an article, users were less likely to believe other articles that followed it whether they were asked to rate them or not. Research has shown that consuming ratings influences purchase decisions in e-commerce and also has modest effects on belief in news articles on social media. However, we do not know if the act of creating a rating influences belief in online news stories. Unlike e-commerce settings in which ratings typically come from those who have personally used the product or service, social media users who submit their ratings for news articles typically lack firsthand knowledge of the events reported in the news, making it difficult for most users to rate news articles accurately. We propose that one key benefit of user ratings in the context of news on social media lies in triggering users who create the ratings (as opposed to consume the ratings) to realize that they lack this firsthand knowledge, thus inducing them to become more skeptical of articles they see. We asked 68 social media users to assess the believability of 42 social media articles and measured their cognitive activity using electroencephalography. We found that asking users to rate articles using a self-referential question induced them to think more critically—as indicated by increased activation in the medial prefrontal cortex and dorsolateral prefrontal cortex—and made them less lik