Global Journal of Engineering, Design & Technology
Open Access

The Role of Bots and AI in Spreading Misinformation on Social Media

Andrea Tomassi^*, Andrea Falegnami and Elpidio Romano ^*Correspondence: Andrea Tomassi, Department of Human Geography and Planning, International Telematic University Uninettuno, Italy, Email:

Author info »

Introduction

In the article "Mapping Automatic Social Media Information Disorder: The Role of Bots and AI in spreading misleading information in society," authors Andrea Tomassi, Andrea Falegnami, and Elpidio Romano delve deeply into the pervasive impact of misinformation on social media, a phenomenon significantly amplified by the use of Artificial Intelligence (AI) and bots. This comprehensive study, conducted at Uninettuno International Telematic University in Rome, critically explores the multifaceted ways in which automated technologies facilitate the widespread dissemination of false information across various digital platforms [1]. The authors examine the mechanisms by which AI and bots contribute to the creation, distribution, and amplification of misleading narratives. They highlight how these technologies can be used to generate vast quantities of false content, tailor messages to specific audiences, and strategically deploy information to maximize impact [2]. The study also considers the algorithms employed by social media platforms, which often prioritize engaging and sensational content, inadvertently promoting the spread of misinformation. By utilizing advanced methodologies such as Natural Language Processing (NLP), topic modeling, and knowledge graph construction, Tomassi, Falegnami, and Romano offer a thorough analysis of the patterns and themes that characterize misinformation. They identify key areas where AI serves both as a tool for spreading falsehoods and as a potential asset in detecting and mitigating misinformation. This dual role of AI underscores the complexity of the issue, as technological advancements can both enhance and undermine information integrity. The research also addresses the social and political implications of misinformation, noting how false information can exacerbate societal divisions, influence public opinion, and undermine democratic processes. The authors emphasize the need for a multi-pronged approach to combat misinformation, which includes technological interventions, policy measures, and efforts to improve digital literacy among the general public. Ultimately, the study calls for interdisciplinary collaboration to develop effective strategies that address the root causes and mechanisms of misinformation [3]. It stresses the importance of enhancing critical thinking skills and promoting a more discerning consumption of digital content to safeguard against the pervasive influence of false information in society. Through their detailed examination, Tomassi, Falegnami, and Romano contribute valuable insights to the ongoing discourse on combating misinformation in the digital age.

Literature Review

In the comprehensive literature review, Tomassi, Falegnami, and Romano systematically explore the dynamics of misinformation, disinformation, and malinformation on social media platforms, emphasizing the critical role of Artificial Intelligence (AI) and bots in these processes. The review highlights that misinformation, defined as false information shared without harmful intent, and disinformation, which is intentionally false and harmful, are both prevalent on platforms like Twitter, Facebook, and YouTube. The study reveals that AI can function dually-either as a sophisticated tool for disseminating false narratives or as a powerful ally in identifying and combating misinformation through fact-checking algorithms [4]. The authors employed the PRISMA protocol to ensure a rigorous and transparent selection of relevant studies from the Scopus database, focusing on high-quality, peer-reviewed articles. This methodological rigor underscores the reliability of their findings, which indicate a significant increase in scholarly interest in misinformation since 2017, likely driven by major global events such as Brexit, the election of Donald Trump, and the COVID-19 pandemic. The literature review also integrates various advanced computational techniques, such as Latent Dirichlet Allocation (LDA) for topic modeling and knowledge graphs using Obsidian software, to map the intricate relationships between themes and documents within the research corpus. The review further discusses the thematic commonalities in fake news, identifying that political and health-related misinformation are particularly prominent. These themes exploit emotional triggers and societal divisions to gain traction, leveraging the algorithmic structures of social media platforms that favor sensational and engaging content [5]. The dual role of AI, as both a facilitator and a combatant of misinformation, is critically analyzed, emphasizing the need for strategic interventions that include technological solutions and enhanced digital literacy among users. Moreover, the review calls for interdisciplinary collaboration to develop holistic strategies to address information disorder. This involves not only technological and regulatory measures but also educational initiatives to foster critical thinking skills, enabling users to better evaluate the credibility of the information they encounter online. This approach is deemed essential for mitigating the spread of false information and safeguarding the integrity of digital discourse.

Discussion

The primary aim of this research is to investigate the spread of different forms of information disorders-misinformation, disinformation, and malinformation-across social media [6]. Employing advanced methodologies such as Natural Language Processing (NLP), topic modeling, and knowledge graph construction, the paper meticulously focuses on four key areas: The distribution patterns of false information, thematic commonalities in fake news, the role of AI as both a tool and a threat, and the development of strategic countermeasures against information disorder. The research categorizes false information into three distinct types: Misinformation, which is false but not intended to harm; disinformation, which is intentionally false and harmful; and malinformation, which is true but misleadingly used to inflict harm. A significant revelation from the study is the dual role of AI in this context [7]. On one hand, AI assists in factchecking and the identification of misinformation, providing tools that can enhance the accuracy and reliability of information [8,9]. On the other hand, AI can be exploited to craft and spread sophisticated false narratives more effectively, making the identification and mitigation of misinformation more challenging. The study highlights that political and health-related misinformation are particularly prevalent on social media platforms. These types of misinformation leverage emotional triggers and societal divisions to gain traction, especially on platforms like Twitter, Facebook and YouTube [10,11]. According to the research, these platforms are particularly vulnerable due to their algorithmic structures that favor sensational and engaging content. This structure facilitates the rapid spread of misinformation by prioritizing content that generates high levels of user engagement, regardless of its veracity [12]. The research employs a robust methodological framework, utilizing the PRISMA protocol for systematic reviews to ensure a transparent and structured analysis.

Conclusion

The choice of Scopus as the primary database underscores a commitment to high-quality and relevant academic sources, which substantiates the findings with scholarly rigor. Advanced statistical and computational techniques, including clustering and Latent Dirichlet Allocation (LDA) for topic modeling, are employed to allow for a nuanced understanding of how misinformation themes are interconnected and evolve across social media. Furthermore, the use of Obsidian software for creating knowledge graphs illustrates an innovative approach to visually map and analyze the relationships between different data points in the study. The findings of this paper are crucial for designing effective strategies to combat misinformation. The study advocates for a multi-faceted approach that includes both technological interventions and the enhancement of users' digital literacy. Developing critical thinking skills is highlighted as a vital defense mechanism that enables individuals to critically assess the credibility of information encountered online. This dual approach aims to empower users to discern credible information from falsehoods and reduce the overall impact of misinformation on society. Tomassi, Falegnami, and Romano's research provides a comprehensive exploration of how misinformation permeates social media through the aid of AI and bots. The detailed examination of the mechanisms behind the spread of false narratives offers valuable insights for stakeholders aiming to curb this digital epidemic. By calling for interdisciplinary collaboration, the study emphasizes the need for a holistic strategy that combines technological, educational, and regulatory efforts to tackle the complex challenge of misinformation in the digital age. This research not only contributes to academic discourse but also serves as a foundational reference for policymakers, social media platforms, and educators in their ongoing efforts to safeguard information integrity in society. The insights provided by this study are essential for informing future policies and strategies aimed at mitigating the harmful effects of misinformation and ensuring the integrity of information in the digital landscape.

Acknowledgments

Special thanks to Professor Garito, the Uninettuno coordinator of the Titan Project, and Professor Caprara, the scientific advisor, for their valuable suggestions and discussions on the subject. Thanks to all Titan project partners for sharing their insights on the issues addressed in this work. Many thanks to all members of the research team for sharing their ideas and experiences.

Conflict of Interest

The authors have declared that no competing interests existed in the production of this paper.

References

1. McPherson M, Smith-Lovin L, Cook JM. Birds of a feather: Homophily in social networks. Annu Rev Sociol. 2001;27(1):415-444.

   [Crossref] [Google Scholar]

2. Needham A. Word of mouth, youth and their brands. Young Consumers. 2008;9(1):60-62.

   [Crossref] [Google Scholar]

3. Shi C, Wei B, Wei S, Wang W, Liu H, Liu J. A quantitative discriminant method of elbow point for the optimal number of clusters in clustering algorithm. EURASIP J Wirel Commun Netw. 2021;2021:1-6.

   [Crossref] [Google Scholar]

4. Tomassi A, Falegnami A, Romano E. Mapping automatic social media information disorder. The role of bots and AI in spreading misleading information in society. Plos One. 2024;19(5):0303183.

   [Crossref]  [Google Scholar] [PubMed]

5. Tomassi A, Caforio A, Romano E, Lamponi E, Pollini A. The development of a Competence Framework for Environmental Education complying with the European Qualifications Framework and the European Green Deal. J Environ Educ. 2024;55(2):153-179.

   [Crossref] [Google Scholar]

6. Yavetz G, Aharony N. Social media in government offices: Usage and strategies. Aslib J Inf Manag. 2020;72(4):445-462.

   [Crossref] [Google Scholar]

7. Darwish EB. The effectiveness of the use of social media in government communication in the UAE. J Arab Muslim Media. 2017;10(1):41-63.

   [Crossref] [Google Scholar]

8. Mainka A, Hartmann S, Stock WG, Peters I. Looking for friends and followers: A global investigation of governmental social media use. Transform Gov: People  Process Policy. 2015;9(2):237-254.

   [Crossref] [Google Scholar]

9. Perlman BJ. Social media sites at the state and local levels: Operational success and governance failure. State Local Gov Rev. 2012;44(1):67-75.

   [Crossref] [Google Scholar]

10. Rathore AK, Maurya D, Srivastava AK. Do policymakers use social media for policy design? A Twitter analytics approach. Australas J Inf Syst. 2021;25.

    [Crossref] [Google Scholar]

11. Yuan YP, Dwivedi YK, Tan GW, Cham TH, Ooi KB, Aw EC, et al. Government digital transformation: Understanding the role of government social media. Gov Inf Q. 2023;40(1):101775.

    [Crossref] [Google Scholar]

12. Sobaci MZ. Social media and local governments: An overview. Social media and local governments: Theory and practice. 2016:3-21.

    [Crossref] [Google Scholar]