A Study of Unified Framework for Extremism Classification, Ideology Detection, Propaganda Analysis, and Flagged Data Detection Using Transformers

Abstract

The rise of extremism and its rapid dissemination through propaganda channels have become pressing global challenges, threatening peace, security, and social cohesion. This study aligns with the United Nations Sustainable Development Goal 16 by proposing a unified framework leveraging advanced machine learning and large language models to combat extremism through extremism classification, ideology detection, propaganda analysis, and flagged word recognition. This framework introduces process innovation by integrating state-of-the-art transformer models such as BERT, RoBERTa, DistilBERT and XLNet to streamline the analysis process and overcome traditional limitations in extremism detection with exceptional performance: 90.00% accuracy for extremism classification, 98.82% accuracy for ideology detection, and 99.71% accuracy for flagged word recognition. While the proposed approach demonstrates high precision and recall, it faces challenges such as potential data bias, ethical concerns in dataset usage and the risk of false positives, which could lead to misclassification of benign content. The inclusion of multilingual capabilities broadens the applicability of the framework but variations in linguistic structures and cultural contexts introduce complexities in model generalization. Additionally, ethical considerations in handling extremist content, especially in social media data collection, necessitate stringent privacy safeguards to prevent unintended harm. By providing actionable insights, this research contributes to counter-extremism efforts in areas such as online content moderation, law enforcement and intelligence analysis, laying a foundation for future advancements in safeguarding global security which enhance the process innovation.