Securing Large Language Models: Addressing Bias, Misinformation, and Prompt Attacks

Read full text
Authors: Benji Peng, Hanxuan Chen, Keyu Chen, Ming Li, Pohsun Feng, Ziqian Bi, Junyu Liu, Xinyuan Song, Qian Niu, Riyang Bao, Jiacheng Shi
Cited by: 1

Abstract

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus on accuracy, bias, content detection, and vulnerability to attacks. Issues related to inaccurate or misleading outputs from LLMs is discussed, with emphasis on the implementation from fact-checking methodologies to enhance response reliability. Inherent biases within LLMs are critically examined through diverse evaluation techniques, including controlled input studies and red teaming exercises. A comprehensive analysis of bias mitigation strategies is presented, including approaches from pre-processing interventions to in-training adjustments and post-processing refinements. The article also probes the complexity of distinguishing LLM-generated content from human-produced text, introducing detection mechanisms like DetectGPT and watermarking techniques while noting the limitations of machine learning enabled classifiers under intricate circumstances. Moreover, LLM vulnerabilities, including jailbreak attacks and prompt injection exploits, are analyzed by looking into different case studies and large-scale competitions like HackAPrompt. This review is concluded by retrospecting defense mechanisms to safeguard LLMs, accentuating the need for more extensive research into the LLM security field.

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Hate Speech and Cyberbullying Detection Spam and Phishing Detection

Publication details

Journal / source
Eureka
Publisher
ScineXor Cultural Investment and Publishing Ltd.
Volume
1
Issue
2
Pages
9–39
Publication date
30 May 2026