ProMoral-Bench: Evaluating Prompting Strategies for Moral Reasoning and Safety in LLMs

Read full text
Authors: Rohan Subramanian Thomas, Shikhar Shiromani, Abdullah Chaudhry, R.U.I.Z.H.E. LI, Vasu Sharma, Kevin Zhu, Sunishchal Dev
Cited by: 0

Abstract

Prompt design significantly impacts the moral competence and safety alignment of large language models (LLMs), yet empirical comparisons remain fragmented across datasets and models.We introduce ProMoral-Bench, a unified benchmark evaluating 11 prompting paradigms across four LLM families. Using ETHICS, Scruples, WildJailbreak, and our new robustness test, ETHICS-Contrast, we measure performance via our proposed Unified Moral Safety Score (UMSS), a metric balancing accuracy and safety. Our results show that compact, exemplar-guided scaffolds outperform complex multi-stage reasoning, providing higher UMSS scores and greater robustness at a lower token cost. While multi-turn reasoning proves fragile under perturbations, few-shot exemplars consistently enhance moral stability and jailbreak resistance. ProMoral-Bench establishes a standardized framework for principled, cost-effective prompt engineering.

Fields of Study & Subjects

Ethics and Social Impacts of AI Adversarial Robustness in Machine Learning Topic Modeling

Publication details

Journal / source
arXiv (Cornell University)
Publication date
5 February 2026
Language
EN
Document type
Preprint