Steer Model beyond Assistant: Controlling System Prompt Strength via Contrastive Decoding
Abstract
Large language models excel at complex instructions yet struggle to deviate from their helpful assistant persona, as post-training instills strong priors that resist conflicting instructions. We introduce system prompt strength, a training-free method that treats prompt adherence as a continuous control. By contrasting logits from target and default system prompts, we isolate and amplify the behavioral signal unique to the target persona by a scalar factor alpha. Across five diverse benchmarks spanning constraint satisfaction, behavioral control, pluralistic alignment, capability modulation, and stylistic control, our method yields substantial improvements: up to +8.5 strict accuracy on IFEval, +45pp refusal rate on OffTopicEval, and +13% steerability on Prompt-Steering. Our approach enables practitioners to modulate system prompt strength, providing dynamic control over model behavior without retraining.
Fields of Study & Subjects
Topic Modeling
Natural Language Processing Techniques
Speech and dialogue systems
Publication details
- Journal / source
- arXiv (Cornell University)
- Publication date
- 10 January 2026
- Document type
- Preprint