aCat: Automatically Choosing Anchor Tokens in Prompt for Natural Language Understanding
Abstract
P-tuning has demonstrated that anchor tokens are beneficial for improving the performance of downstream tasks. However, manual selection of anchor tokens may result in subjective or suboptimal results. In this paper, we present aCat to automatically select anchor tokens. Following the framework of the soft-hard prompt paradigm, aCat achieves automatic prompt template construction. Experiments conducted on natural language understanding benchmarks demonstrate the effectiveness of our proposed method. On the seven SuperGLUE datasets, aCat achieves higher accuracy than P-tuning, with an average accuracy surpassing P-tuning V2.
Fields of Study & Subjects
Topic Modeling
Domain Adaptation and Few-Shot Learning
Natural Language Processing Techniques
Publication details
- Journal / source
- Neural Processing Letters
- Volume
- 58
- Issue
- 2
- Publication date
- 10 March 2026
- Language
- EN