Don’t Start Over: A Cost-Effective Framework for Migrating Personalized Prompts Between LLMs

Read full text
Authors: Association for Artificial Intelligence 2026, Fuli Feng, Weinan Gan, Chongming Gao, Huifeng Guo, Haoyan Liu, Yong Liu, Yang Zhang, Ziyi Zhao
Cited by: 0

Abstract

Personalization in Large Language Models (LLMs) often relies on user-specific soft prompts. However, these prompts become obsolete when the foundation model is upgraded, necessitating costly, full-scale retraining. To overcome this limitation, we propose the \textbf{P}rompt-level \textbf{U}ser \textbf{M}igration \textbf{A}dapter (\textbf{PUMA}), a lightweight framework that efficiently migrates personalized prompts across incompatible models. PUMA utilizes a parameter-efficient adapter to bridge the semantic gap, combined with a group-based user selection strategy to drastically reduce training costs. Experiments on three large-scale datasets show our method matches or even surpasses the performance of retraining from scratch, reducing computational cost up to 98\%. The framework demonstrates strong generalization across diverse model architectures and robustness in advanced scenarios like chained and aggregated migrations, offering a practical path for the sustainable evolution of personalized AI by decoupling user assets from the underlying models.

Fields of Study & Subjects

Domain Adaptation and Few-Shot Learning Topic Modeling Natural Language Processing Techniques

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN