MOSAIC: Masked Objective with Selective Adaptation for In-domain Contrastive Learning

Read full text Summarise with VIRAT
Authors: Vera Pavlova, Mohammed Makhlouf
Cited by: 0
References: 44

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

We introduce MOSAIC (Masked Objective with Selective Adaptation for In-domain Contrastive learning), a multi-stage framework for domain adaptation of text embedding models that incorporates joint domain-specific masked supervision.Our approach addresses the challenges of adapting large-scale generaldomain text embedding models to specialized domains.By jointly optimizing masked language modeling (MLM) and contrastive objectives within a unified training pipeline, our method enables effective learning of domainrelevant representations while preserving the robust semantic discrimination properties of the original model.We empirically validate our approach on both high-resource and low-resource domains, achieving improvements up to 13.4% in NDCG@10 (Normalized Discounted Cumulative Gain) over strong general-domain baselines.Comprehensive ablation studies further demonstrate the effectiveness of each component, highlighting the importance of balanced joint supervision and staged adaptation.

Fields of Study & Subjects

Domain Adaptation and Few-Shot Learning Topic Modeling Information Retrieval and Search Behavior

Publication details

Journal / source
Findings of the Association for Computational Linguistics: EACL
Pages
3792–3807
Publication date
1 January 2026
Language
EN