Logic-Oriented Retriever Enhancement via Contrastive Learning

Read full text
Authors: Wenxuan Zhang, Yuan-Hao Jiang, Changyong Qi, Rui Jia, Yonghe Wu
Cited by: 0

Abstract

Large language models (LLMs) struggle in knowledge-intensive tasks, as retrievers often overfit to surface similarity and fail on queries involving complex logical relations. The capacity for logical analysis is inherent in model representations but remains underutilized in standard training. LORE (Logic ORiented Retriever Enhancement) introduces fine-grained contrastive learning to activate this latent capacity, guiding embeddings toward evidence aligned with logical structure rather than shallow similarity. LORE requires no external upervision, resources, or pre-retrieval analysis, remains index-compatible, and consistently improves retrieval utility and downstream generation while maintaining efficiency. The datasets and code are publicly available at https://github.com/mazehart/Lore-RAG.

Fields of Study & Subjects

Topic Modeling Information Retrieval and Search Behavior Multimodal Machine Learning Applications

Publication details

Journal / source
arXiv (Cornell University)
Publication date
1 February 2026
Document type
Preprint