Semantic Transfer Learning
Abstract
For the purposes of zero-shot next-token and sequence-to-sequence learning, Noken implicit deep learning models, can be composed and connected into feedback loops, enabling a myriad of network configurations to be explored, and so find ways to lower average entropy. Beyond statistical correlations, this novel attention mechanism is based on semantic architecture. Suppose we have learned the semantics of two different subject domains and want to explore interdisciplinary inquiries. Without starting over from scratch and training on the all combined data (which may in fact muddle matters) we introduce an algorithm to leverage and transfer the individual semantics to make sense of the interdisciplinary corpus.
Fields of Study & Subjects
Domain Adaptation and Few-Shot Learning
Advanced Graph Neural Networks
Machine Learning in Healthcare
Publication details
- Journal / source
- HAL (Le Centre pour la Communication Scientifique Directe)
- Publication date
- 1 January 2026
- Language
- EN
- Document type
- Preprint