Noken Descent

View at publisher Summarise with VIRAT
Authors: Gary Nan Tie
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

A Noken implicit model is used to jointly learn query, key and value embeddings.In this context, a query update refines query-key alignment by lowering entropy. On this systematic foundation, we then learn layers of feed forward networks to polish perplexity, resulting in a coherent attention mechanism.

Fields of Study & Subjects

Topic Modeling Natural Language Processing Techniques Information Retrieval and Search Behavior

Publication details

Journal / source
HAL
Publication date
1 January 2026
Language
EN
Document type
Preprint