A visual observation on the geometry of UMAP projections of the difference vectors of antonym and synonym word pair embeddings

Read full text Summarise with VIRAT
Authors: Rami Luisto
Cited by: 0
References: 19

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Antonyms, or opposites, are sometimes defined as \emph{word pairs that have all of the same contextually relevant properties but one}. Seeing how transformer models seem to encode concepts as directions, this begs the question if one can detect ``antonymity'' in the geometry of the embedding vectors of word pairs, especially based on their difference vectors. Such geometrical studies are then naturally contrasted by comparing antonymic pairs to their opposites; synonyms. This paper started as an exploratory project on the complexity of the systems needed to detect the geometry of the embedding vectors of antonymic word pairs. What we now report is a curious ``swirl'' that appears across embedding models in a somewhat specific projection configuration.

Fields of Study & Subjects

Topic Modeling Natural Language Processing Techniques Sentiment Analysis and Opinion Mining

Publication details

Journal / source
arXiv (Cornell University)
Publication date
25 March 2026
Language
EN
Document type
Preprint