Entropy and Energy of the Bosnian Language: An Information-Theoretic Analysis on a 6.18 GB Corpus

Read full text
Authors: Kahrimanovic, Hasan
Cited by: 0

Abstract

This record provides a revised English manuscript and LaTeX source package for an information-theoretic analysis of the Bosnian language based on Bosnian Corpus v1.0, a cleaned and genre-annotated corpus of approximately 6.18 GB of text. The study estimates block entropy and finite-order entropy-rate approximations at the character level (n = 1–8) and word level (n = 1–5), and reports complementary distributional concentration measures including Onicescu energy, Rényi-2 entropy, Shannon unigram entropy, Gini–Simpson diversity, and normalized HHI. It also includes Zipf distributions, a descriptive treatment of vocabulary-growth behavior, and genre-level Jensen–Shannon distance analysis across balanced genre subsets. This revised version improves the reproducibility structure of the manuscript by generating major numerical tables and figures directly from released CSV metric files, updating bibliographic references, clarifying methodological limitations, and providing a cleaner source package suitable for inspection, rebuilding, and scholarly review. The record is linked to the earlier Bosnian-language preprint and to Bosnian Corpus v1.0, which provides the underlying corpus basis for the analysis.

Fields of Study & Subjects

Linguistics Language Diversity and Identity Authorship Attribution and Profiling Linguistics and language evolution

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
23 June 2026
Language
EN
Document type
Preprint