DigitalHistory-Lund/ToK-Preparer: 2025-12-09

Read full text
Authors: Mathias Johansson, Ulrika Holgersson
Cited by: 0

Abstract

Every discussion (discussion_id arc in the per-year ToK_data_YYYY.sqlite3.gz files) now ships as reference files under discussions/ (#8): discussions/{year}/{date}_{fk|ak}_d{id}.pdf and .docx: metadata, legend, then each utterance under a speaker heading; words carrying the ¹²³ category markers are set in bold. discussions/{year}/{date}_{fk|ak}_d{id}.jsonl: one line per utterance. discussions/discussions.jsonl.gz: one line per discussion with nested utterances. 2,236 discussions, 9,858 utterances, 1900–1940. Generated by the new pipeline step uv run python -m src.export_discussions; see the README section "Discussion reference files" for the file naming and jsonl schema. The files are part of the source archive, so this release's Zenodo version carries them. What's Changed Add export_discussions pipeline step (pdf, docx, jsonl per discussion) by @mathjoha in https://github.com/DigitalHistory-Lund/ToK-Preparer/pull/10 Add generated discussion reference files (1900-1940) by @mathjoha in https://github.com/DigitalHistory-Lund/ToK-Preparer/pull/11 Bump version and citation date to 2026-10-13 by @mathjoha in https://github.com/DigitalHistory-Lund/ToK-Preparer/pull/12 Full Changelog: https://github.com/DigitalHistory-Lund/ToK-Preparer/compare/2026-09-08...2026-10-13

Fields of Study & Subjects

Digital Humanities and Scholarship Computational and Text Analysis Methods Linguistic Studies and Language Acquisition

Publication details

Journal / source
Lund University Publications (Lund University)
Publication date
11 January 2026