DigitalHistory-Lund/ToK-Preparer: 2025-12-09
Abstract
Every discussion (discussion_id arc in the per-year ToK_data_YYYY.sqlite3.gz files) now ships as reference files under discussions/ (#8): discussions/{year}/{date}_{fk|ak}_d{id}.pdf and .docx: metadata, legend, then each utterance under a speaker heading; words carrying the ¹²³ category markers are set in bold. discussions/{year}/{date}_{fk|ak}_d{id}.jsonl: one line per utterance. discussions/discussions.jsonl.gz: one line per discussion with nested utterances. 2,236 discussions, 9,858 utterances, 1900–1940. Generated by the new pipeline step uv run python -m src.export_discussions; see the README section "Discussion reference files" for the file naming and jsonl schema. The files are part of the source archive, so this release's Zenodo version carries them. What's Changed Add export_discussions pipeline step (pdf, docx, jsonl per discussion) by @mathjoha in https://github.com/DigitalHistory-Lund/ToK-Preparer/pull/10 Add generated discussion reference files (1900-1940) by @mathjoha in https://github.com/DigitalHistory-Lund/ToK-Preparer/pull/11 Bump version and citation date to 2026-10-13 by @mathjoha in https://github.com/DigitalHistory-Lund/ToK-Preparer/pull/12 Full Changelog: https://github.com/DigitalHistory-Lund/ToK-Preparer/compare/2026-09-08...2026-10-13
Fields of Study & Subjects
Digital Humanities and Scholarship
Computational and Text Analysis Methods
Linguistic Studies and Language Acquisition
Publication details
- Journal / source
- Lund University Publications (Lund University)
- Publication date
- 11 January 2026