An Empirical Study on the Impact of Example Traces on Linear Temporal Logic Comprehension

This README file accompanies the TOSEM 2026 submission titled "An Empirical Study on the Impact of Example Traces on Linear Temporal Logic Comprehension" The contents of the directory are as follows: 1. Consent.pdf, Instructions.pdf, Consent Interview.pdf, and Instructions Interview.pdf - the corresponding texts from the randomized test website and the interview website 2. backend - a directory with the backend python code, consisting of: 2.1. server.py - Flask web server with corresponding endpoints, including the statistical analysis2.2. generator.py - helper code for generating test instances2.3. generate_svg.py - one-time execution of example traces and question traces SVGs for the formula dataset 2.4. svgs - folder of example traces and question traces SVGs2.5. formulas - contains the JSON file of the formula dataset, including generated examples and questions2.6. dataset_curation - folder with formula-extraction scripts from the Dwyer dataset 3. results - a directory with results taken directly from server's endpoints, including 3.1. data.json - general demographical data of the randomized test3.2. formulas.json - LTL formulas with average time to correct answer and correctness ratio3.3. rq1.json, rq2.json, and rq3.json - statistical permutation test results of RQ1, RQ2, and RQ3 4. Excerpts.xlsx - Excel spreadsheet of the extracted quotes from the interview transcripts, and the assigned theme