Interface Organization and Evaluative Reasoning: A Visual Peer Review Dataset
Abstract
This dataset contains peer-review comments and rubric-based evaluations collected during a study examining how interface organization influences evaluative reasoning in visual peer review. The study investigates how the spatial and functional arrangement of interface elements—such as evaluation criteria, prompts, and response fields—shapes the articulation of evaluative judgments during interaction. Data were collected in an undergraduate data visualization course using a staged study design that compared different peer-review interface conditions. Across these stages, students evaluated peer-produced visualizations using rubric-guided critique and open-ended comments. The dataset captures the resulting evaluative discourse as well as rubric selections reflecting visualization design principles such as labeling, scale integrity, legend use, data–ink ratio, chart junk, data density, and task selection. Each record in the dataset represents a single peer-review observation and includes the reviewer’s comment along with rubric-based evaluations associated with the reviewed visualization. The dataset supports analysis of evaluative articulation, linguistic patterns in critique, and the alignment between reviewer comments and domain-specific evaluation criteria. All student identifiers have been removed to ensure anonymity. The dataset is intended to support reproducibility of the analyses reported in the associated research study and may also be used for further research on evaluative discourse, peer feedback, visualization critique, and interface-mediated reasoning.
Fields of Study & Subjects
Data Visualization and Analytics
Student Assessment and Feedback
Visual and Cognitive Learning Processes
Publication details
- Journal / source
- OSF Preprints (OSF Preprints)
- Publication date
- 6 March 2026
- Language
- EN
- Document type
- Preprint