Interface Organization and Evaluative Reasoning: A Visual Peer Review Dataset

Authors: Alon Friedman
Cited by: 0

Abstract

This dataset contains peer-review comments and rubric-based evaluations collected during a study examining how interface organization influences evaluative reasoning in visual peer review. The study investigates how the spatial and functional arrangement of interface elements—such as evaluation criteria, prompts, and response fields—shapes the articulation of evaluative judgments during interaction. Data were collected in an undergraduate data visualization course using a staged study design that compared different peer-review interface conditions. Across these stages, students evaluated peer-produced visualizations using rubric-guided critique and open-ended comments. The dataset captures the resulting evaluative discourse as well as rubric selections reflecting visualization design principles such as labeling, scale integrity, legend use, data–ink ratio, chart junk, data density, and task selection. Each record in the dataset represents a single peer-review observation and includes the reviewer’s comment along with rubric-based evaluations associated with the reviewed visualization. The dataset supports analysis of evaluative articulation, linguistic patterns in critique, and the alignment between reviewer comments and domain-specific evaluation criteria. All student identifiers have been removed to ensure anonymity. The dataset is intended to support reproducibility of the analyses reported in the associated research study and may also be used for further research on evaluative discourse, peer feedback, visualization critique, and interface-mediated reasoning.

Fields of Study & Subjects

Data Visualization and Analytics Student Assessment and Feedback Visual and Cognitive Learning Processes

Publication details

Journal / source
OSF Preprints (OSF Preprints)
Publication date
6 March 2026
Language
EN
Document type
Preprint