Journal article · 2024

Vis Repligogy: Towards a Culture of Facilitating Replication Studies in Visualization Pedagogy and Research

Uzma Haque Syeda, Laura South, Justin Raynor, Liudas Panavas, David Saffo, Tommy Morriss, Cody Dunne, Michelle A. Borkin

Abstract

In this paper, we present the Vis Repligogy framework that enables conducting replication studies in the class. Replication studies are crucial to strengthening the data visualization field and ensuring its foundations are solid and methods accurate. Although visualization researchers acknowledge the epistemological significance of replications and their necessity to establish trust and reliability, the field has made little progress to support the publication of such studies and, importantly, provide methods to the community to encourage replications. Therefore, we contribute Vis Repligogy, a novel framework to systematically incorporate replications within visualization course curricula that not only teaches students replication and evaluation methodologies but also results in executed replication studies to validate prior work. To validate the feasibility of the framework, we present case studies of two graduate data visualization courses that implemented it. These courses resulted in a total of five replication studies. Finally, we reflect on our experience implementing the Vis Repligogy framework to provide useful recommendations for future use. We envision this framework will encourage instructors to conduct replications in their courses, help facilitate more replications in visualization pedagogy and in research, and support a culture shift towards reproducible research. Supplemental materials of this paper are available at https://osf.io/ncb6d/.

BibTeX Copy

@article{syeda_vis_2024,
	title = {Vis {Repligogy}: {Towards} a {Culture} of {Facilitating} {Replication} {Studies} in {Visualization} {Pedagogy} and {Research}},
	copyright = {Creative Commons Attribution 4.0 International},
	shorttitle = {Vis {Repligogy}},
	url = {https://diglib.eg.org/handle/10.2312/eved20241054},
	doi = {10.2312/EVED.20241054},
	abstract = {In this paper, we present the Vis Repligogy framework that enables conducting replication studies in the class. Replication studies are crucial to strengthening the data visualization field and ensuring its foundations are solid and methods accurate. Although visualization researchers acknowledge the epistemological significance of replications and their necessity to establish trust and reliability, the field has made little progress to support the publication of such studies and, importantly, provide methods to the community to encourage replications. Therefore, we contribute Vis Repligogy, a novel framework to systematically incorporate replications within visualization course curricula that not only teaches students replication and evaluation methodologies but also results in executed replication studies to validate prior work. To validate the feasibility of the framework, we present case studies of two graduate data visualization courses that implemented it. These courses resulted in a total of five replication studies. Finally, we reflect on our experience implementing the Vis Repligogy framework to provide useful recommendations for future use. We envision this framework will encourage instructors to conduct replications in their courses, help facilitate more replications in visualization pedagogy and in research, and support a culture shift towards reproducible research. Supplemental materials of this paper are available at https://osf.io/ncb6d/.},
	urldate = {2026-11-05},
	journal = {EuroVis 2024 - Education Papers},
	publisher = {The Eurographics Association},
	author = {Syeda, Uzma Haque and South, Laura and Raynor, Justin and Panavas, Liudas and Saffo, David and Morriss, Tommy and Dunne, Cody and Borkin, Michelle A.},
	year = {2024},
	note = {Artwork Size: 9 pages
Edition: 1054
ISBN: 9783038682578},
	keywords = {CCS Concepts: Human-centered computing→Visualization theory and methods; Visualization pedagogy, Human centered computing→Visualization theory and methods, Visualization pedagogy},
}