ETLForge: A unified framework for synthetic test-data generation and ETL validation

Read full text Summarise with VIRAT
Authors: Kyriakos Kartas
Cited by: 0
References: 6

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

ETLForge is a Python package (Python >= 3.9) for tabular ETL testing workflows.It uses one external YAML/JSON schema to drive both synthetic data generation and validation for pandas DataFrames.The schema can describe field types, ranges, uniqueness, nullability and optional Faker templates (Faker Contributors, 2024).ETLForge provides DataGenerator (creates tabular test datasets) and DataValidator (checks datasets and returns row-level error reports).A Click-based CLI (The Pallets Projects, 2023) and a Python API expose the same core workflow, enabling local development and CI/CD automation (Fowler & Foemmel, 2013).

Fields of Study & Subjects

Data Quality and Management Software Testing and Debugging Techniques Scientific Computing and Data Management

Publication details

Journal / source
The Journal of Open Source Software
Volume
11
Issue
119
Pages
9326–9326
Publication date
25 March 2026
Language
EN