Quantifying the Impact of Anonymization-Induced Clinical Data Quality Loss: A Methodological Study Using Primary Diagnosis Codes and Hospital Length of Stay (Preprint)

Read full text
Authors: Gaetan Kamdje Wabo, Piotr Kazimierz Sokołowski, Mahboubeh Jannesari Ladani, Michael A. Hagmann, Thomas Ganslandt, Fabian P. Siegel
Cited by: 1
References: 42

Abstract

BACKGROUND Secondary use of electronic health record (EHR) data requires robust privacy protection. k-Anonymity is widely used to enable data sharing by ensuring that each quasi-identifier combination occurs in at least k records. However, its analytical impact on clinically meaningful data structures remains insufficiently characterized, particularly for complex diagnosis-outcome relationships. Existing evaluation approaches rarely integrate distributional fidelity with inferential reproducibility, leaving an important gap in evidence-based data governance. OBJECTIVE This study systematically evaluated the privacy-utility trade-off at k=5, 10, and 15. We quantified how k-anonymity affects the distributional properties of primary diagnosis codes and hospital length of stay (LOS), and assessed whether diagnosis-specific LOS patterns remain reproducible after anonymization. METHODS We analyzed 720,359 inpatient encounters from University Hospital Mannheim collected between January 2010 and September 2024. Anonymization was performed with the ARX Data Anonymization Tool using record suppression and microaggregation at three k thresholds. Distributional distortion was assessed using the Kolmogorov-Smirnov (KS) D statistic as a descriptive divergence measure, together with quantile shifts, interquartile range compression, and tail probability changes. Categorical fidelity was evaluated using the Jaccard similarity coefficient and Cramér’s V. Inferential reproducibility was assessed with linear mixed models by comparing the intraclass correlation coefficient (ICC), diagnosis-level best linear unbiased prediction (BLUP) concordance using Spearman rank correlation and Lin’s concordance correlation coefficient (CCC), and agreement in BLUP magnitude across datasets. RESULTS The KS D statistic remained stable across anonymization levels (0.231-0.232), indicating a similar degree of LOS distributional divergence across all anonymized datasets. Median LOS increased from 4 to 5 days, the 95th percentile decreased from 24 to 17 days, and the standard deviation declined by approximately 4.9 days, while the mean changed by less than 0.025 days. Record suppression increased from 0.77% at k=5 to 2.61% at k=15. ICD-10-GM vocabulary overlap declined monotonically from Jaccard=0.624 at k=5 to 0.422 at k=15, with up to 250 three-character diagnosis categories lost. The ICC increased from 0.285 to 0.848, consistent with strong residual variance compression after anonymization rather than improved clinical signal. BLUP rank concordance remained high (Spearman ρ=0.936-0.940), whereas Lin’s CCC showed distortion in effect magnitude (0.870-0.885), and 10% of diagnosis categories showed sign reversals. Most quality loss occurred at the transition to k=5, with only incremental changes at higher thresholds. CONCLUSIONS This study presents an approach for evaluating the analytical consequences of anonymization in clinical data. Although k-anonymity preserved the relative ranking of diagnosis-specific LOS effects, it substantially altered distributional shape, effect magnitude, and diagnostic vocabulary. Anonymized datasets may therefore remain usable for ordinal or comparative analyses, but can be misleading for analyses requiring faithful variance structure or absolute effect estimates. The full evaluation concept, together with a structured reporting checklist, is provided. CLINICALTRIAL no.

Fields of Study & Subjects

Medical Coding and Health Information Privacy-Preserving Technologies in Data Machine Learning in Healthcare

Publication details

Publication date
8 April 2026
Document type
Preprint