Data-hugging shields proprietary AI models from research that could disprove them
Abstract
"Data hugging" blocks independent verification of medical AI. Apple claims age estimation with a mean absolute error of 2.9 years using photoplethysmographic (PPG) signals. Given PPG's noise, such accuracy is questionable, raising concerns about other tech companies' claims. Using UK Biobank data, we find this accuracy unreplicable, achieving results only marginally better than predicting mean age. We advocate for curated public benchmark datasets and evaluation platforms to protect the public from unverifiable claims.
Fields of Study & Subjects
Artificial Intelligence in Healthcare and Education
Ethics and Social Impacts of AI
Face recognition and analysis
Publication details
- Journal / source
- npj Artificial Intelligence
- Publisher
- Springer Science and Business Media LLC
- Volume
- 2
- Issue
- 1
- Pages
- 45–45
- Publication date
- 17 April 2026
- Language
- EN