Distribution Testing in the Presence of Arbitrarily Dominant Noise with Verification Queries

View at publisher
Authors: Hadley Black, Christopher Ye
Cited by: 0

Abstract

We study distribution testing without direct access to a source of relevant data, but rather to a highly contaminated one, from which only a tiny fraction (e.g. 1%) is relevant. To enable this, we introduce the following verification query model. The goal is to perform a statistical task on distribution \(p\) given sample access to a mixture \(r = \lambda p + (1-\lambda)q\) and the ability to query whether a sample \(x \sim r\) was generated by \(p\) (relevant) or by \(q\) (irrelevant). This captures scenarios where it is cheap to acquire data from a massive pool, but expensive to verify whether it is of interest for the specific task. In general, if \(m_0\) clean samples from \(p\) suffice for a task, then \(O(m_0/\lambda)\) samples and verification queries trivially suffice in our model. We ask, are there tasks for which the number of queries can be significantly reduced?

Fields of Study & Subjects

Machine Learning and Algorithms SARS-CoV-2 detection and testing Data Quality and Management

Publication details

Journal / source
Society for Industrial and Applied Mathematics eBooks
Pages
4410–4480
Publication date
1 January 2026
Language
EN