Estimating the historical minimum false‐positive risk of statistically significant reported outcomes in anaesthesia and pain medicine
Abstract
Estimating the historical minimum false-positive risk of statistically significant reported outcomes in anaesthesia and pain medicine Clinical research is driven by the search for safe and efficient interventions to improve patient outcomes.Traditionally, treatment efficiency is assessed within the framework of null hypothesis significance testing.However, this does not address a crucial question when reporting a statistically significant result: what is the risk that my discovery (in the sense of statistical significance) is wrong [1]?Equating this false-positive risk with the p value would correspond to one of many misinterpretations of statistical testing [2].To illustrate this problem, I will statistically estimate the minimum false-positive risk in a large set of reported outcomes in randomised controlled trials in anaesthesia and pain medicine.Reported outcomes were selected from the publicly available data set by van Zwet et al. [3] containing the published results of more than 68,000 studies from the Cochrane Database of Systematic Reviews.Here, only studies from the domain 'Anaesthesia and Pain' were selected, and only efficacy-related outcomes from randomised controlled trials were analysed.* Assuming an equal probability of the null or alternative hypothesis being true.
Fields of Study & Subjects
Meta-analysis and systematic reviews
Statistical Methods in Clinical Trials
Advanced Causal Inference Techniques
Publication details
- Journal / source
- Anaesthesia
- Publisher
- Wiley
- Volume
- 81
- Issue
- 4
- Pages
- 582–584
- Publication date
- 9 February 2026
- Language
- EN