Optimizing the Delivery of Shamiri: A Series of Rapid A/B Tests (2024-2025)

Read full text
Authors: Tom L. Osborn, Wendy Mmbone Musonye
Cited by: 1

Abstract

Across two program years (2024–2025), we embedded six A/B tests within routine implementation, each holding the four-session intervention content constant and varying a single component of its delivery scaffold — provider recruitment, group size, supervisor caseload, training, or supervision structure. Adaptations meant to lower cost, widen reach, or simplify operations were framed as non-inferiority questions; the one adaptation that added cost was framed as a superiority question. A parallel routine quality-assurance (QA) stream of standard, unmodified delivery anchored the comparisons and was benchmarked against five prior Shamiri studies. Co-primary outcomes were depression (PHQ-8) and anxiety (GAD-7) at a four-week endpoint, analyzed by intention-to-treat with multiple imputation in the full sample and the primary clinically-elevated subsample (PHQ-8 ≥ 10 / GAD-7 ≥ 10); longitudinal mixed models estimated between-arm differences in change for the A/B tests against pre-specified margins and within-arm change for the QA stream. The analytic sample comprised 5,714 students.

Fields of Study & Subjects

Counseling Practices and Supervision Medical Education and Admissions Behavioral and Psychological Studies

Publication details

Publication date
1 January 2026
Document type
Preprint