Positive net benefit of machine learning: predicting postoperative pancreatic fistula after pancreaticoduodenectomy

Postoperative pancreatic fistula following pancreaticoduodenectomy remains a devastating complication. While machine learning models have been developed to predict fistula formation, none have assessed clinical net benefit. We aim to redevelop and verify the clinical utility of machine learning models in predicting postoperative fistula using Lift and Decision Curve Analysis. The National Surgical Quality Improvement Program Pancreatectomy database (2017-2022) was queried for adults with pancreatic neoplasms, cysts, or pancreatitis undergoing elective pancreaticoduodenectomy. A logistic regression, XGBoost, GBM, LightGBM, Neural Network, and AutoML were developed. Lift analysis assessed model performance compared to random chance and Decision Curve Analysis assessed clinical net benefit. SHapley Additive exPlanations were used for feature interpretation. 1,228 (13.1%) patients developed fistula out of 9,370 included in the study. Patients with fistula were more likely to have no preoperative biliary stent (50.2 vs 37.5%), pancreatic duct