Multitask learning of longitudinal circulating biomarkers and clinical outcomes: identification of optimal machine-learning and deep-learning models

BACKGROUND: Many circulating biomarkers are assessed at different time intervals during clinical studies. Despite of the success of standard joint models in predicting clinical outcomes using low-dimensional longitudinal data (1-2 biomarkers), significant computational challenges are encountered when applying these techniques to high-dimensional biomarker datasets. Modern machine- or deep-learning models show potential for multiple biomarker processes, but systematic evaluations and applications to high-dimensional data in the clinical settings have yet to be reported. We aimed to enhance the scalability of joint modeling and provide guidance on optimal approaches for high-dimensional biomarker data and outcomes. METHODS: We evaluated multiple deep-learning and machine-learning models using 24 clinical biomarkers and survival data from the SQUIRE trial, a phase 3 randomized clinical trial investigating necitumumab and standard gemcitabine/cisplatin treatment in patients with squamous non-small-cell lung cancer (NSCLC). RESULTS: Overall, we confirmed that longitudinal models enabled more accurate prediction of patients' survival compared to those solely based on baseline information. Coupling multivariate functional principal component analysis (MFPCA) with Cox regression (MFPCA-Cox) provided the highest predictive discrimination and accuracy for the NSCLC patients with AUC values of 0.7 - >0.8 at various landmark time points and prediction timeframes, outperforming recent advanced Transformer and convolutional neural network deep-learning algorithms (TransformerJM and Match-Net, respectively). CONCLUSIONS: In conclusion, we identified that MFPCA-Cox represents a robust and versatile joint modeling algorithm for high-dimensional biomarker longitudinal data with irregular and missing data, capturing complex relationships within the data, yielding accurate predictions for both longitudinal biomarkers and survival outcomes, and gaining insights into the underlying dynamics. TRIAL REGISTRATION: ClinicalTrials.gov (NCT00981058; first posted on September 22, 2009).