PREreview of "Interpretable Biomanufacturing Process Risk and Sensitivity Analyses for Quality-by-Design and Stability Control"

This Zenodo record is a permanently preserved version of a PREreview. You can view the complete PREreview at https://prereview.org/reviews/18770706. Formal Peer Review Manuscript Title: Interpretable Biomanufacturing Process Risk and Sensitivity Analyses for Quality-by-Design and Stability Control Submitted to: Journal of Pharmaceutical Sciences / Biotechnology and Bioengineering Review Status: Major Revisions Required 1. Summary Assessment This manuscript presents a methodologically substantive framework integrating Bayesian network (BN)-based probabilistic knowledge graphs with Shapley value (SV)-derived sensitivity analyses to address CPP/CQA criticality assessment and model uncertainty quantification in biomanufacturing. The three-part contribution — interpretable process modelling, stochastic sensitivity analysis, and model risk decomposition via a nested Gibbs sampler — represents a technically ambitious undertaking that meaningfully distinguishes itself from conventional multivariate PAT approaches by explicitly incorporating causal process structure. The motivational framing around QbD, process stability, and the limitations of data-sparse biomanufacturing environments is well-constructed and professionally grounded in ICH Q8(R2) and FDA PAT guidance. The use of game-theoretic sensitivity analysis (Owen, 2014; Song et al., 2016) to handle interdependent inputs in complex bioprocesses is novel and conceptually sound. The inclusion of both a simulation study and a real-world Yarrowia lipolytica citric acid fermentation case study strengthens empirical credibility. However, the manuscript exhibits several significant deficiencies that limit its publication readiness in its current form. These include: the restriction to linear Gaussian BN models without adequate justification or sensitivity testing for nonlinear bioprocesses; an extremely small real-world dataset (R = 8 batches) that undermines inferential reliability; inadequate discussion of graph structure determination and its sensitivity; underdeveloped regulatory alignment; and, critically, an absence of formal statistical validation metrics for the real case study. Additionally, the manuscript appears to have been posted as an arXiv preprint (arXiv:1909.04261v4) since 2019, and the authors should disclose whether this constitutes a simultaneous or prior submission. 2. Major Concerns MC1 – Linearity Assumption and Model Validity The entire analytical framework rests on a linear Gaussian BN specified in Equations (4)–(6). Biomanufacturing processes are inherently nonlinear, as evidenced by the exponential cell growth kinetics the authors themselves cite (Section 4). While a log-transformation is proposed to linearise the exponential growth model, this approach is applied only illustratively and is not generalised to the broader framework. The authors must provide: (a) a formal analysis of when the linear approximation is adequate; (b) empirical evidence that the linearization does not introduce systematic bias in the real case study; and (c) a discussion of how the framework degrades when linearity assumptions are violated. The claim that finite-difference approximation of ODE-based kinetics matches Equation (6) requires rigorous justification, not merely assertion. MC2 – Critically Insufficient Real-World Sample Size The real case study employs only R = 8 complete batches to estimate a BN with 62 nodes. The posterior standard deviations reported in Tables 5–7 are frequently comparable to or exceed the estimated criticality values themselves (e.g., Cell_0 contributing 1.88% ± 4.12% to BM_10 variance), indicating that the posterior is effectively uninformative for many parameters. The authors acknowledge this limitation without adequately addressing its implications. With 62 nodes, the parameter space includes hundreds of coefficients, making credible posterior inference with 8 observations statistically untenable without strong, explicitly validated prior information. The authors must either: (a) formally quantify the minimum sample size required for reliable inference under the proposed framework; or (b) provide a more rigorous justification for the informativeness of the priors used, including sensitivity analysis to prior hyperparameter selection. MC3 – BN Structure Determination Not Addressed. The manuscript assumes that the DAG structure of the BN is known a priori. This is a fundamental methodological gap. In practice, causal graph structure is rarely fully known, and structure uncertainty can propagate substantially into criticality estimates. The authors must address: how the graph topology is determined in practice; what procedures are recommended for structure learning or expert elicitation; and how structural misspecification affects the SV-based criticality assessments. The absence of any structure uncertainty analysis is a material omission for a framework claiming to support QbD process development. MC4 – Absence of Formal Validation Metrics in Real Case Study. Section 7.2 presents criticality estimates but provides no ground-truth comparison, no cross-validation, no predictive performance metric, and no benchmarking against existing methods. Unlike Section 7.1.2, which compares BN-SV against ML-M using simulated true parameters, the real case study offers no analogous validation. Statements such as "matches well with the data in Fig. 6" and "consistent with the data" constitute qualitative corroboration, not scientific validation. A held-out prediction exercise, leave-one-out cross-validation, or comparison with established fermentation knowledge should be provided. MC5 – Regulatory Alignment Is Superficial. The manuscript invokes QbD, ICH Q8(R2), and PAT guidance but does not engage substantively with the regulatory implications of the proposed framework. Key questions left unaddressed include: How would this framework be presented in a regulatory submission (e.g., BLA, NDA)? What constitutes an acceptable level of model uncertainty for regulatory purposes? How does the BN-SV criticality metric relate to the FMEA-based risk ranking tools currently used in industry (e.g., risk priority numbers, severity-probability matrices as per ICH Q9)? How would DAG structure assumptions be validated for regulatory acceptance? For a journal targeting pharmaceutical sciences, these questions are not peripheral — they are central to demonstrating practical impact. MC6 – Computational Scalability Not Addressed Algorithm 2 employs a nested Gibbs sampling scheme with parameters Nπ, BO, and BI that are set to 500, 5, and 20, respectively, based on a citation to Song et al. (2016). For a process graph with 62 nodes and hundreds of parameters, the computational cost of this nested scheme is potentially prohibitive in industrial settings. No analysis of computational complexity, wall-clock runtime, or scalability to larger process graphs is provided. This omission is particularly concerning given the manuscript's claim to support real-time monitoring and release. 3. Minor Concerns mC1 – Typographical and Notation Inconsistencies: The manuscript contains several notation inconsistencies. In Table 8, the caption references "pFeed_20,CA_140" while the table body reports results for "rOil_28" and "Feed_23." This appears to be a labelling error that must be corrected. Additionally, the subscript "∗" notation used throughout Section 6 to denote posterior-based quantities is introduced informally and should be defined with greater precision. mC2 – Figures Require Enhancement: Figures 3 and 7 are central to the manuscript's contribution but are difficult to read at print resolution. Node labels in Fig. 3 are particularly small. All figures should be provided at a minimum of 300 dpi with legible fonts. Figure 8 (Appendix A) is complex but lacks a concise explanatory caption. mC3 – Abstract Omits Key Limitations: The abstract presents the framework without any acknowledgement of its assumptions or limitations. Journal standards for this venue require that abstracts reflect the actual scope and boundary conditions of the contribution. mC4 – Related Work on Nonlinear BN and Dynamic Models Is Absent: The background section does not review dynamic BN (DBN) models, which are directly relevant to time-series bioprocess data as encountered in the real case study. Similarly, nonlinear extensions of BN sensitivity analysis (e.g., based on copula approaches or non-Gaussian distributions) are not discussed, making the literature review incomplete. mC5 – Gibbs Sampler Convergence Diagnostics Not Reported: The Gibbs sampling procedure specifies T0 = 500 as burn-in and h = 10 as thinning, but provides no MCMC convergence diagnostics (e.g., Gelman-Rubin Rˆ statistic, trace plots, effective sample size). This is a methodological requirement for any Bayesian computation paper targeting a rigorous venue. mC6 – Prior Hyperparameter Sensitivity: The prior distributions in Equation (13) are described as "vague", but the specific hyperparameter values used are not reported in the main text (only in Appendix E for the simulation study). For the real case study, the prior specification is entirely opaque. A sensitivity analysis to prior choice, or at a minimum a full disclosure of hyperparameters used, is required. mC7 – Citation Formatting: Several citations appear inconsistently formatted. "Guideline, I. H. T. et al. (2009)" is an unusual citation format for ICH Q8(R2) and should reference the document directly. The Mitchell (2013) citation references a trade publication (BioPharm International) for the cause-and-effect matrix; this should be supplemented with a peer-reviewed source where possible. 4. Methodology Critique The methodological architecture of this paper is its primary strength and, simultaneously, its primary source of vulnerability. The integration of BN-based causal modelling with Shapley-value decomposition is mathematica