Functional and parametric identifiability for universal differential equations applied to chemical reaction networks

Abstract

Mathematical modelling has traditionally relied on detailed system knowledge to construct mechanistic models. However, the advent of large-scale data collection and advances in machine learning have led to an increasing use of data-driven approaches. Recently, hybrid models have emerged that combine both paradigms: well-understood system components are modelled mechanistically, while unknown parts are inferred from data. Here, we focus on one such class: universal differential equations (UDEs), where neural networks are embedded within differential equations to approximate unknown dynamics. When fitted to data, these networks act as universal function approximators, learning missing functional components. In this work, we note that UDE identifiability, i.e. our ability to identify true system properties, can be split into parametric and functional identifiability (assessing identifiability for the mechanistic and data-driven model parts, respectively). Next, we investigate how UDE properties, such as neural network numbers and constraints, affect parametric and functional identifiability. Notably, we show that across a wide range of models, the generalisation of a fully mechanistic model to a UDE has little impact on the mechanistic components' parametric identifiability. Finally, we note that hybrid modelling through the fitting of unknown functions (as achieved by UDEs) is particularly well-suited to chemical reaction network (CRN) modelling. Here, CRNs are used in fields ranging from systems biology, chemistry, and pharmacology to epidemiology and population dynamics, making them highly relevant for study. By showcasing how CRN-based UDE models can be highly interpretable, we demonstrate that this hybrid approach is a promising avenue for future applications.