arXiv subjects

Domenic Di Francesco

Publications and source records attributed to Domenic Di Francesco.

4 recordsLinked to original sources

arXiv2025

Is Your Model Risk ALARP? Evaluating Prospective Safety-Critical Applications of Complex Models

The increasing availability of advanced computational modelling offers new opportunities to improve safety, efficacy, and emissions reductions. Application of complex models to support engineering decisions has been slow in comparison to other sectors, reflecting the higher consequence of unsafe applications. Adopting a complex model introduces a \emph{model risk}, namely the expected consequence of incorrect or otherwise unhelpful outputs. This should be weighed against the prospective benefits that the more sophisticated model can provide, also accounting for the non-zero risk of existing practice. Demonstrating when the model risk of a proposed machine learning application is As Low As Reasonably Practicable (ALARP) can help ensure that safety-critical industries benefit from complex models where appropriate while avoiding their misuse. An example of automated weld radiograph classification is presented to demonstrate how this can be achieved by combining statistical decision analysis, uncertainty quantification, and value of information.

stat.AP↗

arXiv2024

Rationalising data collection for supporting decision making in building energy systems using Value of Information analysis

The use of data collection to support decision making through the reduction of uncertainty is ubiquitous in the management, operation, and design of building energy systems. However, no existing studies in the building energy systems literature have quantified the economic benefits of data collection strategies to determine whether they are worth their cost. This work demonstrates that Value of Information analysis (VoI), a Bayesian Decision Analysis framework, provides a suitable methodology for quantifying the benefits of data collection. Three example decision problems in building energy systems are studied: air-source heat pump maintenance scheduling, ventilation scheduling for indoor air quality, and ground-source heat pump system design. Smart meters, occupancy monitoring systems, and ground thermal tests are shown to be economically beneficial for supporting these decisions respectively. It is proposed that further study of VoI in building energy systems would allow expenditure on data collection to be economised and prioritised, avoiding wastage.

eess.SY↗

arXiv2023

System Effects in Identifying Risk-Optimal Data Requirements for Digital Twins of Structures

Structural Health Monitoring (SHM) technologies offer much promise to the risk management of the built environment, and they are therefore an active area of research. However, information regarding material properties, such as toughness and strength is instead measured in destructive lab tests. Similarly, the presence of geometrical anomalies is more commonly detected and sized by inspection. Therefore, a risk-optimal combination should be sought, acknowledging that different scenarios will be associated with different data requirements. Value of Information (VoI) analysis is an established statistical framework for quantifying the expected benefit of a prospective data collection activity. In this paper the expected value of various combinations of inspection, SHM and testing are quantified, in the context of supporting risk management of a location of stress concentration in a railway bridge. The Julia code for this analysis (probabilistic models and influence diagrams) is made available. The system-level results differ from a simple linear sum of marginal VoI estimates, i.e. the expected value of collecting data from SHM and inspection together is not equal to the expected value of SHM data plus the expected value of inspection data. In summary, system-level decision making, requires system-level models.

stat.AP↗

arXiv2023

Value of Information Analysis for rationalising information gathering in building energy analysis

The use of monitored data to improve the accuracy of building energy models and operation of energy systems is ubiquitous, with topics such as building monitoring and Digital Twinning attracting substantial research attention. However, little attention has been paid to quantifying the value of the data collected against its cost. This paper argues that without a principled method for determining the value of data, its collection cannot be prioritised. It demonstrates the use of Value of Information analysis (VoI), which is a Bayesian Decision Analysis framework, to provide such a methodology for quantifying the value of data collection in the context of building energy modelling and analysis. Three energy decision-making examples are presented: ventilation scheduling, heat pump maintenance scheduling, and ground source heat pump design. These examples illustrate the use of VoI to support decision-making on data collection.

eess.SY↗