SearcharxivSearch

arXiv subjects

Youngdeok Hwang

Publications and source records attributed to Youngdeok Hwang.

8 recordsLinked to original sources

Emulators for Large-scale Computer Experiments with Quantitative and Qualitative Inputs

Computer experiments with both quantitative and qualitative inputs have become common across various areas. However, constructing accurate and computationally efficient emulators for such experiments at large scales remains a significant challenge. We propose a novel, scalable framework for emulating computer experiments with mixed inputs. Our approach is based on a new covariance function integrating additive Gaussian Processes (GPs) to handle the mixed inputs, with Vecchia approximation for scalability. We demonstrate that methods for large-scale computer experiments can be effectively extended when paired with our proposed modeling framework.

stat.CO

Synthetic Data Generation With Incomplete Survey Data Under Informative Sampling

We propose a Bayesian framework for data synthesis and imputation in complex survey settings with informative sampling. To address variance underestimation in existing Bayesian approaches and to accommodate the missing data encountered in survey data, we introduce an adaptive weighting scheme for parameter estimation. We show that the proposed weighting yields consistent estimators with an asymptotically valid Godambe information matrix. The framework is flexible, accommodating a broad class of Bayesian models and facilitating practical implementation. Simulation studies demonstrate that the proposed method provides accurate uncertainty quantification for both model parameters and synthetic population inference.

stat.ME

Sparse Sensor Allocation for Inverse Problems of Detecting Sparse Leaking Emission Sources

This paper investigates the sparse optimal allocation of sensors for detecting sparse leaking emission sources. Because of the non-negativity of emission rates, uncertainty associated with parameters in the forward model, and sparsity of leaking emission sources, the classical linear Gaussian Bayesian inversion setup is limited and no closed-form solutions are available. By incorporating the non-negativity constraints on emission rates, relaxing the Gaussian distributional assumption, and considering the parameter uncertainties associated with the forward model, this paper provides comprehensive investigations, technical details, in-depth discussions and implementation of the optimal sensor allocation problem leveraging a bilevel optimization framework. The upper-level problem determines the optimal sensor locations by minimizing the Integrated Mean Squared Error (IMSE) of the estimated emission rates over uncertain wind conditions, while the lower-level problem solves an inverse problem that estimates the emission rates. Two algorithms, including the repeated Sample Average Approximation (rSAA) and the Stochastic Gradient Descent based bilevel approximation (SBA), are thoroughly investigated. It is shown that the proposed approach can further reduce the IMSE of the estimated emission rates starting from various initial sensor deployment generated by existing approaches. Convergence analysis is performed to obtain the performance guarantee, and numerical investigations show that the proposed approach can allocate sensors according to the parameters and output of the forward model. Computationally efficient code with GPU acceleration is available on GitHub so that the approach readily applicable.

stat.AP

Optimal Sensor Allocation with Multiple Linear Dispersion Processes

This paper considers the optimal sensor allocation for estimating the emission rates of multiple sources in a two-dimensional spatial domain. Locations of potential emission sources are known (e.g., factory stacks), and the number of sources is much greater than the number of sensors that can be deployed, giving rise to the optimal sensor allocation problem. In particular, we consider linear dispersion forward models, and the optimal sensor allocation is formulated as a bilevel optimization problem. The outer problem determines the optimal sensor locations by minimizing the overall Mean Squared Error of the estimated emission rates over various wind conditions, while the inner problem solves an inverse problem that estimates the emission rates. Two algorithms, including the repeated Sample Average Approximation and the Stochastic Gradient Descent based bilevel approximation, are investigated in solving the sensor allocation problem. Convergence analysis is performed to obtain the performance guarantee, and numerical examples are presented to illustrate the proposed approach.

stat.CO

Bayesian Model Calibration and Sensitivity Analysis for Oscillating Biological Experiments

Understanding the oscillating behaviors that govern organisms' internal biological processes requires interdisciplinary efforts combining both biological and computer experiments, as the latter can complement the former by simulating perturbed conditions with higher resolution. Harmonizing the two types of experiment, however, poses significant statistical challenges due to identifiability issues, numerical instability, and ill behavior in high dimension. This article devises a new Bayesian calibration framework for oscillating biochemical models. The proposed Bayesian model is estimated relying on an advanced Markov chain Monte Carlo (MCMC) technique which can efficiently infer the parameter values that match the simulated and observed oscillatory processes. Also proposed is an approach to sensitivity analysis based on the intervention posterior. This approach measures the influence of individual parameters on the target process by using the obtained MCMC samples as a computational tool. The proposed framework is illustrated with circadian oscillations observed in a filamentous fungus, Neurospora crassa.

stat.AP

A clustered Gaussian process model for computer experiments

A Gaussian process has been one of the important approaches for emulating computer simulations. However, the stationarity assumption for a Gaussian process and the intractability for large-scale dataset limit its availability in practice. In this article, we propose a clustered Gaussian process model which segments the input data into multiple clusters, in each of which a Gaussian process model is performed. The stochastic expectation-maximization is employed to efficiently fit the model. In our simulations as well as a real application to solar irradiance emulation, our proposed method had smaller mean square errors than its main competitors, with competitive computation time, and provides valuable insights from data by discovering the clusters. An R package for the proposed methodology is provided in an open repository.

stat.ME

Synthesizing simulation and field data of solar irradiance

Predicting the intensity and amount of sunlight as a function of location and time is an essential component in identifying promising locations for economical solar farming. Although weather models and irradiance data are relatively abundant, these have yet, to our knowledge, been hybridized on a continental scale. Rather, much of the emphasis in the literature has been on short-term localized forecasting. This is probably because the amount of data involved in a more global analysis is prohibitive with the canonical toolkit, via the Gaussian process (GP). Here we show how GP surrogate and discrepancy models can be combined to tractably and accurately predict solar irradiance on time-aggregated and daily scales with measurements at thousands of sites across the continental United States. Our results establish short term accuracy of bias-corrected weather-based simulation of irradiance, when realizations are available in real space-time (e.g., in future days), and provide accurate surrogates for smoothing in the more common situation where reliable weather data is not available (e.g., in future years).

stat.AP

Development of hp-inverse model by using generalized polynomial chaos

We present a hp-inverse model to estimate a smooth, non-negative source function from a limited number of observations for a two-dimensional linear source inversion problem. A standard least-square inverse model is formulated by using a set of Gaussian radial basis functions (GRBF) on a rectangular mesh system with a uniform grid space. Here, the choice of the mesh system is modeled as a random variable and the generalized polynomial chaos (gPC) expansion is used to represent the random mesh system. It is shown that the convolution of gPC and GRBF provides hierarchical basis functions for the linear source inverse model with the $hp$-refinement capability. We propose a mixed l_1 and l_2 regularization to exploit the hierarchical nature of the basis functions to find a sparse solution. The $hp$-inverse model has an advantage over the standard least-square inverse model when the number of data is limited. It is shown that the hp-inverse model provides a good estimate of the source function even when the number of unknown parameters ($m$) is much larger the number of data ($n$), e.g., m/n > 40.

physics.ao-ph