SearcharxivSearch

arXiv subjects

Robert Bassett

Publications and source records attributed to Robert Bassett.

At least 19 recordsLinked to original sources

Lessons Learned from Deploying Adaptive Machine Learning Agents with Limited Data for Real-time Cell Culture Process Monitoring

This study explores the deployment of three machine learning (ML) approaches for real-time prediction of glucose, lactate, and ammonium concentrations in cell culture processes, using Raman spectroscopy as input features. The research addresses challenges associated with limited data availability and process variability, providing a comparative analysis of pretrained models, just-in-time learning (JITL), and online learning algorithms. Two industrial case studies are presented to evaluate the impact of varying bioprocess conditions on model performance. The findings highlight the specific conditions under which pretrained models demonstrate superior predictive accuracy and identify scenarios where JITL or online learning approaches are more effective for adaptive process monitoring. This study also highlights the critical importance of updating the deployed models/agents with the latest offline analytical measurements during bioreactor operations to maintain the model performance against the changes in cell growth behaviours and operating conditions throughout the bioreactor run. Additionally, the study confirms the usefulness of a simple mixture-of-experts framework in achieving enhanced accuracy and robustness for real-time predictions of metabolite concentrations based on Raman spectral data. These insights contribute to the development of robust strategies for the efficient deployment of ML models in dynamic and changing biomanufacturing environments.

q-bio.QM

Uncertainty Quantification Using Ensemble Learning and Monte Carlo Sampling for Performance Prediction and Monitoring in Cell Culture Processes

Biopharmaceutical products, particularly monoclonal antibodies (mAbs), have gained prominence in the pharmaceutical market due to their high specificity and efficacy. As these products are projected to constitute a substantial portion of global pharmaceutical sales, the application of machine learning models in mAb development and manufacturing is gaining momentum. This paper addresses the critical need for uncertainty quantification in machine learning predictions, particularly in scenarios with limited training data. Leveraging ensemble learning and Monte Carlo simulations, our proposed method generates additional input samples to enhance the robustness of the model in small training datasets. We evaluate the efficacy of our approach through two case studies: predicting antibody concentrations in advance and real-time monitoring of glucose concentrations during bioreactor runs using Raman spectra data. Our findings demonstrate the effectiveness of the proposed method in estimating the uncertainty levels associated with process performance predictions and facilitating real-time decision-making in biopharmaceutical manufacturing. This contribution not only introduces a novel approach for uncertainty quantification but also provides insights into overcoming challenges posed by small training datasets in bioprocess development. The evaluation demonstrates the effectiveness of our method in addressing key challenges related to uncertainty estimation within upstream cell cultivation, illustrating its potential impact on enhancing process control and product quality in the dynamic field of biopharmaceuticals.

q-bio.QM

Galaxy 3D Shape Recovery using Mixture Density Network

Since the turn of the century, astronomers have been exploiting the rich information afforded by combining stellar kinematic maps and imaging in an attempt to recover the intrinsic, three-dimensional (3D) shape of a galaxy. A common intrinsic shape recovery method relies on an expected monotonic relationship between the intrinsic misalignment of the kinematic and morphological axes and the triaxiality parameter. Recent studies have, however, cast doubt about underlying assumptions relating shape and intrinsic kinematic misalignment. In this work, we aim to recover the 3D shape of individual galaxies using their projected stellar kinematic and flux distributions using a supervised machine learning approach with mixture density network (MDN). Using a mock dataset of the EAGLE hydrodynamical cosmological simulation, we train the MDN model for a carefully selected set of common kinematic and photometric parameters. Compared to previous methods, we demonstrate potential improvements achieved with the MDN model to retrieve the 3D galaxy shape along with the uncertainties, especially for prolate and triaxial systems. We make specific recommendations for recovering galaxy intrinsic shapes relevant for current and future integral field spectroscopic galaxy surveys.

astro-ph.IM

Applications of Machine Learning in Biopharmaceutical Process Development and Manufacturing: Current Trends, Challenges, and Opportunities

While machine learning (ML) has made significant contributions to the biopharmaceutical field, its applications are still in the early stages in terms of providing direct support for quality-by-design based development and manufacturing of biopharmaceuticals, hindering the enormous potential for bioprocesses automation from their development to manufacturing. However, the adoption of ML-based models instead of conventional multivariate data analysis methods is significantly increasing due to the accumulation of large-scale production data. This trend is primarily driven by the real-time monitoring of process variables and quality attributes of biopharmaceutical products through the implementation of advanced process analytical technologies. Given the complexity and multidimensionality of a bioproduct design, bioprocess development, and product manufacturing data, ML-based approaches are increasingly being employed to achieve accurate, flexible, and high-performing predictive models to address the problems of analytics, monitoring, and control within the biopharma field. This paper aims to provide a comprehensive review of the current applications of ML solutions in a bioproduct design, monitoring, control, and optimisation of upstream, downstream, and product formulation processes. Finally, this paper thoroughly discusses the main challenges related to the bioprocesses themselves, process data, and the use of machine learning models in biopharmaceutical process development and manufacturing. Moreover, it offers further insights into the adoption of innovative machine learning methods and novel trends in the development of new digital biopharma solutions.

cs.LG

Exponential Family Trend Filtering on Lattices

Trend filtering is a modern approach to nonparametric regression that is more adaptive to local smoothness than splines or similar basis procedures. Existing analyses of trend filtering focus on estimating a function corrupted by homoskedastic Gaussian noise, but our work extends this technique to general exponential family distributions. This extension is motivated by the need to study massive, gridded climate data derived from polar-orbiting satellites. We present algorithms tailored to large problems, theoretical results for general exponential family likelihoods, and principled methods for tuning parameter selection without excess computation.

math.ST

Lyman Continuum Galaxy Candidates in COSMOS

Star-forming galaxies are the sources likely to have reionized the universe. As we cannot observe them directly due to the opacity of the intergalactic medium at $z\gtrsim5$, we study $z\sim3\text{--}5$ galaxies as proxies to place observational constraints on cosmic reionization. Using new deep \textit{Hubble Space Telescope} rest-frame UV F336W and F435W imaging (30-orbit, $\sim40$~arcmin$^2$, $\sim29\text{--}30$~mag depth at 5$σ$), we attempt to identify a sample of Lyman continuum galaxies (LCGs). These are individual sources that emit ionizing flux below the Lyman break ($<912~\textÅ$). This population would allow us to constrain cosmic reionization parameters such as the number density and escape fraction ($f_{\rm esc}$) of ionizing sources. We compile a comprehensive parent sample that does not rely on the Lyman-break technique for redshifts. We present three new spectroscopic candidates at $z\sim3.7\text{--}4.4$, and 32 new photometric candidates. The high-resolution multi-band HST imaging and new Keck/Low Resolution Imaging Spectrometer (LRIS) redshifts make these promising spectroscopic LCG candidates. Using both a traditional and probabilistic approach, we find the most likely $f_{\rm esc}$ values for the three spectroscopic LCG candidates are $>100\%$, and therefore not physical. We are unable to confirm the true nature of these sources with the best available imaging and direct blue Keck/LRIS spectroscopy. More spectra, especially from the new class of 30 m telescopes, will be required to build a statistical sample of LCGs to place firm observational constraints on cosmic reionization.

astro-ph.GA

DeepFake Detection with Inconsistent Head Poses: Reproducibility and Analysis

Applications of deep learning to synthetic media generation allow the creation of convincing forgeries, called DeepFakes, with limited technical expertise. DeepFake detection is an increasingly active research area. In this paper, we analyze an existing DeepFake detection technique based on head pose estimation, which can be applied when fake images are generated with an autoencoder-based face swap. Existing literature suggests that this method is an effective DeepFake detector, and its motivating principles are attractively simple. With an eye towards using these principles to develop new DeepFake detectors, we conduct a reproducibility study of the existing method. We conclude that its merits are dramatically overstated, despite its celebrated status. By investigating this discrepancy we uncover a number of important and generalizable insights related to facial landmark detection, identity-agnostic head pose estimation, and algorithmic bias in DeepFake detectors. Our results correct the current literature's perception of state of the art performance for DeepFake detection.

cs.CV

The Maximal Eigengap Estimator for Acoustic Vector-Sensor Processing

This paper introduces the maximal eigengap estimator for finding the direction of arrival of a wideband acoustic signal using a single vector-sensor. We show that in this setting narrowband cross-spectral density matrices can be combined in an optimal weighting that approximately maximizes signal-to-noise ratio across a wide frequency band. The signal subspace resulting from this optimal combination of narrowband power matrices defines the maximal eigengap estimator. We discuss the advantages of the maximal eigengap estimator over competing methods, and demonstrate its utility in a real-data application using signals collected in 2019 from an acoustic vector-sensor deployed in the Monterey Bay.

eess.SP

One-Step Estimation With Scaled Proximal Methods

We study statistical estimators computed using iterative optimization methods that are not run until completion. Classical results on maximum likelihood estimators (MLEs) assert that a one-step estimator (OSE), in which a single Newton-Raphson iteration is performed from a starting point with certain properties, is asymptotically equivalent to the MLE. We further develop these early-stopping results by deriving properties of one-step estimators defined by a single iteration of scaled proximal methods. Our main results show the asymptotic equivalence of the likelihood-based estimator and various one-step estimators defined by scaled proximal methods. By interpreting OSEs as the last of a sequence of iterates, our results provide insight on scaling numerical tolerance with sample size. Our setting contains scaled proximal gradient descent applied to certain composite models as a special case, making our results applicable to many problems of practical interest. Additionally, our results provide support for the utility of the scaled Moreau envelope as a statistical smoother by interpreting scaled proximal descent as a quasi-Newton method applied to the scaled Moreau envelope.

math.OC

Color and Edge-Aware Adversarial Image Perturbations

Adversarial perturbation of images, in which a source image is deliberately modified with the intent of causing a classifier to misclassify the image, provides important insight into the robustness of image classifiers. In this work we develop two new methods for constructing adversarial perturbations, both of which are motivated by minimizing human ability to detect changes between the perturbed and source image. The first of these, the Edge-Aware method, reduces the magnitude of perturbations permitted in smooth regions of an image where changes are more easily detected. Our second method, the Color-Aware method, performs the perturbation in a color space which accurately captures human ability to distinguish differences in colors, thus reducing the perceived change. The Color-Aware and Edge-Aware methods can also be implemented simultaneously, resulting in image perturbations which account for both human color perception and sensitivity to changes in homogeneous regions. Because Edge-Aware and Color-Aware modifications exist for many image perturbations techniques, we also focus on computation to demonstrate their potential for use within more complex perturbation schemes. We empirically demonstrate that the Color-Aware and Edge-Aware perturbations we consider effectively cause misclassification, are less distinguishable to human perception, and are as easy to compute as the most efficient image perturbation techniques. Code and demo available at https://github.com/rbassett3/Color-and-Edge-Aware-Perturbations

cs.CV

The intricate link between galaxy dynamics and intrinsic shape (or why so-called prolate rotation is a misnomer)

Many recent integral integral field spectroscopy (IFS) survey teams have used stellar kinematic maps combined with imaging to statistically infer the underlying distributions of galaxy intrinsic shapes. With now several IFS samples at our disposal, the method, which was originally proposed by M. Franx and collaborators in 1991, is gaining in popularity, having been so far applied to ATLAS3D, SAMI, MANGA and MASSIVE. We present results showing that a commonly assumed relationship between dynamical and intrinsic shape alignment does not hold in Illustris, affecting our ability to recover accurate intrinsic shape distributions. A further implication is that so-called "prolate rotation", where the bulk of stars in prolate galaxies are thought to rotate around the projected major axis, is a misnomer.

astro-ph.GA

Prospects for Recovering Galaxy Intrinsic Shapes from Projected Quantities

The distribution of three dimensional intrinsic galaxy shapes has been a longstanding open question. The difficulty stems from projection effects meaning one must rely on statistical methods applied to galaxy samples to infer intrinsic shape distributions. Theoretical work using analytical galaxy potentials suggests a relationship between galaxy intrinsic shape (as defined by its "triaxiality", in practice a proxy for how prolate a galaxy is) and the intrinsic misalignment angle between kinematic and morphological axes ($Ψ_{\rm int}$). This relationship reduces the number of unknowns, providing more reliable inferred intrinsic shape distributions than methods using photometry alone. Here we explore the connection between intrinsic shape and stellar kinematics using cosmological hydrodynamical simulations from the Illustris project. The strongest relationship we find is that galaxy intrinsic flattening is correlated with specific angular momentum (j) with high j galaxies being flatter than galaxies with low specific angular momentum. Our analysis shows that, although the majority of kinematically misaligned galaxies exhibit prolate shapes, examples of kinematically aligned prolate galaxies are also present. Clearly a direct correspondence between prolate shape and minor-axis rotation (often referred to as "prolate rotation") is not present in Illustris. Thus, we demonstrate that the assumption of a simple relationship between $Ψ_{\rm int}$ and intrinsic shape commonly employed in shape recovery studies is not valid for Illustris galaxies. We suggest improvements on the method as well as some alternative methods for future work in this area.

astro-ph.GA

Fused Density Estimation: Theory and Methods

In this paper we introduce a method for nonparametric density estimation on geometric networks. We define fused density estimators as solutions to a total variation regularized maximum-likelihood density estimation problem. We provide theoretical support for fused density estimation by proving that the squared Hellinger rate of convergence for the estimator achieves the minimax bound over univariate densities of log-bounded variation. We reduce the original variational formulation in order to transform it into a tractable, finite-dimensional quadratic program. Because random variables on geometric networks are simple generalizations of the univariate case, this method also provides a useful tool for univariate density estimation. Lastly, we apply this method and assess its performance on examples in the univariate and geometric network setting. We compare the performance of different optimization techniques to solve the problem, and use these results to inform recommendations for the computation of fused density estimators.

stat.ME

Maximum a Posteriori Estimators as a Limit of Bayes Estimators

Maximum a posteriori and Bayes estimators are two common methods of point estimation in Bayesian Statistics. It is commonly accepted that maximum a posteriori estimators are a limiting case of Bayes estimators with 0-1 loss. In this paper, we provide a counterexample which shows that in general this claim is false. We then correct the claim that by providing a level-set condition for posterior densities such that the result holds. Since both estimators are defined in terms of optimization problems, the tools of variational analysis find a natural application to Bayesian point estimation.

math.ST

Robust Cross-correlation-based Measurement of Clump Sizes in Galaxies

Stars form in molecular complexes that are visible as giant clouds ($\sim 10^{5-6} \mathrm{M}_\odot$) in nearby galaxies and as giant clumps ($\sim 10^{8-9}\mathrm{M}_\odot$) in galaxies at redshifts $z\approx1$$-$$3$. Theoretical inferences on the origin and evolution of these complexes often require robust measurements of their characteristic size, which is hard to measure at limited resolution and often ill-defined due to overlap and quasi-fractal substructure. We show that maximum and luminosity-weighted sizes of clumps seen in star formation maps (e.g.\ H$α$) can be recovered statistically using the two-point correlation function (2PCF), if an approximate stellar surface density map is taken as the normalizing random field. After clarifying the link between Gaussian clumps and the 2PCF analytically, we design a method for measuring the diameters of Gaussian clumps with realistic quasi-fractal substructure. This method is tested using mock images of clumpy disk galaxies at different spatial resolutions and perturbed by Gaussian white noise. We find that the 2PCF can recover the input clump scale at $\sim20\%$ accuracy, as long as this scale is larger than the spatial resolution. We apply this method to the local spiral galaxy NGC 5194, as well as to three clumpy turbulent galaxies from the DYNAMO-HST sample. In both cases, our statistical H$α$-clump size measurements agree with previous measurements and with the estimated Jeans lengths. However, the new measurements are free from subjective choices when fitting individual clumps.

astro-ph.GA

The SAMI Galaxy Survey: Kinematics of Dusty Early-Type Galaxies

Recently, large samples of visually classified early-type galaxies (ETGs) containing dust have been identified using space-based infrared observations with the Herschel Space Telescope. The presence of large quantities of dust in massive ETGs is peculiar as X-ray halos of these galaxies are expected to destroy dust in 10 Myr (or less). This has sparked a debate regarding the origin of the dust: is it internally produced by asymptotic giant branch (AGB) stars, or is it accreted externally through mergers? We examine the 2D stellar and ionised gas kinematics of dusty ETGs using IFS observations from the SAMI galaxy survey, and integrated star-formation rates, stellar masses, and dust masses from the GAMA survey. Only 8% (4/49) of visually-classified ETGs are kinematically consistent with being dispersion-supported systems. These "dispersion-dominated galaxies" exhibit discrepancies between stellar and ionised gas kinematics, either offsets in the kinematic position angle or large differences in the rotational velocity, and are outliers in star-formation rate at a fixed dust mass compared to normal star-forming galaxies. These properties are suggestive of recent merger activity. The remaining 90% of dusty ETGs have low velocity dispersions and/or large circular velocities, typical of "rotation-dominated galaxies". These results, along with the general evidence of published works on X-ray emission in ETGs, suggest that they are unlikely to host hot, X-ray gas consistent with their low stellar mass when compared to dispersion-dominated galaxies. This means dust will be long lived and thus these galaxies do not require external scenarios for the origin of their dust content.

astro-ph.GA

The Formation of S0 Galaxies with Counter-Rotating Neutral and Molecular Hydrogen

The observation of counter rotation in galaxies (i.e. gas that rotates in the opposite direction to the stellar component or two co-spatial stellar populations with opposite rotation) is becoming more commonplace with modern integral field spectroscopic surveys. In this paper we explore the emergence of counter-rotation (both stellar and gaseous) in S0 galaxies from smoothed-particle hydrodynamics simulations of 1/10 mass ratio minor mergers between a 10^10.8 solar mass disk galaxy with a bulge-to-total ration of 0.17 and a gas rich companion (gas-to-stellar mass fraction of 5.0). These simulations include a self-consistent treatment of gas dynamics, star formation, the production/destruction of H2 and dust, and the time evolution of the interstellar radiation field. We explore the effect of retrograde versus prograde obits, gas and bulge mass fractions of the primary galaxy, and orbital parameters of the companion. The key requirement for producing counter rotation in stars or gas in a merger remnant is a retrograde primary, while the relative spin of the companion affects only the radial extent of the accreted gas. We also find that including a significant amount of gas in the primary can prevent the emergence of counter-rotating gas, although accreted stars retain counter-rotation. Bulge mass and orbit have a secondary effect, generally influencing the final distribution of accreted stars and gas within the framework outlined above. In addition to our primary focus of counter-rotating components in galaxies, we also make some predictions regarding the SFRs, H2 distributions, and dust in minor merger remnants.

astro-ph.GA

Dust Attenuation in Clumpy, Star-Forming Galaxies at 0.07 < z < 0.14

Dust attenuation in galaxies has been extensively studied nearby, however, there are still many unknowns regarding attenuation in distant galaxies. We contribute to this effort using observations of star-forming galaxies in the redshift range z = 0.05-0.15 from the DYNAMO survey. Highly star-forming DYNAMO galaxies share many similar attributes to clumpy, star-forming galaxies at high redshift. Considering integrated Sloan Digital Sky Survey observations, trends between attenuation and other galaxy properties for DYNAMO galaxies are well matched to star-forming galaxies at high redshift. Integrated gas attenuations of DYNAMO galaxies are 0.2-2.0 mags in the V-band, and the ratio of stellar E(B-V) and gas E(B-V) is 0.78-0.08 (compared to 0.44 at low redshift). Four highly star-forming DYNAMO galaxies were observed at H-alpha using the Hubble Space Telescope and at Pa-alpha using integral field spectroscopy at Keck. The latter achieve similar resolution (~0.8-1 kpc) to our HST imaging using adaptive optics, providing resolved observations of gas attenuations of these galaxies on sub-kpc scales. We find < 1.0 mag of variation in attenuation (at H-alpha) from clump to clump, with no evidence of highly attenuated star formation. Attenuations are in the range 0.3-2.2 mags in the V band, consistent with attenuations of low redshift star-forming galaxies. The small spatial variation on attenuation suggests that a majority of the star-formation activity in these four galaxies occurs in relatively unobscured regions and, thus, star-formation is well characterised by our H-alpha observations.

astro-ph.GA