SearcharxivSearch

arXiv subjects

Christopher Stanley

Publications and source records attributed to Christopher Stanley.

3 recordsLinked to original sources

An exponential mechanism based on quadratic approximations for fine-tuning machine learning models with privacy guarantees

Fine-tuning adapts a pretrained machine learning model to a small, sensitive dataset, but this process risks memorizing individual new data points, making the model vulnerable to adversaries who seek to extract sensitive information. In this work, we develop a randomized algorithm based on the exponential mechanism for fine-tuning while ensuring differential privacy. Our key idea is to construct a simple utility function that combines a local quadratic approximation of the pretrained model with information from the new dataset. The resulting exponential mechanism admits exact sampling from a multivariate normal distribution in closed form. We establish theoretical privacy guarantees, sensitivity bounds, and accuracy estimations for our method. We further introduce a random-projection strategy that makes the approach scalable to high-dimensional models. Numerical experiments on the MNIST benchmark and the MIMIC clinical dataset demonstrate competitive performance against existing differentially private fine-tuning techniques.

cs.LG

Computer-aided abnormality detection in chest radiographs in a clinical setting via domain-adaptation

Deep learning (DL) models are being deployed at medical centers to aid radiologists for diagnosis of lung conditions from chest radiographs. Such models are often trained on a large volume of publicly available labeled radiographs. These pre-trained DL models' ability to generalize in clinical settings is poor because of the changes in data distributions between publicly available and privately held radiographs. In chest radiographs, the heterogeneity in distributions arises from the diverse conditions in X-ray equipment and their configurations used for generating the images. In the machine learning community, the challenges posed by the heterogeneity in the data generation source is known as domain shift, which is a mode shift in the generative model. In this work, we introduce a domain-shift detection and removal method to overcome this problem. Our experimental results show the proposed method's effectiveness in deploying a pre-trained DL model for abnormality detection in chest radiographs in a clinical setting.

cs.CV

Understanding inelastically scattered neutrons from water on a time-of-flight small-angle neutron scattering (SANS) instrument

It is generally assumed by most of the small-angle neutron scattering (SANS) user community that a neutrons energy is unchanged during SANS measurements. Here, the scattering from water, specifically light water, was measured on the EQ-SANS instrument, a time-of-flight SANS instrument located at the Spallation Neutron Source of Oak Ridge National Laboratory. A significant inelastic process was observed in the TOF spectra of neutrons scattered from water. Analysis of the TOF spectra from the sample showed that the scattered neutrons have energies consistent with room-temperature thermal energies (~20 meV) regardless of the incident neutron energy. With the aid of Monte Carlo particle transport simulations, we conclude that the thermalization process within the sample results in faster neutrons that arrive at the detector earlier than expected based on the incident neutron energies. This thermalization process impacts the measured SANS intensities in a manner that will ultimately be sample- and temperature-dependent, necessitating careful processing of the raw data into the SANS cross-section.

physics.ins-det