SearcharxivSearch

arXiv subjects

David Chapman

Publications and source records attributed to David Chapman.

18 recordsLinked to original sources

RDDMPI: Residual Denoising Diffusion Model for Probabilistic Multivariate Time Series Imputation

Multivariate time series imputation (MTSI) aims to recover missing values in temporal data composed of multiple interdependent variables. This problem is central to real-world applications such as healthcare monitoring, traffic networks, and energy systems. Recent diffusion-based approaches have shown strong potential for probabilistic imputation by learning to generate missing values through iterative denoising. However, most existing approaches perform diffusion directly in the original data space, requiring the denoising network to simultaneously capture global structure, temporal dynamics, and stochastic variability. This makes the generative task unnecessarily complex, especially when modern deterministic imputers can already provide accurate initial reconstructions. To address this limitation, we propose RDDMPI, a conditional residual diffusion framework that operates directly in residual space. Instead of modeling the full missing signal directly, we reformulate probabilistic imputation as a baseline-residual decomposition, where a pretrained model captures the dominant signal and a diffusion process models the residual uncertainty. To better exploit deterministic guidance, \model{} conditions the reverse denoising process on both the baseline-completed signal and its latent representation, while a reliability-aware conditioning mechanism adaptively controls the influence of baseline information during residual generation. This formulation simplifies the diffusion learning objective, enabling it to focus on structured correction terms rather than reconstructing the full signal. Experiments on multiple benchmark datasets demonstrate that RDDMPI consistently improves both reconstruction accuracy and uncertainty quantification.

cs.LG

Impact of ion-electron collisions on nonlocal ion heat conduction, viscous stress, and diffusion

By applying a first-principles reduced kinetic method, this work demonstrates the impact of ion-electron collisions on ion transport for strongly inhomogeneous plasmas in the nonlocal regime, where collisionality is insufficient to enforce local thermal equilibrium due to sharp gradients. Ion heat conduction and viscous stress in both unmagnetized and magnetized plasmas are considered, as well as inter-species diffusion in multi-species plasmas. Most notably, even for equal ion and electron temperatures, ion-electron collisions are found to substantially modify the peak nonlocal heat flow, whereas nonlocal preheats are strongly suppressed since streaming suprathermal particles are further out in the tail of the cold ion distribution where ion-electron collisions become dominant.

physics.plasm-ph

End-to-end Feature Alignment: A Simple CNN with Intrinsic Class Attribution

We present Feature-Align CNN (FA-CNN), a prototype CNN architecture with intrinsic class attribution through end-to-end feature alignment. Our intuition is that the use of unordered operations such as Linear and Conv2D layers cause unnecessary shuffling and mixing of semantic concepts, thereby making raw feature maps difficult to understand. We introduce two new order preserving layers, the dampened skip connection, and the global average pooling classifier head. These layers force the model to maintain an end-to-end feature alignment from the raw input pixels all the way to final class logits. This end-to-end alignment enhances the interpretability of the model by allowing the raw feature maps to intrinsically exhibit class attribution. We prove theoretically that FA-CNN penultimate feature maps are identical to Grad-CAM saliency maps. Moreover, we prove that these feature maps slowly morph layer-by-layer over network depth, showing the evolution of features through network depth toward penultimate class activations. FA-CNN performs well on benchmark image classification datasets. Moreover, we compare the averaged FA-CNN raw feature maps against Grad-CAM and permutation methods in a percent pixels removed interpretability task. We conclude this work with a discussion and future, including limitations and extensions toward hybrid models.

cs.CV

A First-Principles Closure for Nonlocal Magnetized Transport

A reduced kinetic method (RKM) for describing nonlocal transport in magnetized plasmas is derived from first principles and considered in a 1D3V geometry. Unlike standard nonlocal closures, this RKM uses the Fokker-Planck collision operator, therefore local transport results are naturally reproduced for small Knudsen number. An inhibited peak heat flux and preheat of the conductive heat flux are observed, which are expected from physical arguments and previous kinetic studies. Nonlocal behavior of other transport fluxes, namely the Righi-Leduc, Peltier, Ettingshausen, Nernst, thermal force, friction, cross friction, viscous stress, and gyroviscous stress terms are also demonstrated. Neglecting the nonlinear component of the Fokker-Planck collision operator is justified a posteriori. An especially computationally efficient and analytically simpler version of the RKM is presented.

physics.plasm-ph

Nonlocal current-driven heat flow in ideal plasmas

Electron heat flux is an important and often dominant mechanism of energy transport in a variety of collisional plasmas in a confined fusion or astrophysical context. While nonlocal conductive heat transport, driven by strong temperature gradients, has been investigated extensively in previous literature, nonlocal regimes of the current-driven heat flow and friction have not received the same attention. In this work, a first-principles reduced kinetic method (RKM) is applied to study nonlocal effects on current-driven transport. In addition to nonlocality due to sharp gradients, sufficiently large currents are found to significantly enhance current-driven heat flux due to a novel nonlocal mechanism, with this enhancement being increasingly prevalent for higher effective ionizations $Z^*$. Introducing the dimensionless number $N_u \equiv \vert \boldsymbol{u}_e - \boldsymbol{u}_i \vert / v_{\text{th},e}$, these enhancements occur for even relatively weak flows $N_u \gtrsim 1/100$, analogously to standard nonlocal effects becoming significant for Knudsen numbers $N_K \gtrsim 1/100$.

physics.plasm-ph

Why CNN Features Are not Gaussian: A Statistical Anatomy of Deep Representations

Deep convolutional neural networks (CNNs) are commonly analyzed through geometric and linear-algebraic perspectives, yet the statistical distribution of their internal feature activations remains poorly understood. In many applications, deep features are implicitly treated as Gaussian when modeling densities. In this work, we empirically examine this assumption and show that it does not accurately describe the distribution of CNN feature activations. Through a systematic study across multiple architectures and datasets, we find that the feature activations deviate substantially from Gaussian and are better characterized by Weibull and related long-tailed distributions. We further introduce a novel Discretized Characteristic Function Copula (DCF-Copula) method to model multivariate feature dependencies. We find that tail-length increases with network depth and that upper-tail dependence emerges between feature pairs. These statistical findings are not consistent with the Central Limit Theorem, and are instead indicative of a Matthew process that progressively concentrates semantic signal within the tails. These statistical findings suggest that CNNs are excellent at noise reduction, yet poor at outlier removal tasks. We recommend the use of long-tailed upper-tail-dependent priors as opposed to Gaussian priors for accurately CNN deep feature density. Code available at https://github.com/dchapman-prof/DCF-Copula

cs.CV

FLAIM: A reduced volume ignition model for the compression and thermonuclear burn of spherical fuel capsules

We present the "First Light Advanced Ignition Model" (FLAIM), a reduced model for the implosion, adiabatic compression, volume ignition and thermonuclear burn of a spherical DT fuel capsule utilising a high-Z metal pusher. FLAIM is characterised by a highly modular structure, which makes it an appropriate tool for optimisations, sensitivity analyses and parameter scans. One of the key features of the code is the 1D description of the hydrodynamic operator, which has a minor impact on the computational efficiency, but allows us to gain a major advantage in terms of physical accuracy. We demonstrate that a more accurate treatment of the hydrodynamics plays a primary role in closing most of the gap between a simple model and a general 1D rad-hydro code, and that only a residual part of the discrepancy is attributable to the heat losses. We present a detailed quantitative comparison between FLAIM and 1D rad-hydro simulations, showing good agreement over a large parameter space in terms of temporal profiles of key physical quantities, ignition maps and typical burn metrics.

physics.plasm-ph

A Method of Moments Embedding Constraint and its Application to Semi-Supervised Learning

Discriminative deep learning models with a linear+softmax final layer have a problem: the latent space only predicts the conditional probabilities $p(Y|X)$ but not the full joint distribution $p(Y,X)$, which necessitates a generative approach. The conditional probability cannot detect outliers, causing outlier sensitivity in softmax networks. This exacerbates model over-confidence impacting many problems, such as hallucinations, confounding biases, and dependence on large datasets. To address this we introduce a novel embedding constraint based on the Method of Moments (MoM). We investigate the use of polynomial moments ranging from 1st through 4th order hyper-covariance matrices. Furthermore, we use this embedding constraint to train an Axis-Aligned Gaussian Mixture Model (AAGMM) final layer, which learns not only the conditional, but also the joint distribution of the latent space. We apply this method to the domain of semi-supervised image classification by extending FlexMatch with our technique. We find our MoM constraint with the AAGMM layer is able to match the reported FlexMatch accuracy, while also modeling the joint distribution, thereby reducing outlier sensitivity. We also present a preliminary outlier detection strategy based on Mahalanobis distance and discuss future improvements to this strategy. Code is available at: \url{https://github.com/mmajurski/ssl-gmm}

cs.CV

Richtmyer-Meshkov Instability at high Mach Number: Non-Newtonian Effects

The Richtmyer-Meshkov instability (RMI) occurs when a shock wave passes through an interface between fluids of different densities, a phenomenon prevalent in a variety of scenarios including supersonic combustion, supernovae, and inertial confinement fusion. In the most advanced current numerical modelling of RMI, a multitude of secondary physical phenomena are typically neglected that may crucially change in silico predictions. In this study, we investigate the effects of shear-thinning behaviour of a fluid on the RMI at negative Atwood numbers via numerical simulations. A parametric study is carried out over a wide range of Atwood and Mach numbers that probes the flow dynamics following the impact on the interface of the initial shock wave and subsequent, reflected shocks. We demonstrate agreement between our numerical results and analytical predictions, which are valid during the early stages of the flow, and examine the effect of the system parameters on the vorticity distribution near the interface. We also carry out an analysis of the rate of vorticity production and dissipation budget which pinpoints the physical mechanisms leading to instability due to the initial and reflected shocks. Our findings indicate that the shear-thinning effects have a significant impact on instability growth and the development of secondary instabilities, which manifest themselves through the formation of Kelvin-Helmholtz waves. Specifically, we demonstrate that these effects influence vorticity generation and damping, which, in turn, affect the RMI growth. These insights have important implications for a range of applications, including inertial confinement fusion and bubble collapse within non-Newtonian materials.

physics.flu-dyn

A reduced kinetic method for investigating non-local ion heat transport in ideal multi-species plasmas

A reduced kinetic method (RKM) with a first-principle collision operator is introduced in a 1D2V planar geometry and implemented in a computationally inexpensive code to investigate non-local ion heat transport in multi-species plasmas. The RKM successfully reproduces local results for multi-species ion systems and the important features expected to arise due to non-local effects on the heat flux are captured. In addition to this, novel features associated with multi-species, as opposed to single species, case are found. Effects of non-locality on the heat flux are investigated in mass and charge symmetric and asymmetric ion mixtures with temperature, pressure, and concentration gradients. In particular, the enthalpy flux associated with diffusion is found to be insensitive to sharp pressure and concentration gradients, increasing its significance in comparison to the conductive heat flux driven by temperature gradients in non-local scenarios. The RKM code can be used for investigating other kinetic and non-local effects in a broader plasma physics context. Due to its relatively low computational cost it can also serve as a practical non-local ion heat flux closure in hydrodynamic simulations or as a training tool for machine learning surrogates.

physics.plasm-ph

RFC-Net: Learning High Resolution Global Features for Medical Image Segmentation on a Computational Budget

Learning High-Resolution representations is essential for semantic segmentation. Convolutional neural network (CNN)architectures with downstream and upstream propagation flow are popular for segmentation in medical diagnosis. However, due to performing spatial downsampling and upsampling in multiple stages, information loss is inexorable. On the contrary, connecting layers densely on high spatial resolution is computationally expensive. In this work, we devise a Loose Dense Connection Strategy to connect neurons in subsequent layers with reduced parameters. On top of that, using a m-way Tree structure for feature propagation we propose Receptive Field Chain Network (RFC-Net) that learns high resolution global features on a compressed computational space. Our experiments demonstrates that RFC-Net achieves state-of-the-art performance on Kvasir and CVC-ClinicDB benchmarks for Polyp segmentation.

cs.CV

Semi-supervised Contrastive Outlier removal for Pseudo Expectation Maximization (SCOPE)

Semi-supervised learning is the problem of training an accurate predictive model by combining a small labeled dataset with a presumably much larger unlabeled dataset. Many methods for semi-supervised deep learning have been developed, including pseudolabeling, consistency regularization, and contrastive learning techniques. Pseudolabeling methods however are highly susceptible to confounding, in which erroneous pseudolabels are assumed to be true labels in early iterations, thereby causing the model to reinforce its prior biases and thereby fail to generalize to strong predictive performance. We present a new approach to suppress confounding errors through a method we describe as Semi-supervised Contrastive Outlier removal for Pseudo Expectation Maximization (SCOPE). Like basic pseudolabeling, SCOPE is related to Expectation Maximization (EM), a latent variable framework which can be extended toward understanding cluster-assumption deep semi-supervised algorithms. However, unlike basic pseudolabeling which fails to adequately take into account the probability of the unlabeled samples given the model, SCOPE introduces an outlier suppression term designed to improve the behavior of EM iteration given a discrimination DNN backbone in the presence of outliers. Our results show that SCOPE greatly improves semi-supervised classification accuracy over a baseline, and furthermore when combined with consistency regularization achieves the highest reported accuracy for the semi-supervised CIFAR-10 classification task using 250 and 4000 labeled samples. Moreover, we show that SCOPE reduces the prevalence of confounding errors during pseudolabeling iterations by pruning erroneous high-confidence pseudolabeled samples that would otherwise contaminate the labeled set in subsequent retraining iterations.

cs.LG

Mitigating domain shift in AI-based tuberculosis screening with unsupervised domain adaptation

We demonstrate that Domain Invariant Feature Learning (DIFL) can improve the out-of-domain generalizability of a deep learning Tuberculosis screening algorithm. It is well known that state of the art deep learning algorithms often have difficulty generalizing to unseen data distributions due to "domain shift". In the context of medical imaging, this could lead to unintended biases such as the inability to generalize from one patient population to another. We analyze the performance of a ResNet-50 classifier for the purposes of Tuberculosis screening using the four most popular public datasets with geographically diverse sources of imagery. We show that without domain adaptation, ResNet-50 has difficulty in generalizing between imaging distributions from a number of public Tuberculosis screening datasets with imagery from geographically distributed regions. However, with the incorporation of DIFL, the out-of-domain performance is greatly enhanced. Analysis criteria includes a comparison of accuracy, sensitivity, specificity and AUC over both the baseline, as well as the DIFL enhanced algorithms. We conclude that DIFL improves generalizability of Tuberculosis screening while maintaining acceptable accuracy over the source domain imagery when applied across a variety of public datasets.

eess.IV

CCS-GAN: COVID-19 CT-scan classification with very few positive training images

We present a novel algorithm that is able to classify COVID-19 pneumonia from CT Scan slices using a very small sample of training images exhibiting COVID-19 pneumonia in tandem with a larger number of normal images. This algorithm is able to achieve high classification accuracy using as few as 10 positive training slices (from 10 positive cases), which to the best of our knowledge is one order of magnitude fewer than the next closest published work at the time of writing. Deep learning with extremely small positive training volumes is a very difficult problem and has been an important topic during the COVID-19 pandemic, because for quite some time it was difficult to obtain large volumes of COVID-19 positive images for training. Algorithms that can learn to screen for diseases using few examples are an important area of research. We present the Cycle Consistent Segmentation Generative Adversarial Network (CCS-GAN). CCS-GAN combines style transfer with pulmonary segmentation and relevant transfer learning from negative images in order to create a larger volume of synthetic positive images for the purposes of improving diagnostic classification performance. The performance of a VGG-19 classifier plus CCS-GAN was trained using a small sample of positive image slices ranging from at most 50 down to as few as 10 COVID-19 positive CT-scan images. CCS-GAN achieves high accuracy with few positive images and thereby greatly reduces the barrier of acquiring large training volumes in order to train a diagnostic classifier for COVID-19.

eess.IV

Person Re-Identification with a Locally Aware Transformer

Person Re-Identification is an important problem in computer vision-based surveillance applications, in which the same person is attempted to be identified from surveillance photographs in a variety of nearby zones. At present, the majority of Person re-ID techniques are based on Convolutional Neural Networks (CNNs), but Vision Transformers are beginning to displace pure CNNs for a variety of object recognition tasks. The primary output of a vision transformer is a global classification token, but vision transformers also yield local tokens which contain additional information about local regions of the image. Techniques to make use of these local tokens to improve classification accuracy are an active area of research. We propose a novel Locally Aware Transformer (LA-Transformer) that employs a Parts-based Convolution Baseline (PCB)-inspired strategy for aggregating globally enhanced local classification tokens into an ensemble of $\sqrt{N}$ classifiers, where $N$ is the number of patches. An additional novelty is that we incorporate blockwise fine-tuning which further improves re-ID accuracy. LA-Transformer with blockwise fine-tuning achieves rank-1 accuracy of $98.27 \%$ with standard deviation of $0.13$ on the Market-1501 and $98.7\%$ with standard deviation of $0.2$ on the CUHK03 dataset respectively, outperforming all other state-of-the-art published methods at the time of writing.

cs.CV

Toward Generating Synthetic CT Volumes using a 3D-Conditional Generative Adversarial Network

We present a novel conditional Generative Adversarial Network (cGAN) architecture that is capable of generating 3D Computed Tomography scans in voxels from noisy and/or pixelated approximations and with the potential to generate full synthetic 3D scan volumes. We believe conditional cGAN to be a tractable approach to generate 3D CT volumes, even though the problem of generating full resolution deep fakes is presently impractical due to GPU memory limitations. We present results for autoencoder, denoising, and depixelating tasks which are trained and tested on two novel COVID19 CT datasets. Our evaluation metrics, Peak Signal to Noise ratio (PSNR) range from 12.53 - 46.46 dB, and the Structural Similarity index ( SSIM) range from 0.89 to 1.

eess.IV

Deep Expectation-Maximization for Semi-Supervised Lung Cancer Screening

We present a semi-supervised algorithm for lung cancer screening in which a 3D Convolutional Neural Network (CNN) is trained using the Expectation-Maximization (EM) meta-algorithm. Semi-supervised learning allows a smaller labelled data-set to be combined with an unlabeled data-set in order to provide a larger and more diverse training sample. EM allows the algorithm to simultaneously calculate a maximum likelihood estimate of the CNN training coefficients along with the labels for the unlabeled training set which are defined as a latent variable space. We evaluate the model performance of the Semi-Supervised EM algorithm for CNNs through cross-domain training of the Kaggle Data Science Bowl 2017 (Kaggle17) data-set with the National Lung Screening Trial (NLST) data-set. Our results show that the Semi-Supervised EM algorithm greatly improves the classification accuracy of the cross-domain lung cancer screening, although results are lower than a fully supervised approach with the advantage of additional labelled data from the unsupervised sample. As such, we demonstrate that Semi-Supervised EM is a valuable technique to improve the accuracy of lung cancer screening models using 3D CNNs.

cs.LG

Generating Realistic COVID19 X-rays with a Mean Teacher + Transfer Learning GAN

COVID-19 is a novel infectious disease responsible for over 800K deaths worldwide as of August 2020. The need for rapid testing is a high priority and alternative testing strategies including X-ray image classification are a promising area of research. However, at present, public datasets for COVID19 x-ray images have low data volumes, making it challenging to develop accurate image classifiers. Several recent papers have made use of Generative Adversarial Networks (GANs) in order to increase the training data volumes. But realistic synthetic COVID19 X-rays remain challenging to generate. We present a novel Mean Teacher + Transfer GAN (MTT-GAN) that generates COVID19 chest X-ray images of high quality. In order to create a more accurate GAN, we employ transfer learning from the Kaggle Pneumonia X-Ray dataset, a highly relevant data source orders of magnitude larger than public COVID19 datasets. Furthermore, we employ the Mean Teacher algorithm as a constraint to improve stability of training. Our qualitative analysis shows that the MTT-GAN generates X-ray images that are greatly superior to a baseline GAN and visually comparable to real X-rays. Although board-certified radiologists can distinguish MTT-GAN fakes from real COVID19 X-rays. Quantitative analysis shows that MTT-GAN greatly improves the accuracy of both a binary COVID19 classifier as well as a multi-class Pneumonia classifier as compared to a baseline GAN. Our classification accuracy is favourable as compared to recently reported results in the literature for similar binary and multi-class COVID19 screening tasks.

cs.LG