SearcharxivSearch

arXiv subjects

Shuwen Sun

Publications and source records attributed to Shuwen Sun.

13 recordsLinked to original sources

Surrogate modeling for convection-dominated parametric problems based on error learning

Convection-dominated problems are known for their slow Kolmogorov $n$-width decays and are challenging for model order reduction (MOR). In this work, we propose a hybrid surrogate modeling approach and a non-intrusive variant that overcome some drawbacks of linear MOR methods. The proposed hybrid surrogate model is a projection-based reduced-order model (ROM), corrected by the error learned from a deep neural network. With the aid of deep learning, the model component of the surrogate model can be kept in a small reduced dimension. The neural network component and the model component are sequentially but separately built during the offline stage. At the online stage, they are easily coupled to output the solution predictions. Due to the intrusive nature of the hybrid-ROM, the numerically discretized operators of the original model must be available. For problems solved using black-box solvers, where the details of the numerical discretization are not accessible, we further propose a non-intrusive variant of the hybrid surrogate. Compared to the existing MOR methods with nonlinear manifolds, the proposed hybrid ROM is more easily built and is also easily assembled for online prediction. In contrast to the surrogate modeling approaches purely based on deep-learning, the proposed non-intrusive variant has a lighter neural network structure with much fewer parameters to be learned. We test the proposed methods on two nonlinear convection parametric problems. The first is the 1D inviscid Burgers' equation with one parameter, and the second is the 2D inviscid Burgers' equation with two parameters. Since both methods are based on error correction, their online predictions exhibit higher accuracy yet with largely reduced prediction time, compared to state-of-the-art methods.

math.DS

Optimized Fabrication Procedure for High-Quality Graphene-based Moir\'e Superlattice Devices

Moir\'e superlattices constitute a versatile platform to investigate emergent phenomena arising from the interplay of strong correlations and topology, while offering flexible in situ tunability. However, the fabrication of such moir\'e superlattices is challenging. It is difficult to achieve highly uniform devices with a precise twist angle because of the unintentional introduction of heterostrain, twist angle disorder, and angle/lattice relaxation during the nanofabrication process. This article introduces an optimized, experience-informed protocol for fabricating high-quality graphene-based moir\'e superlattice devices, focusing on a modified dry transfer technique. The transfer process is performed in a highly tunable, custom-built transfer setup that enables precise position, angle, and temperature control. By combining rigorous flake selection criteria, pre-cleaned bubble-free bottom gates, and graphene laser ablation, the moir\'e superlattice is constructed by deliberately overlaying twisted graphene flakes at a submicron speed at room temperature. Through precise control of the transfer process, the resulting graphene moir\'e superlattice devices exhibit high uniformity and desired twist angles. This optimized protocol addresses existing challenges in the fabrication of graphene-based moir\'e superlattice devices and paves the way for further advances in the rapidly evolving field of moir\'e materials.

cond-mat.mes-hall

Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning

Providing effective treatment and making informed clinical decisions are essential goals of modern medicine and clinical care. We are interested in simulating disease dynamics for clinical decision-making, leveraging recent advances in large generative models. To this end, we introduce the Medical World Model (MeWM), the first world model in medicine that visually predicts future disease states based on clinical decisions. MeWM comprises (i) vision-language models to serve as policy models, and (ii) tumor generative models as dynamics models. The policy model generates action plans, such as clinical treatments, while the dynamics model simulates tumor progression or regression under given treatment conditions. Building on this, we propose the inverse dynamics model that applies survival analysis to the simulated post-treatment tumor, enabling the evaluation of treatment efficacy and the selection of the optimal clinical action plan. As a result, the proposed MeWM simulates disease dynamics by synthesizing post-treatment tumors, with state-of-the-art specificity in Turing tests evaluated by radiologists. Simultaneously, its inverse dynamics model outperforms medical-specialized GPTs in optimizing individualized treatment protocols across all metrics. Notably, MeWM improves clinical decision-making for interventional physicians, boosting F1-score in selecting the optimal TACE protocol by 13%, paving the way for future integration of medical world models as the second readers.

cs.CV

Spatially-Enhanced Temporal Fusion Transformer: Interpretable Multi-Output Prediction for Parametric Dynamical Systems with Time-Varying Inputs

We explore the promising performance of a transformer model in predicting outputs of parametric dynamical systems with external time-varying input signals. The outputs of such systems vary not only with physical parameters but also with external time-varying input signals. Accurately catching the dynamics of such systems is challenging. We have adapted and extended an existing transformer model, called temporal fusion transformer (TFT), for single-output prediction to a multiple-output transformer, named as Spatially-Enhanced Temporal Fusion Transformer (SE-TFT), which is able to predict multiple output responses of these systems. The SE-TFT generalizes the interpretability of the original TFT model. The generalized interpretable attention weight matrix explores not only the temporal correlations in the sequence, but also the interactions between the multiple outputs, providing explanation for the spatial correlation in the output domain. This proposed SE-TFT accurately predicts the sequence of multiple outputs, regardless of the nonlinearity of the system and the dimensionality of the parameter space.

cs.LG

Simultaneous transport and tunneling spectroscopy of moir\'e graphene: Distinct observation of the superconducting gap and signatures of nodal superconductivity

Understanding the nature of superconductivity in magic-angle graphene remains challenging. A key difficulty lies in discerning the different energy scales in this strongly interacting system, particularly the superconducting gap. Here, we report the first simultaneous tunneling spectroscopy and transport measurements of magic-angle graphene, providing a novel approach to probe the superconducting state. This approach allows us to identify two coexisting V-shaped tunneling gaps with different energy scales: a distinct low-energy superconducting gap that vanishes at the superconducting critical temperature and magnetic field, and a higher-energy pseudogap. The superconducting tunneling spectra display a linear gap-filling behavior with temperature and magnetic field and exhibit the Volovik effect, consistent with a nodal order parameter. Our work reveals the unconventional nature of the superconducting gap in magic-angle graphene and establishes an experimental framework for multidimensional investigation of tunable quantum materials.

cond-mat.supr-con

Data-Augmented Predictive Deep Neural Network: Enhancing the extrapolation capabilities of non-intrusive surrogate models

Numerically solving a large parametric nonlinear dynamical system is challenging due to its high complexity and the high computational costs. In recent years, machine-learning-aided surrogates are being actively researched. However, many methods fail in accurately generalizing in the entire time interval $[0, T]$, when the training data is available only in a training time interval $[0, T_0]$, with $T_0<T$. To improve the extrapolation capabilities of the surrogate models in the entire time domain, we propose a new deep learning framework, where kernel dynamic mode decomposition (KDMD) is employed to evolve the dynamics of the latent space generated by the encoder part of a convolutional autoencoder (CAE). After adding the KDMD-decoder-extrapolated data into the original data set, we train the CAE along with a feed-forward deep neural network using the augmented data. The trained network can predict future states outside the training time interval at any out-of-training parameter samples. The proposed method is tested on two numerical examples: a FitzHugh-Nagumo model and a model of incompressible flow past a cylinder. Numerical results show accurate and fast prediction performance in both the time and the parameter domain.

cs.LG

Early Detection and Localization of Pancreatic Cancer by Label-Free Tumor Synthesis

Early detection and localization of pancreatic cancer can increase the 5-year survival rate for patients from 8.5% to 20%. Artificial intelligence (AI) can potentially assist radiologists in detecting pancreatic tumors at an early stage. Training AI models require a vast number of annotated examples, but the availability of CT scans obtaining early-stage tumors is constrained. This is because early-stage tumors may not cause any symptoms, which can delay detection, and the tumors are relatively small and may be almost invisible to human eyes on CT scans. To address this issue, we develop a tumor synthesis method that can synthesize enormous examples of small pancreatic tumors in the healthy pancreas without the need for manual annotation. Our experiments demonstrate that the overall detection rate of pancreatic tumors, measured by Sensitivity and Specificity, achieved by AI trained on synthetic tumors is comparable to that of real tumors. More importantly, our method shows a much higher detection rate for small tumors. We further investigate the per-voxel segmentation performance of pancreatic tumors if AI is trained on a combination of CT scans with synthetic tumors and CT scans with annotated large tumors at an advanced stage. Finally, we show that synthetic tumors improve AI generalizability in tumor detection and localization when processing CT scans from different hospitals. Overall, our proposed tumor synthesis method has immense potential to improve the early detection of pancreatic cancer, leading to better patient outcomes.

eess.IV

Parametric Dynamic Mode Decomposition for nonlinear parametric dynamical systems

A non-intrusive model order reduction (MOR) method that combines features of the dynamic mode decomposition (DMD) and the radial basis function (RBF) network is proposed to predict the dynamics of parametric nonlinear systems. In many applications, we have limited access to the information of the whole system, which motivates non-intrusive model reduction. One bottleneck is capturing the dynamics of the solution without knowing the physics inside the "black-box" system. DMD is a powerful tool to mimic the dynamics of the system and give a reliable approximation of the solution in the time domain using only the dominant DMD modes. However, DMD cannot reproduce the parametric behavior of the dynamics. Our contribution focuses on extending DMD to parametric DMD by RBF interpolation. Specifically, a RBF network is first trained using snapshot matrices at limited parameter samples. The snapshot matrix at any new parameter sample can be quickly learned from the RBF network. DMD will use the newly generated snapshot matrix at the online stage to predict the time patterns of the dynamics corresponding to the new parameter sample. The proposed framework and algorithm are tested and validated by numerical examples including models with parametrized and time-varying inputs.

math.NA

Label-Free Liver Tumor Segmentation

We demonstrate that AI models can accurately segment liver tumors without the need for manual annotation by using synthetic tumors in CT scans. Our synthetic tumors have two intriguing advantages: (I) realistic in shape and texture, which even medical professionals can confuse with real tumors; (II) effective for training AI models, which can perform liver tumor segmentation similarly to the model trained on real tumors -- this result is exciting because no existing work, using synthetic tumors only, has thus far reached a similar or even close performance to real tumors. This result also implies that manual efforts for annotating tumors voxel by voxel (which took years to create) can be significantly reduced in the future. Moreover, our synthetic tumors can automatically generate many examples of small (or even tiny) synthetic tumors and have the potential to improve the success rate of detecting small liver tumors, which is critical for detecting the early stages of cancer. In addition to enriching the training data, our synthesizing strategy also enables us to rigorously assess the AI robustness.

eess.IV

Synthetic Tumors Make AI Segment Tumors Better

We develop a novel strategy to generate synthetic tumors. Unlike existing works, the tumors generated by our strategy have two intriguing advantages: (1) realistic in shape and texture, which even medical professionals can confuse with real tumors; (2) effective for AI model training, which can perform liver tumor segmentation similarly to a model trained on real tumors - this result is unprecedented because no existing work, using synthetic tumors only, has thus far reached a similar or even close performance to the model trained on real tumors. This result also implies that manual efforts for developing per-voxel annotation of tumors (which took years to create) can be considerably reduced for training AI models in the future. Moreover, our synthetic tumors have the potential to improve the success rate of small tumor detection by automatically generating enormous examples of small (or tiny) synthetic tumors.

eess.IV

Magic-Angle Multilayer Graphene: A Robust Family of Moiré Superconductors

The discovery of correlated states and superconductivity in magic-angle twisted bilayer graphene (MATBG) has established moiré quantum matter as a new platform to explore interaction-driven and topological quantum phenomena. Multitudes of phases have been realized in moiré systems, but surprisingly, robust superconductivity has been one of the least common of all, initially found in MATBG and only more recently also in magic-angle twisted trilayer graphene (MATTG). While MATBG and MATTG share some similar characteristics, they also exhibit substantial differences, such as in their response to external electric and magnetic fields. This raises the question of whether they are simply two separate unique systems, or whether they form part of a broader family of superconducting materials. Here, we report the experimental realization of magic-angle twisted 4-layer and 5-layer graphene (MAT4G and MAT5G, respectively), which turn out to be superconductors, hence establishing alternating-twist magic-angle multilayer graphene as a robust family of moiré superconductors. The members of this family have flat bands in their electronic structure as a common feature, suggesting their central role in the observed robust superconductivity. On the other hand, there are also important variations across the family, such as different symmetries for members with even and odd number of layers. However, our measurements in parallel magnetic fields, in particular the investigation of Pauli limit violation and spontaneous rotational symmetry breaking, reveal that the most pronounced distinction is between the N=2 and N>2-layer structures. Our results expand the emergent family of moiré superconductors, providing new insight with potential implications for the design of novel superconducting materials platforms.

cond-mat.supr-con

Sequential Learning on Liver Tumor Boundary Semantics and Prognostic Biomarker Mining

The boundary of tumors (hepatocellular carcinoma, or HCC) contains rich semantics: capsular invasion, visibility, smoothness, folding and protuberance, etc. Capsular invasion on tumor boundary has proven to be clinically correlated with the prognostic indicator, microvascular invasion (MVI). Investigating tumor boundary semantics has tremendous clinical values. In this paper, we propose the first and novel computational framework that disentangles the task into two components: spatial vertex localization and sequential semantic classification. (1) A HCC tumor segmentor is built for tumor mask boundary extraction, followed by polar transform representing the boundary with radius and angle. Vertex generator is used to produce fixed-length boundary vertices where vertex features are sampled on the corresponding spatial locations. (2) The sampled deep vertex features with positional embedding are mapped into a sequential space and decoded by a multilayer perceptron (MLP) for semantic classification. Extensive experiments on tumor capsule semantics demonstrate the effectiveness of our framework. Mining the correlation between the boundary semantics and MVI status proves the feasibility to integrate this boundary semantics as a valid HCC prognostic biomarker.

cs.CV

Chiral topological superconducting state with Chern number $\mathcal{C} =-2$ in Pb$_3$Bi/Ge(111)

Materials realization of chiral topological superconductivity is a crucial condition for observing and manipulating Majorana fermions in condensed matter physics. Here we develop a tight-binding description of Pb$_3$Bi/Ge(111), identified recently as an appealing candidate system for realizing chiral $p$-wave topological superconductivity [Nat. Phys. 15, 796 (2019)]. We first show that our phenomenological model can capture the two main features of the electronic band structures obtained from first-principles calculations, namely, the giant Rashba splitting and type-II van Hove singularity. Next, when the $s$-wave superconducting property of the parent Pb system is explicitly considered, we find the alloyed system can be tuned into a chiral topological superconductor with Chern number $\mathcal{C} = -2$, resulting from the synergistic effect of a sufficiently strong Zeeman field and the inherently large Rashba spin-orbit coupling. The nontrivial topology with $\mathcal{C} = -2$ is further shown to be detectable as two chiral Majorana edge modes propagating along the same direction of the system with proper boundaries. We finally discuss the physically realistic conditions to establish the predicted topological superconductivity and observe the corresponding Majorana edge modes, including the influence of the superconducting gap, Landé $g$-factor, and critical magnetic field. The present study provides useful guides in searching for effective $p$-wave superconductivity and Majorana fermions in two-dimensional or related interfacial systems.

cond-mat.supr-con