arXiv subjects

Jie Wang

Publications and source records attributed to Jie Wang.

At least 217 records · Page 12Linked to original sources

arXiv2025

Efficient Bilinear Attention-based Fusion for Medical Visual Question Answering

Medical Visual Question Answering (MedVQA) has attracted growing interest at the intersection of medical image understanding and natural language processing for clinical applications. By interpreting medical images and providing precise answers to relevant clinical inquiries, MedVQA has the potential to support diagnostic decision-making and reduce workload across various fields like radiology. While recent approaches rely heavily on unified large pre-trained Visual-Language Models, research on more efficient fusion mechanisms remains relatively limited in this domain. In this paper, we introduce a fusion model, OMniBAN, that integrates Orthogonality loss, Multi-head attention, and a Bilinear Attention Network to achieve high computational efficiency as well as solid performance. We conduct comprehensive experiments and demonstrate how bilinear attention fusion can approximate the performance of larger fusion models like cross-modal Transformer. Our results show that OMniBAN requires fewer parameters (approximately 2/3 of Transformer-based Co-Attention) and substantially lower FLOPs (approximately 1/4), while achieving comparable overall performance and even slight improvements on closed-ended questions on two key MedVQA benchmarks. This balance between efficiency and accuracy suggests that OMniBAN could be a viable option for real-world medical image question answering, where computational resources are often constrained.

eess.IV↗

arXiv2025

CXR-AD: Component X-ray Image Dataset for Industrial Anomaly Detection

Internal defect detection constitutes a critical process in ensuring component quality, for which anomaly detection serves as an effective solution. However, existing anomaly detection datasets predominantly focus on surface defects in visible-light images, lacking publicly available X-ray datasets targeting internal defects in components. To address this gap, we construct the first publicly accessible component X-ray anomaly detection (CXR-AD) dataset, comprising real-world X-ray images. The dataset covers five industrial component categories, including 653 normal samples and 561 defect samples with precise pixel-level mask annotations. We systematically analyze the dataset characteristics and identify three major technical challenges: (1) strong coupling between complex internal structures and defect regions, (2) inherent low contrast and high noise interference in X-ray imaging, and (3) significant variations in defect scales and morphologies. To evaluate dataset complexity, we benchmark three state-of-the-art anomaly detection frameworks (feature-based, reconstruction-based, and zero-shot learning methods). Experimental results demonstrate a 29.78% average performance degradation on CXR-AD compared to MVTec AD, highlighting the limitations of current algorithms in handling internal defect detection tasks. To the best of our knowledge, CXR-AD represents the first publicly available X-ray dataset for component anomaly detection, providing a real-world industrial benchmark to advance algorithm development and enhance precision in internal defect inspection technologies.

cs.CV↗

arXiv2025

Solving Low-Rank Semidefinite Programs via Manifold Optimization

We propose a manifold optimization approach to solve linear semidefinite programs (SDP) with low-rank solutions, with an emphasis on SDP relaxations for polynomial optimization problems. This approach incorporates the inexact augmented Lagrangian method (ALM) and the Burer-Monteiro factorization, and features the self-adaptive strategies for updating the factorization size and the penalty parameter. We establish global convergence of the inexact ALM, despite the non-convexity brought by the Burer-Monteiro factorization. We further provide a practical algorithm building on the inexact ALM, and along with the algorithm we release an open-source SDP solver ManiSDP. Comprehensive numerical experiments demonstrate that ManiSDP achieves state-of-the-art in terms of efficiency, accuracy, and scalability, and is faster than several advanced SDP solvers (MOSEK, SDPLR, SDPNAL+, STRIDE) by up to orders of magnitudes on a variety of linear SDPs. The largest SDP solved by ManiSDP (in about 8.5 hours with maximal KKT residue 3.5e-13) is the second-order moment relaxation of a binary quadratic program with 120 variables, which has matrix dimension 7261 and contains 17,869,161 affine constraints.

math.OC↗

arXiv2025

SONC Optimization and Exact Nonnegativity Certificates via Second-Order Cone Programming

The second-order cone (SOC) is a class of simple convex cones and optimizing over them can be done more efficiently than with semidefinite programming. It is interesting both in theory and in practice to investigate which convex cones admit a representation using SOCs, given that they have a strong expressive ability. In this paper, we prove constructively that the cone of sums of nonnegative circuits (SONC) admits a SOC representation. Based on this, we give a new algorithm for unconstrained polynomial optimization via SOC programming. We also provide a hybrid numeric-symbolic scheme which combines the numerical procedure with a rounding-projection algorithm to obtain exact nonnegativity certificates. Numerical experiments demonstrate the efficiency of our algorithm for polynomials with fairly large degree and number of variables.

math.OC↗

arXiv2025

Exploiting Sparsity in Complex Polynomial Optimization

In this paper, we study the sparsity-adapted complex moment-Hermitian sum of squares (moment-HSOS) hierarchy for complex polynomial optimization problems, where the sparsity includes correlative sparsity and term sparsity. We compare the strengths of the sparsity-adapted complex moment-HSOS hierarchy with the sparsity-adapted real moment-SOS hierarchy on either randomly generated complex polynomial optimization problems or the AC optimal power flow problem. The results of numerical experiments show that the sparsity-adapted complex moment-HSOS hierarchy provides a trade-off between the computational cost and the quality of obtained bounds for large-scale complex polynomial optimization problems.

math.OC↗

arXiv2025

Mechanistic Modeling of Lipid Nanoparticle Formation for the Delivery of Nucleic Acid Therapeutics

Nucleic acids such as mRNA have emerged as a promising therapeutic modality with the capability of addressing a wide range of diseases. Lipid nanoparticles (LNPs) as a delivery platform for nucleic acids were used in the COVID-19 vaccines and have received much attention. While modern manufacturing processes which involve rapidly mixing an organic stream containing the lipids with an aqueous stream containing the nucleic acids are conceptually straightforward, detailed understanding of LNP formation and structure is still limited and scale-up can be challenging. Mathematical and computational methods are a promising avenue for deepening scientific understanding of the LNP formation process and facilitating improved process development and control. This article describes strategies for the mechanistic modeling of LNP formation, starting with strategies to estimate and predict important physicochemical properties of the various species such as diffusivities and solubilities. Subsequently, a framework is outlined for constructing mechanistic models of reactor- and particle-scale processes. Insights gained from the various models are mapped back to product quality attributes and process insights. Lastly, the use of the models to guide development of advanced process control and optimization strategies is discussed.

cond-mat.soft↗

arXiv2025

Observation of Double Hysteresis in CoFe$_2$O$_4$/MnFe$_2$O$_4$ Core/Shell Nanoparticles and Its Contribution to AC Heat Induction

Magnetic core/shell nanoparticles are promising candidates for magnetic hyperthermia due to its high AC magnetic heat induction (specific loss power (SLP)). It's widely accepted that magnetic exchange-coupling between core and shell plays the crucial role in enhancing SLP of magnetic core/shell nanoparticles. However, the physical contribution of exchange coupling to SLP has not been systematically investigated, and the underlying mechanism remains unclear. In this study, magnetic hard/soft CoFe$_2$O$_4$/MnFe$_2$O$_4 and inverted soft/hard MnFe$_2$O$_4$/CoFe$_2$O$_4$ core/shell nanoparticles were synthesized, systematically varying the number of shell layers, to investigate the physical contribution of internal bias coupling at the core/shell interface to AC heat induction (SLP). Our results show that a unique magnetic property, double-hysteresis loop, was present and clearly observed, which was never reported in previous core/shell research literature. According to the experimentally and theoretically analyzed results, the double-hysteresis behavior in core/shell nanoparticles was caused by the difference in magnetic anisotropy between core and shell materials, separated by a non-magnetic interface. The enhanced SLP and maximum temperature rise (TAC,max) of core/shell nanoparticles are attributed to the optimized magnetic anisotropy, AC magnetic softness and double hysteresis behavior due to the internal bias coupling. These results demonstrate that the rational design capabilities to separately control the magnetic anisotropy, AC/DC magnetic properties by varying the volume ration between core and shell and by switching hard or soft phase materials between core and shell are effective modalities to enhance the AC heat induction of core/shell nanoparticles for magnetic nanoparticle hyperthermia.

cond-mat.mtrl-sci↗

arXiv2025

A comprehensive review of remote sensing in wetland classification and mapping

Wetlands constitute critical ecosystems that support both biodiversity and human well-being; however, they have experienced a significant decline since the 20th century. Back in the 1970s, researchers began to employ remote sensing technologies for wetland classification and mapping to elucidate the extent and variations of wetlands. Although some review articles summarized the development of this field, there is a lack of a thorough and in-depth understanding of wetland classification and mapping: (1) the scientific importance of wetlands, (2) major data, methods used in wetland classification and mapping, (3) driving factors of wetland changes, (4) current research paradigm and limitations, (5) challenges and opportunities in wetland classification and mapping under the context of technological innovation and global environmental change. In this review, we aim to provide a comprehensive perspective and new insights into wetland classification and mapping for readers to answer these questions. First, we conduct a meta-analysis of over 1,200 papers, encompassing wetland types, methods, sensor types, and study sites, examining prevailing trends in wetland classification and mapping. Next, we review and synthesize the wetland features and existing data and methods in wetland classification and mapping. We also summarize typical wetland mapping products and explore the intrinsic driving factors of wetland changes across multiple spatial and temporal scales. Finally, we discuss current limitations and propose future directions in response to global environmental change and technological innovation. This review consolidates our understanding of wetland remote sensing and offers scientific recommendations that foster transformative progress in wetland science.

cs.CV↗

arXiv2025

Visual Consensus Prompting for Co-Salient Object Detection

Existing co-salient object detection (CoSOD) methods generally employ a three-stage architecture (i.e., encoding, consensus extraction & dispersion, and prediction) along with a typical full fine-tuning paradigm. Although they yield certain benefits, they exhibit two notable limitations: 1) This architecture relies on encoded features to facilitate consensus extraction, but the meticulously extracted consensus does not provide timely guidance to the encoding stage. 2) This paradigm involves globally updating all parameters of the model, which is parameter-inefficient and hinders the effective representation of knowledge within the foundation model for this task. Therefore, in this paper, we propose an interaction-effective and parameter-efficient concise architecture for the CoSOD task, addressing two key limitations. It introduces, for the first time, a parameter-efficient prompt tuning paradigm and seamlessly embeds consensus into the prompts to formulate task-specific Visual Consensus Prompts (VCP). Our VCP aims to induce the frozen foundation model to perform better on CoSOD tasks by formulating task-specific visual consensus prompts with minimized tunable parameters. Concretely, the primary insight of the purposeful Consensus Prompt Generator (CPG) is to enforce limited tunable parameters to focus on co-salient representations and generate consensus prompts. The formulated Consensus Prompt Disperser (CPD) leverages consensus prompts to form task-specific visual consensus prompts, thereby arousing the powerful potential of pre-trained models in addressing CoSOD tasks. Extensive experiments demonstrate that our concise VCP outperforms 13 cutting-edge full fine-tuning models, achieving the new state of the art (with 6.8% improvement in F_m metrics on the most challenging CoCA dataset). Source code has been available at https://github.com/WJ-CV/VCP.

cs.CV↗

arXiv2025

Bootstrapping the Quantum Hall problem

The bootstrap method aims to solve problems by imposing constraints on the space of physical observables, which often follow from physical assumptions such as positivity and symmetry. Here, we employ a bootstrap approach to study interacting electrons in the lowest Landau level by minimizing the energy as a function of the static structure factor subject to a set of constraints, bypassing the need to construct the full many-body wavefunction. This approach rigorously lower bounds the ground state energy, making it complementary to conventional variational upper bounds. We show that the lower bound we obtain is relatively tight, within at most 5\% from the ground state energy computed with exact diagonalization (ED) at small system sizes, and generally gets tighter as we include more constraints. In addition to energetics, our results reproduce the correct power law dependence of the pair correlation function at short distances and the existence of a large entanglement gap in the two-particle entanglement spectra for the Laughlin states at $ν= 1/3$. We further identify signatures of the composite Fermi liquid state close to half-filling. This shows that the bootstrap approach is capable, in principle, of describing non-trivial gapped topologically ordered, as well as gapless, phases. At the end, we will discuss possible extensions and limitations of this approach. Our work establishes numerical bootstrap as a promising method to study many-body phases in topological bands, paving the way to its application in moiré platforms where the energetic competition between fractional quantum anomalous Hall, symmetry broken, and gapless states remains poorly understood.

cond-mat.str-el↗

arXiv2025

Flow Intelligence: Robust Feature Matching via Temporal Signature Correlation

Feature matching across video streams remains a cornerstone challenge in computer vision. Increasingly, robust multimodal matching has garnered interest in robotics, surveillance, remote sensing, and medical imaging. While traditional rely on detecting and matching spatial features, they break down when faced with noisy, misaligned, or cross-modal data. Recent deep learning methods have improved robustness through learned representations, but remain constrained by their dependence on extensive training data and computational demands. We present Flow Intelligence, a paradigm-shifting approach that moves beyond spatial features by focusing on temporal motion patterns exclusively. Instead of detecting traditional keypoints, our method extracts motion signatures from pixel blocks across consecutive frames and extract temporal motion signatures between videos. These motion-based descriptors achieve natural invariance to translation, rotation, and scale variations while remaining robust across different imaging modalities. This novel approach also requires no pretraining data, eliminates the need for spatial feature detection, enables cross-modal matching using only temporal motion, and it outperforms existing methods in challenging scenarios where traditional approaches fail. By leveraging motion rather than appearance, Flow Intelligence enables robust, real-time video feature matching in diverse environments.

cs.CV↗

arXiv2025

GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation

Constructing vivid 3D head avatars for given subjects and realizing a series of animations on them is valuable yet challenging. This paper presents GaussianHead, which models the actional human head with anisotropic 3D Gaussians. In our framework, a motion deformation field and multi-resolution tri-plane are constructed respectively to deal with the head's dynamic geometry and complex texture. Notably, we impose an exclusive derivation scheme on each Gaussian, which generates its multiple doppelgangers through a set of learnable parameters for position transformation. With this design, we can compactly and accurately encode the appearance information of Gaussians, even those fitting the head's particular components with sophisticated structures. In addition, an inherited derivation strategy for newly added Gaussians is adopted to facilitate training acceleration. Extensive experiments show that our method can produce high-fidelity renderings, outperforming state-of-the-art approaches in reconstruction, cross-identity reenactment, and novel view synthesis tasks. Our code is available at: https://github.com/chiehwangs/gaussian-head.

cs.CV↗

arXiv2025

Commutators with multiple unitary symmetry

Commutators are essential in quantum information theory, influencing quantum state symmetries and information storage robustness. This paper systematically investigates the characteristics of bipartite and multipartite quantum states invariant under local unitary group actions. The results demonstrate that any quantum states commuting with $U \otimes U^{\dagger}$ and $U \otimes V$ can be expressed as $\frac{1}{n}I_n$, where $U$ and $V$ are arbitary $n\times n$ unitary matrices. Furthermore, in tripartite systems, any quantum states commuting with $U \otimes U \otimes U^{\dagger}$ must necessarily adopt the form: $W = xI_{n^3} + y\left(\sum_{i,j=1}^n (|i\rangle \langle j|) \otimes (|j\rangle \langle i|)\right) \otimes I_n$, where $F_n$ represents the canonical swap operator. These results provide theoretical tools for characterizing multipartite entanglement constraints and designing symmetry-protected quantum protocols.

quant-ph↗

arXiv2025

An in silico approach to analyse the influence of carotid haemodynamics on cardiovascular events using 3D tomographic ultrasound and computational fluid dynamics

Analysing the haemodynamics of flow in carotid artery disease serves as a means to better understand the development and progression of associated complex diseases. Carotid artery disease can predispose people to major adverse cardiovascular events. Understanding the nature of carotid blood flow using in silico methods enables the extraction of relevant metrics that are not accessible in vivo. This study develops computationally efficient means of modelling patient-specific flow, utilising 3D tomographic ultrasound to generate anatomically faithful reconstructions including artherosclerotic plaque, and computational fluid dynamics to simulate flow in these arteries. A computationally efficient model has been proposed here, which has been used to conduct simulations for a large dataset, the results of which where stastitically analysed to test the association of relevant haemodynamic metrics with cardiovascular events. The incidence of major cardiovascular diseases in carotid artery disease patients has been shown to have an association with flow vorticity in the region of interest, and less so with the absolute magnitudes of wall shear stress.

physics.med-ph↗

arXiv2025

PvNeXt: Rethinking Network Design and Temporal Motion for Point Cloud Video Recognition

Point cloud video perception has become an essential task for the realm of 3D vision. Current 4D representation learning techniques typically engage in iterative processing coupled with dense query operations. Although effective in capturing temporal features, this approach leads to substantial computational redundancy. In this work, we propose a framework, named as PvNeXt, for effective yet efficient point cloud video recognition, via personalized one-shot query operation. Specially, PvNeXt consists of two key modules, the Motion Imitator and the Single-Step Motion Encoder. The former module, the Motion Imitator, is designed to capture the temporal dynamics inherent in sequences of point clouds, thus generating the virtual motion corresponding to each frame. The Single-Step Motion Encoder performs a one-step query operation, associating point cloud of each frame with its corresponding virtual motion frame, thereby extracting motion cues from point cloud sequences and capturing temporal dynamics across the entire sequence. Through the integration of these two modules, {PvNeXt} enables personalized one-shot queries for each frame, effectively eliminating the need for frame-specific looping and intensive query processes. Extensive experiments on multiple benchmarks demonstrate the effectiveness of our method.

cs.CV↗

arXiv2025

Can DeepSeek Reason Like a Surgeon? An Empirical Evaluation for Vision-Language Understanding in Robotic-Assisted Surgery

The DeepSeek models have shown exceptional performance in general scene understanding, question-answering (QA), and text generation tasks, owing to their efficient training paradigm and strong reasoning capabilities. In this study, we investigate the dialogue capabilities of the DeepSeek model in robotic surgery scenarios, focusing on tasks such as Single Phrase QA, Visual QA, and Detailed Description. The Single Phrase QA tasks further include sub-tasks such as surgical instrument recognition, action understanding, and spatial position analysis. We conduct extensive evaluations using publicly available datasets, including EndoVis18 and CholecT50, along with their corresponding dialogue data. Our empirical study shows that, compared to existing general-purpose multimodal large language models, DeepSeek-VL2 performs better on complex understanding tasks in surgical scenes. Additionally, although DeepSeek-V3 is purely a language model, we find that when image tokens are directly inputted, the model demonstrates better performance on single-sentence QA tasks. However, overall, the DeepSeek models still fall short of meeting the clinical requirements for understanding surgical scenes. Under general prompts, DeepSeek models lack the ability to effectively analyze global surgical concepts and fail to provide detailed insights into surgical scenarios. Based on our observations, we argue that the DeepSeek models are not ready for vision-language tasks in surgical contexts without fine-tuning on surgery-specific datasets.

cs.CV↗

arXiv2025

The mass accretion history of dark matter haloes down to Earth mass

We take advantage of the unprecedented dynamical range provided by the "Cosmic-Zoom" project to study the mass accretion history (MAH) of present-day dark matter haloes over the entire mass range present in the $Λ$CDM paradigm when the dark matter is made of weakly interacting massive particles of mass $100\ \mathrm{GeV}$. In particular, we complement previous studies by exploring the MAHs of haloes with mass from $10^8\ h^{-1}\mathrm{M_{\odot}}$ down to Earth mass, $10^{-6}\ h^{-1}\mathrm{M_{\odot}}$. The formation redshift of low-mass haloes anti-correlates weakly with mass, peaking at $z=3$ for haloes of mass $10^{-4}\ h^{-1}\mathrm{M_{\odot}}$. Even lower masses are affected by the free-streaming cutoff in the primordial spectrum of density fluctuations and form at lower redshift. We compare MAHs in our simulations with predictions from two analytical models based on the extended Press-Schechter theory (EPS), and three empirical models derived by fitting and extrapolating either results from cosmological $N$-body simulations or Monte Carlo realizations of halo growth. All models fit our simulations reasonably well over the mass range for which they were calibrated. While the empirical models match better for more massive haloes, $M>10^{10}\ h^{-1}\mathrm{M_{\odot}}$, the analytical models do better when extrapolated down to Earth mass. At the higher masses, we explore the correlation between local environment density and MAH, finding that biases are relatively weak, with typical MAHs for haloes in extremely low-density and in typical regions differing by less than $20$ percent at high redshift. If this result can be extrapolated to lower halo masses, we conclude that EPS theory predicts the hierarchical build-up of dark matter haloes quite well over the entire halo mass range.

astro-ph.GA↗

arXiv2025

A widely applicable Galaxy Group finder Using Machine Learning

Galaxy groups are essential for studying the distribution of matter on a large scale in redshift surveys and for deciphering the link between galaxy traits and their associated halos. In this work, we propose a widely applicable method for identifying groups through machine learning techniques in real space taking into account the impact of redshift distortion. Our methodology involves two neural networks: one is a classification model for identifying central galaxy groups, and the other is a regression model for predicting the mass of these groups. Both models input observable galaxy traits, allowing future applicability to real survey data. Testing on simulated datasets indicates our method accurately identifies over $92\%$ of groups with $\mathrm{M}_{vir} \geq 10^{11}h^{-1}\mathrm{M}_\odot$, with $80\%$ achieving a membership completeness of at least $80\%$. The predicted group masses vary by less than 0.3 dex across different mass scales, even in the absence of a priori data. Our network adapts seamlessly to expand to sparse samples with a flux limit of $m_{r} < 14$, to high redshift samples at $z=1.08$, and to galaxy samples from the TNG300 hydrodynamical simulation without further training. Furthermore, the framework can easily adjust to real surveys by training on redshift distorted samples without needing parameter changes. Careful consideration of different observational effects in redshift space makes it promising that this method will be applicable to real galaxy surveys.

astro-ph.CO↗