arXiv subjects

Jie Tian

Publications and source records attributed to Jie Tian.

At least 19 recordsLinked to original sources

arXiv2026

Neuro-Symbolic Geometric Abstraction (NeuSOGA): From Observations to Symbolic Mathematical Representations

A fundamental challenge in artificial intelligence is the transformation of observations into explicit symbolic representations suitable for abstraction, interpretation, and reasoning. While modern AI systems achieve remarkable perceptual capabilities through large-scale statistical learning, the resulting knowledge is typically encoded within latent parameters that are difficult to inspect or manipulate analytically. Inspired by Neuro-Symbolic AI and theories of human abstraction, this paper investigates the formation of symbolic mathematical representations from geometric observations. We propose NeuSOGA (Neuro-Symbolic Geometric Abstraction), a framework that progressively transforms observations into topological abstractions, geometric abstractions, and ultimately symbolic mathematical representations. The architecture combines topology-guided structural discovery using Euclidean Distance Transforms, foundation-model perception using Segment Anything, adaptive multi-scale geometric abstraction, and symbolic synthesis through Implicit Area Splines. The resulting representation is an analytical implicit model supporting arbitrary-order smoothness, additive composition, and closed-form evaluation. Unlike neural latent encodings, the generated representation remains interpretable, editable, and mathematically explicit. Experiments on ModelNet40 point clouds, arbitrary-view projections, and segmented optical observations demonstrate that NeuSOGA transforms diverse observations into compact symbolic representations while preserving essential geometric and topological structure across sensing modalities and viewing directions. NeuSOGA provides an interpretable and explainable pathway from observation to symbol and establishes

cs.AI↗

arXiv2026

FilmBench: A Film-Grade Benchmark for Cinematic Video Generation

Progress in video generation keeps narrowing the visual gap between AI-generated and professionally produced footage, yet most benchmarks still draw prompts from web sources or LLM templates and score them with untrained, generic multimodal models. More fundamentally, their evaluation taxonomies remain rudimentary (overall visual quality, coarse text alignment and temporal smoothness) rather than the professional Cinematic Language criteria by which films are actually made and judged, so they assess basic video plausibility rather than film-grade craft. We introduce FilmBench, a text-to-video (T2V) and reference-to-video (R2V) benchmark grounded in the professional Cinematic Language of the film- academy tradition and co-developed with directors and faculty from the Beijing Film Academy and the Hujing Digital Media & Entertainment Group film studio. It rests on three choices. First, prompts are reverse-engineered from clips of award-winning films spanning 20 cinematic genres and chosen by professional directors, so every prompt is anchored to a verified live-action reference; the prompts follow real shot lists, and most script multiple shots (1,056 of the 1,169 prompts are multi-shot), unlike prior single-clip benchmarks. Second, evaluation follows a three-level Cinematic taxonomy of 3 axes, 12 components and 35 (T2V) +3 (R2V-only) sub-metrics. Third, we develop an in-house expert-grade automatic evaluation agent and open-source its core suite of Cinematic Language operators (FilmOps). Benchmarking leading video generation models (9 for T2V, 7 for R2V), the evaluator reproduces the human model ranking at model-level Spearman \r{ho} = 0.95 (T2V) and 0.96 (R2V). Scores fall well below prior web-style benchmarks, with two consistent gaps in dynamic aesthetics and a marked single- to multi-shot performance drop that widens for weaker models.

cs.CV↗

arXiv2026

Morphology of Optical Changing-Look AGN-host Galaxies: Evidence for an Important Role of Mergers

Optical changing-look active galactic nuclei (CL-AGNs) are characterized by the (dis)appearance of broad emission lines on unexpectedly short timescales. However, the underlying mechanisms and their potential connection to host-galaxy properties are still unclear. In this work, we present an analysis of the morphology for 63 low-redshift CL-AGNs (z < 0.15) selected from the largest CL-AGN catalog (Guo et al. 2025) to date, using images from DESI DR10 and employing both non-parametric methods and visual inspection. We find that CL-AGN hosts exhibit a concentration like late-type spirals, asymmetry like early-type spirals, and smoothness like ellipticals. This is confirmed by their Gini-M20 coefficients, suggesting weak/modest disturbances. Based upon our visual inspection, we further identify that 18 (29%) out of 63 sources are mergers, among which ~56% (10/18) show shell features. Compared to different non-CL-AGN samples, CL-AGN hosts have a higher (~2\times) possibility of being merging systems. Our results indicate that mergers/interactions may play an important role in driving the changing-look behavior.

astro-ph.GA↗

arXiv2026

Intuitive Surgical SurgToolLoc and SurgVU Challenges Results: 2022-2025

Robotic assisted (RA) surgery promises to transform surgical intervention. Intuitive Surgical is committed to fostering these changes and the machine learning models and algorithms that will enable them. With these goals in mind we have invited the surgical data science community to participate in a yearly competition hosted through the Medical Imaging Computing and Computer Assisted Interventions (MICCAI) conference. With varying changes from year to year, we have challenged the community to solve difficult machine learning problems in the context of advanced RA applications. Here we document the results of these challenges, focusing on surgical tool localization (SurgToolLoc) and surgical visual understanding (SurgVU). The publicly released dataset that accompanies these challenges is detailed in a separate paper arXiv:2501.09209 [1].

cs.CV↗

arXiv2026

COMMA: Coordinate-aware Modulated Mamba Network for 3D Dispersed Vessel Segmentation

Accurate segmentation of 3D vascular structures is essential for various medical imaging applications. The dispersed nature of vascular structures leads to inherent spatial uncertainty and necessitates location awareness, yet most current 3D medical segmentation models rely on the patch-wise training strategy that usually loses this spatial context. In this study, we introduce the Coordinate-aware Modulated Mamba Network (COMMA) and contribute a manually labeled dataset of 570 cases, the largest publicly available 3D vessel dataset to date. COMMA leverages both entire and cropped patch data through global and local branches, ensuring robust and efficient spatial location awareness. Specifically, COMMA employs a channel-compressed Mamba (ccMamba) block to encode entire image data, capturing long-range dependencies while optimizing computational costs. Additionally, we propose a coordinate-aware modulated (CaM) block to enhance interactions between the global and local branches, allowing the local branch to better perceive spatial information. We evaluate COMMA on six datasets, covering two imaging modalities and five types of vascular tissues. The results demonstrate COMMA's superior performance compared to state-of-the-art methods with computational efficiency, especially in segmenting small vessels. Ablation studies further highlight the importance of our proposed modules and spatial information. The code and data will be open source at https://github.com/shigen-StoneRoot/COMMA.

eess.IV↗

arXiv2026

Synergizing Discriminative Exemplars and Self-Refined Experience for MLLM-based In-Context Learning in Medical Diagnosis

General Multimodal Large Language Models (MLLMs) often underperform in capturing domain-specific nuances in medical diagnosis, trailing behind fully supervised baselines. Although fine-tuning provides a remedy, the high costs of expert annotation and massive computational overhead limit its scalability. To bridge this gap without updating the weights of the pre-trained backbone of the MLLM, we propose a Clinician Mimetic Workflow. This is a novel In-Context Learning (ICL) framework designed to synergize Discriminative Exemplar Coreset Selection (DECS) and Self-Refined Experience Summarization (SRES). Specifically, DECS simulates a clinician's ability to reference "anchor cases" by selecting discriminative visual coresets from noisy data at the computational level; meanwhile, SRES mimics the cognition and reflection in clinical diagnosis by distilling diverse rollouts into a dynamic textual Experience Bank. Extensive evaluation across all 12 datasets of the MedMNIST 2D benchmark demonstrates that our method outperforms zero-shot general and medical MLLMs. Simultaneously, it achieves performance levels comparable to fully supervised vision models and domain-specific fine-tuned MLLMs, setting a new benchmark for parameter-efficient medical in-context learning. Our code is available at an anonymous repository: https://anonymous.4open.science/r/Synergizing-Discriminative-Exemplars-and-Self-Refined-Experience-ED74.

cs.CV↗

arXiv2026

RRAT J1541+4703: A Rotating Radio Transient Exhibiting Normal Pulsar States

Rotating Radio Transients (RRATs) are a class of pulsar-like objects characterized by intermittent radio emissions. Among them, RRATs that exhibit both RRAT and normal pulsar (NP) states may represent a key evolutionary stage from nulling pulsars to RRATs. We performed a detailed analysis of RRAT J1574+4703 using the Five-hundred-meter Aperture Spherical Radio Telescope (FAST) at a frequency of 1250 MHz. Our findings indicate that this RRAT spends approximately 98% of its time in the RRAT state, with the remainder spent in an NP state exhibiting nulling behavior. Additionally, we observed distinct integral pulse profiles and polarization properties between the two states, suggesting that they originate from different emission heights and magnetospheric structures. Furthermore, it was observed that the NP states of this RRAT exhibit mode switching, with ~44% of the time spent in the normal mode and ~39% in the abnormal mode. Notably, abnormal modes are predominantly detected at the onset and termination of the NP states. This discrepancy between the modes indicates potential instability in the magnetospheric processes that govern the NP states.

astro-ph.HE↗

arXiv2026

The annular gap model under a rotating dipole field approximation: simulating gamma-ray light curve

A more realistic description of the magnetosphere is crucial for understanding the radiation emitted by pulsars. In this paper, we revisit the annular gap model by employing a rotating dipole field, which is more realistic than the static dipole field, as an approximation of the magnetic structure of the pulsar magnetosphere. Compared with the static dipole field approximation, the open field-line region, including both the core and annular gaps, is significantly enlarged, and the two regions become asymmetric with respect to the fiducial plane. We apply this model to three young gamma-ray pulsars with distinct light-curve morphologies, PSRs J0631$+$1036 (single peak), J1709$-$4429 (double peaks), and J1048$-$5832 (three peaks). Using viewing geometries constrained by radio polarization measurements, the annular gap model within the rotating dipole field successfully reproduces the main morphological features of their gamma-ray light curves above 0.1 GeV. Our model provides a framework for interpreting pulsar high-energy emission, which can be used to analyze the emission properties of high-energy pulsars.

astro-ph.HE↗

arXiv2026

PerformRecast: Expression and Head Pose Disentanglement for Portrait Video Editing

This paper primarily investigates the task of expression-only portrait video performance editing based on a driving video, which plays a crucial role in animation and film industries. Most existing research mainly focuses on portrait animation, which aims to animate a static portrait image according to the facial motion from the driving video. As a consequence, it remains challenging for them to disentangle the facial expression from head pose rotation and thus lack the ability to edit facial expression independently. In this paper, we propose PerformRecast, a versatile expression-only video editing method which is dedicated to recast the performance in existing film and animation. The key insight of our method comes from the characteristics of 3D Morphable Face Model (3DMM), which models the face identity, facial expression and head pose of 3D face mesh with separate parameters. Therefore, we improve the keypoints transformation formula in previous methods to make it more consistent with 3DMM model, which achieves a better disentanglement and provides users with much more fine-grained control. Furthermore, to avoid the misalignment around the boundary of face in generated results, we decouple the facial and non-facial regions of input portrait images and pre-train a teacher model to provide separate supervision for them. Extensive experiments show that our method produces high-quality results which are more faithful to the driving video, outperforming existing methods in both controllability and efficiency. Our code, data and trained models are available at https://youku-aigc.github.io/PerformRecast.

cs.CV↗

arXiv2026

Gaze-guided Hand-Object Interaction Synthesis: Dataset and Method

Gaze plays a crucial role in revealing human attention and intention, particularly in hand-object interaction scenarios, where it guides and synchronizes complex tasks that require precise coordination between the brain, hand, and object. Motivated by this, we introduce a novel task: Gaze-Guided Hand-Object Interaction Synthesis, with potential applications in augmented reality, virtual reality, and assistive technologies. To support this task, we present GazeHOI, the first dataset to capture simultaneous 3D modeling of gaze, hand, and object interactions. This task poses significant challenges due to the inherent sparsity and noise in gaze data, as well as the need for high consistency and physical plausibility in generating hand and object motions. To tackle these issues, we propose a stacked gaze-guided hand-object interaction diffusion model, named GHO-Diffusion. The stacked design effectively reduces the complexity of motion generation. We also introduce HOI-Manifold Guidance during the sampling stage of GHO-Diffusion, enabling fine-grained control over generated motions while maintaining the data manifold. Additionally, we propose a spatial-temporal gaze feature encoding for the diffusion condition and select diffusion results based on consistency scores between gaze-contact maps and gaze-interaction trajectories. Extensive experiments highlight the effectiveness of our method and the unique contributions of our dataset. More details in https://takiee.github.io/gaze-hoi/.

cs.CV↗

arXiv2026

Nowcast3D: Reliable precipitation nowcasting via gray-box learning

Reliable nowcasting of extreme precipitation remains difficult because convective systems are strongly nonlinear, multiscale, and nonstationary in 3D. Radar is the backbone of nowcasting, yet existing methods struggle to predict extremes: physics-based extrapolation cannot capture growth and decay, deterministic learning tends to oversmooth and underestimate peaks, and purely generative models often lack physical consistency. Hybrid schemes help but are mostly limited to 2D composite reflectivity, collapsing the atmosphere into one layer and discarding vertical structure critical for height-dependent dynamics. We introduce Nowcast3D, a gray-box, fully 3D framework that works directly on volumetric radar reflectivity. The end-to-end model couples physically constrained neural operators (advection, local diffusion, and microphysics) with a conditional diffusion model to generate ensemble forecasts with quantified uncertainty. Trained on provincial-scale 3D volumes over a $10.24^\circ \times 10.24^\circ$ region and fine-tuned on a $2.56^\circ \times 2.56^\circ$ city region ($0.01^\circ \approx 1$ km), Nowcast3D provides near-real-time forecasts up to 3 h and outperforms competitive baselines in cross-region and temporal out-of-sample tests. It can also infer wind fields without labeled supervision, supporting physically plausible transport. In a nationwide blind evaluation by 160 meteorologists, Nowcast3D ranked first and was preferred in 57% of post-hoc assessments, surpassing the leading baseline (27%). These results highlight its reliability and operational value for extreme precipitation nowcasting.

cs.LG↗

arXiv2025

Position-Prior-Guided Network for System Matrix Super-Resolution in Magnetic Particle Imaging

Magnetic Particle Imaging (MPI) is a novel medical imaging modality. One of the established methods for MPI reconstruction is based on the System Matrix (SM). However, the calibration of the SM is often time-consuming and requires repeated measurements whenever the system parameters change. Current methodologies utilize deep learning-based super-resolution (SR) techniques to expedite SM calibration; nevertheless, these strategies do not fully exploit physical prior knowledge associated with the SM, such as symmetric positional priors. Consequently, we integrated positional priors into existing frameworks for SM calibration. Underpinned by theoretical justification, we empirically validated the efficacy of incorporating positional priors through experiments involving both 2D and 3D SM SR methods.

cs.CV↗

arXiv2025

Phase-based stimulated emission depletion (pSTED) magnetic particle imaging

Magnetic particle imaging (MPI) is an in vivo method to detect magnetic nanoparticles for cell tracking, vascular imaging, and molecular target imaging without ionizing radiation. Current magnetic particle imaging is accomplished by forming an field-free line (FFL) through a gradient selection field. By translating and rotating FFL under excitation and drive fields, the harmonic complex signal of a point source forms a Lorentzian-shape point spread function on the plane perpendicular to FFL. The Lorentzian PSF has a finite size and limited resolution due to the non-sharp Langevin function and weak selection field. This study proposes a donut-shaped focal spot by borrowing the stimulated emission depletion (STED) fluorescence microscopy principle. The influence of the gradient selection field on the relaxation time of magnetic particles determines the nonlinear phase shift of the harmonic complex signals, resulting in the formation of a donut-shaped focal spot. By subtracting the donut-shaped focal spot from the Lorentzian focal spot, the STED focal spot size was reduced by up to 4 times beyond the Langevin magnetization resolution barrier. In human brain FFL-based MPI scanner, the donut-shaped focal spot can be used to reconstruct images with super-resolution and super-sensitivity through the deconvoution of the STED focal spot and filtered backprojection algorithm.

physics.med-ph↗

arXiv2025

A Morphological Study on AGN-host Dwarf Galaxies

The study of morphology in galaxies offers a convenient and quantitative method to measure the shapes and characteristics of galaxy light distribution that reflect the evolutionary history. For AGN-host dwarf galaxies, however, there is a lack of detailed studies on their morphologies. In this work, we compile a relatively large sample ($\sim$400 members) of local AGN-host dwarf ($M_{\star}\leq10^{9.5} M_{\odot}$ and $z<0.055$) galaxies selected via various methods. We use the $grz$ bands images from DESI DR10 and the Python package statmorph to measure non-parametric coefficients. We also carry out visual inspection with the assistance of deep learning to classify these galaxies into early-type (ETGs), late-type (LTGs) galaxies, and mergers, and find that about 37%, 44%, and 13% of the total sample sources are ETGs, LTGs, and mergers, respectively. In comparison to normal dwarf galaxies, AGN-host dwarfs have a higher probability to be LTGs, and a lower merger rate, indicating that mergers/interactions are not the primary driver of AGN activities. Among the subsamples selected with different methods, the BPT sample has the highest fraction of ETGs, the variability sample consists of the largest fraction of LTGs, and the mid-IR sample contains the most mergers.

astro-ph.GA↗

arXiv2025

Chinese-Vicuna: A Chinese Instruction-following Llama-based Model

Chinese-Vicuna is an open-source, resource-efficient language model designed to bridge the gap in Chinese instruction-following capabilities by fine-tuning Meta's LLaMA architecture using Low-Rank Adaptation (LoRA). Targeting low-resource environments, it enables cost-effective deployment on consumer GPUs (e.g., RTX-2080Ti for 7B models) and supports domain-specific adaptation in fields like healthcare and law. By integrating hybrid datasets (BELLE and Guanaco) and 4-bit quantization (QLoRA), the model achieves competitive performance in tasks such as translation, code generation, and domain-specific Q\&A. The project provides a comprehensive toolkit for model conversion, CPU inference, and multi-turn dialogue interfaces, emphasizing accessibility for researchers and developers. Evaluations indicate competitive performance across medical tasks, multi-turn dialogue coherence, and real-time legal updates. Chinese-Vicuna's modular design, open-source ecosystem, and community-driven enhancements position it as a versatile foundation for Chinese LLM applications.

cs.CL↗

arXiv2025

A Multi-Agent Framework Integrating Large Language Models and Generative AI for Accelerated Metamaterial Design

Metamaterials, renowned for their exceptional mechanical, electromagnetic, and thermal properties, hold transformative potential across diverse applications, yet their design remains constrained by labor-intensive trial-and-error methods and limited data interoperability. Here, we introduce CrossMatAgent -- a novel multi-agent framework that synergistically integrates large language models with state-of-the-art generative AI to revolutionize metamaterial design. By orchestrating a hierarchical team of agents -- each specializing in tasks such as pattern analysis, architectural synthesis, prompt engineering, and supervisory feedback -- our system leverages the multimodal reasoning of GPT-4o alongside the generative precision of DALL-E 3 and a fine-tuned Stable Diffusion XL model. This integrated approach automates data augmentation, enhances design fidelity, and produces simulation- and 3D printing-ready metamaterial patterns. Comprehensive evaluations, including CLIP-based alignment, SHAP interpretability analyses, and mechanical simulations under varied load conditions, demonstrate the framework's ability to generate diverse, reproducible, and application-ready designs. CrossMatAgent thus establishes a scalable, AI-driven paradigm that bridges the gap between conceptual innovation and practical realization, paving the way for accelerated metamaterial development.

cond-mat.mtrl-sci↗

arXiv2025

STPNet: Scale-aware Text Prompt Network for Medical Image Segmentation

Accurate segmentation of lesions plays a critical role in medical image analysis and diagnosis. Traditional segmentation approaches that rely solely on visual features often struggle with the inherent uncertainty in lesion distribution and size. To address these issues, we propose STPNet, a Scale-aware Text Prompt Network that leverages vision-language modeling to enhance medical image segmentation. Our approach utilizes multi-scale textual descriptions to guide lesion localization and employs retrieval-segmentation joint learning to bridge the semantic gap between visual and linguistic modalities. Crucially, STPNet retrieves relevant textual information from a specialized medical text repository during training, eliminating the need for text input during inference while retaining the benefits of cross-modal learning. We evaluate STPNet on three datasets: COVID-Xray, COVID-CT, and Kvasir-SEG. Experimental results show that our vision-language approach outperforms state-of-the-art segmentation methods, demonstrating the effectiveness of incorporating textual semantic knowledge into medical image analysis. The code has been made publicly on https://github.com/HUANGLIZI/STPNet.

eess.IV↗

arXiv2025

Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Think

Image-to-Video (I2V) generation aims to synthesize a video clip according to a given image and condition (e.g., text). The key challenge of this task lies in simultaneously generating natural motions while preserving the original appearance of the images. However, current I2V diffusion models (I2V-DMs) often produce videos with limited motion degrees or exhibit uncontrollable motion that conflicts with the textual condition. To address these limitations, we propose a novel Extrapolating and Decoupling framework, which introduces model merging techniques to the I2V domain for the first time. Specifically, our framework consists of three separate stages: (1) Starting with a base I2V-DM, we explicitly inject the textual condition into the temporal module using a lightweight, learnable adapter and fine-tune the integrated model to improve motion controllability. (2) We introduce a training-free extrapolation strategy to amplify the dynamic range of the motion, effectively reversing the fine-tuning process to enhance the motion degree significantly. (3) With the above two-stage models excelling in motion controllability and degree, we decouple the relevant parameters associated with each type of motion ability and inject them into the base I2V-DM. Since the I2V-DM handles different levels of motion controllability and dynamics at various denoising time steps, we adjust the motion-aware parameters accordingly over time. Extensive qualitative and quantitative experiments have been conducted to demonstrate the superiority of our framework over existing methods.

cs.CV↗