Searcharxiv⌕ Search

arXiv subjects

Jie Xiao

Publications and source records attributed to Jie Xiao.

At least 73 records · Page 4Linked to original sources

Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration

While diffusion models demonstrate strong generative capabilities in image restoration (IR) tasks, their complex architectures and iterative processes limit their practical application compared to mainstream reconstruction-based general ordinary IR networks. Existing approaches primarily focus on optimizing network architecture and diffusion paths but overlook the integration of the diffusion training paradigm within general ordinary IR frameworks. To address these challenges, this paper elucidates key principles for adapting the diffusion training paradigm to general IR training through systematic analysis of time-step dependencies, network hierarchies, noise-level relationships, and multi-restoration task correlations, proposing a new IR framework supported by diffusion-based training. To enable IR networks to simultaneously restore images and model generative representations, we introduce a series of regularization strategies that align diffusion objectives with IR tasks, improving generalization in single-task scenarios. Furthermore, recognizing that diffusion-based generation exerts varying influences across different IR tasks, we develop an incremental training paradigm and task-specific adaptors, further enhancing performance in multi-task unified IR. Experiments demonstrate that our method significantly improves the generalization of IR networks in single-task IR and achieves superior performance in multi-task unified IR. Notably, the proposed framework can be seamlessly integrated into existing general IR architectures.

cs.CV↗

NTIRE 2025 Image Shadow Removal Challenge Report

This work examines the findings of the NTIRE 2025 Shadow Removal Challenge. A total of 306 participants have registered, with 17 teams successfully submitting their solutions during the final evaluation phase. Following the last two editions, this challenge had two evaluation tracks: one focusing on reconstruction fidelity and the other on visual perception through a user study. Both tracks were evaluated with images from the WSRD+ dataset, simulating interactions between self- and cast-shadows with a large number of diverse objects, textures, and materials.

cs.CV↗

GHz spiking neuromorphic photonic chip with in-situ training

Neuromorphic photonic computing represents a paradigm shift for next-generation machine intelligence, yet critical gaps persist in emulating the brain's event-driven, asynchronous dynamics,a fundamental barrier to unlocking its full potential. Here, we report a milestone advancement of a photonic spiking neural network (PSNN) chip, the first to achieve full-stack brain-inspired computing on a complementary metal oxide semiconductor-compatible silicon platform. The PSNN features transformative innovations of gigahertz-scale nonlinear spiking dynamics,in situ learning capacity with supervised synaptic plasticity, and informative event representations with retina-inspired spike encoding, resolving the long-standing challenges in spatiotemporal data integration and energy-efficient dynamic processing. By leveraging its frame-free, event-driven working manner,the neuromorphic optoelectronic system achieves 80% accuracy on the KTH video recognition dataset while operating at ~100x faster processing speeds than conventional frame-based approaches. This work represents a leap for neuromorphic computing in a scalable photonic platform with low latency and high throughput, paving the way for advanced applications in real-time dynamic vision processing and adaptive decision-making, such as autonomous vehicles and robotic navigation.

physics.optics↗

Notes on Chevalley Groups and Root Category I

Based on the construction of simple Lie algebras via root category and following Chevalley's results, we construct Chevalley groups from the root category. Then we prove the Bruhat decomposition and the simplicity of the Chevalley groups, and calculate the orders of finite Chevalley groups.

math.RT↗

FreePCA: Integrating Consistency Information across Long-short Frames in Training-free Long Video Generation via Principal Component Analysis

Long video generation involves generating extended videos using models trained on short videos, suffering from distribution shifts due to varying frame counts. It necessitates the use of local information from the original short frames to enhance visual and motion quality, and global information from the entire long frames to ensure appearance consistency. Existing training-free methods struggle to effectively integrate the benefits of both, as appearance and motion in videos are closely coupled, leading to motion inconsistency and visual quality. In this paper, we reveal that global and local information can be precisely decoupled into consistent appearance and motion intensity information by applying Principal Component Analysis (PCA), allowing for refined complementary integration of global consistency and local quality. With this insight, we propose FreePCA, a training-free long video generation paradigm based on PCA that simultaneously achieves high consistency and quality. Concretely, we decouple consistent appearance and motion intensity features by measuring cosine similarity in the principal component space. Critically, we progressively integrate these features to preserve original quality and ensure smooth transitions, while further enhancing consistency by reusing the mean statistics of the initial noise. Experiments demonstrate that FreePCA can be applied to various video diffusion models without requiring training, leading to substantial improvements. Code is available at https://github.com/JosephTiTan/FreePCA.

cs.CV↗

BACON: Improving Clarity of Image Captions via Bag-of-Concept Graphs

Advancements in large Vision-Language Models have brought precise, accurate image captioning, vital for advancing multi-modal image understanding and processing. Yet these captions often carry lengthy, intertwined contexts that are difficult to parse and frequently overlook essential cues, posing a great barrier for models like GroundingDINO and SDXL, which lack the strong text encoding and syntax analysis needed to fully leverage dense captions. To address this, we propose BACON, a prompting method that breaks down VLM-generated captions into disentangled, structured elements such as objects, relationships, styles, and themes. This approach not only minimizes confusion from handling complex contexts but also allows for efficient transfer into a JSON dictionary, enabling models without linguistic processing capabilities to easily access key information. We annotated 100,000 image-caption pairs using BACON with GPT-4V and trained an LLaVA captioner on this dataset, enabling it to produce BACON-style captions without relying on costly GPT-4V. Evaluations of overall quality, precision, and recall-as well as user studies-demonstrate that the resulting caption model consistently outperforms other SOTA VLM models in generating high-quality captions. Besides, we show that BACON-style captions exhibit better clarity when applied to various models, enabling them to accomplish previously unattainable tasks or surpass existing SOTA solutions without training. For example, BACON-style captions help GroundingDINO achieve 1.51x higher recall scores on open-vocabulary object detection tasks compared to leading methods.

cs.CV↗

Lusztig sheaves and integrable highest weight modules

We consider the localization $\mathcal{Q}_{\mathbf{V},\mathbf{W}}/\mathcal{N}_{\mathbf{V}}$ of Lusztig's sheaves for framed quivers, and define functors $E^{(n)}_{i},F^{(n)}_{i},K^{\pm}_{i},n\in \mathbb{N},i \in I$ between the localizations. With these functors, the Grothendieck group of localizations realizes the irreducible integrable highest weight modules $L(Λ)$ of quantum groups. Moreover, the nonzero simple perverse sheaves in localizations form the canonical bases of $L(Λ)$. We also compare our realization (at $v \rightarrow 1$) with Nakajima's realization via quiver varieties and prove that the transition matrix between canonical bases and fundamental classes is upper triangular with diagonal entries all equal to $\pm 1$.

math.RT↗

Essential $p$-capacity-volume estimates for rotationally symmetric manifolds

Given $p\in [1,\infty]$, this article presents the novel basic volumetric estimates for the relative $p$-capacities with their applications to finding not only the sharp weak $(p,q)$-imbeddings but also the precise lower bounds of the principal $p$-frequencies, which principally live in the rotationally symmetric manifolds.

math.DG↗

Berezinskii-Kosterlitz-Thouless region and magnetization plateaus in easy-axis triangular weak-dimer antiferromagnet K$_2$Co$_2$(SeO$_3$)$_3$

We investigate the magnetic phase diagram of the bilayer triangular antiferromagnet K$_2$Co$_2$(SeO$_3$)$_3$, revealing a rich interplay among geometric frustration, bilayer coupling, and symmetry-driven phenomena. High-field magnetization measurements show fractional magnetization plateaus at 1/3, 1/2, 2/3, and 5/6 of the saturation magnetization. To elucidate the experimental magnetic phase diagram at low fields, we propose that K$_2$Co$_2$(SeO$_3$)$_3$ can be described as an easy-axis triangular weak-dimer antiferromagnet. We emphasize the critical role of the emergent $U(1) \otimes S_3$ symmetry, where $S_3 = \mathbb{Z}_3 \otimes \mathbb{Z}_2^d$, in determining the magnetic phases at low fields. The remarkable agreement between the experimental and theoretical phase diagrams suggests that the phase transitions are governed by this symmetry. Notably, our combined experimental and theoretical results identify a Berezinskii-Kosterlitz-Thouless (BKT) phase region at finite fields. These findings provide new insights into the phase structure of frustrated magnets and establish K$_2$Co$_2$(SeO$_3$)$_3$ as a compelling platform for exploring unconventional quantum phenomena in $U(1) \otimes S_3$ systems.

cond-mat.str-el↗

MangaNinja: Line Art Colorization with Precise Reference Following

Derived from diffusion models, MangaNinjia specializes in the task of reference-guided line art colorization. We incorporate two thoughtful designs to ensure precise character detail transcription, including a patch shuffling module to facilitate correspondence learning between the reference color image and the target line art, and a point-driven control scheme to enable fine-grained color matching. Experiments on a self-collected benchmark demonstrate the superiority of our model over current solutions in terms of precise colorization. We further showcase the potential of the proposed interactive point control in handling challenging cases, cross-character colorization, multi-reference harmonization, beyond the reach of existing algorithms.

cs.CV↗

The Matrix: Infinite-Horizon World Generation with Real-Time Moving Control

We present The Matrix, the first foundational realistic world simulator capable of generating continuous 720p high-fidelity real-scene video streams with real-time, responsive control in both first- and third-person perspectives, enabling immersive exploration of richly dynamic environments. Trained on limited supervised data from AAA games like Forza Horizon 5 and Cyberpunk 2077, complemented by large-scale unsupervised footage from real-world settings like Tokyo streets, The Matrix allows users to traverse diverse terrains -- deserts, grasslands, water bodies, and urban landscapes -- in continuous, uncut hour-long sequences. Operating at 16 FPS, the system supports real-time interactivity and demonstrates zero-shot generalization, translating virtual game environments to real-world contexts where collecting continuous movement data is often infeasible. For example, The Matrix can simulate a BMW X3 driving through an office setting--an environment present in neither gaming data nor real-world sources. This approach showcases the potential of AAA game data to advance robust world models, bridging the gap between simulations and real-world applications in scenarios with limited data.

cs.AI↗

Lie algebras arising from two-periodic projective complex and derived categories

Let $A$ be a finite-dimensional $\mathbb{C}$-algebra of finite global dimension and $\mathcal{A}$ be the category of finitely generated right $A$-modules. By using of the category of two-periodic projective complexes $\mathcal{C}_2(\mathcal{P})$, we construct the motivic Bridgeland's Hall algebra for $\mathcal{A}$, where structure constants are given by Poincaré polynomials in $t$, then construct a $\mathbb{C}$-Lie subalgebra $\mathfrak{g}=\mathfrak{n}\oplus \mathfrak{h}$ at $t=-1$, where $\mathfrak{n}$ is constructed by stack functions about indecomposable radical complexes, and $\mathfrak{h}$ is by contractible complexes. For the stable category $\mathcal{K}_2(\mathcal{P})$ of $\mathcal{C}_2(\mathcal{P})$, we construct its moduli spaces and a $\mathbb{C}$-Lie algebra $\tilde{\mathfrak{g}}=\tilde{\mathfrak{n}}\oplus \tilde{\mathfrak{h}}$, where $\tilde{\mathfrak{n}}$ is constructed by support-indecomposable constructible functions, and $\tilde{\mathfrak{h}}$ is by the Grothendieck group of $\mathcal{K}_2(\mathcal{P})$. We prove that the natural functor $\mathcal{C}_2(\mathcal{P})\rightarrow \mathcal{K}_2(\mathcal{P})$ together with the natural isomorphism between Grothendieck groups of $\mathcal{A}$ and $\mathcal{K}_2(\mathcal{P})$ induces a Lie algebra isomorphism $\mathfrak{g}\cong\tilde{\mathfrak{g}}$. This makes clear that the structure constants at $t=-1$ provided by Bridgeland in [5] in terms of exact structure of $\mathcal{C}_2(\mathcal{P})$ precisely equal to that given in [30] in terms of triangulated category structure of $\mathcal{K}_2(\mathcal{P})$.

math.RT↗

Current Views on Mechanisms of the FLASH Effect in Cancer Radiotherapy

FLASH radiotherapy (FLASH-RT) is a new modality of radiotherapy by delivering doses with ultra-high dose rates. FLASH-RT has the ability to suppress tumor growth while sparing normal tissues, known as the FLASH effect. Although FLASH effect has proved valid in various models by different ionizing radiations, the exact underlying mechanism is still unclear. This article summarizes mainstream hypotheses of FLASH effect at physicochemical and biological levels, including oxygen depletion and free radical reactions, nuclear and mitochondria damage, as well as immune response. These hypotheses contribute reasonable explanations to the FLASH effect, and are interconnected according to the chronological order of the organism's response to ionizing radiation. By collating the existing consensus, evidence, and hypotheses, this article provides a comprehensive overview of potential mechanisms of FLASH effect and practical guidance for future investigation in the field of FLASH-RT.

physics.med-ph↗

Enabling Patient-side Disease Prediction via the Integration of Patient Narratives

Disease prediction holds considerable significance in modern healthcare, because of its crucial role in facilitating early intervention and implementing effective prevention measures. However, most recent disease prediction approaches heavily rely on laboratory test outcomes (e.g., blood tests and medical imaging from X-rays). Gaining access to such data for precise disease prediction is often a complex task from the standpoint of a patient and is always only available post-patient consultation. To make disease prediction available from patient-side, we propose Personalized Medical Disease Prediction (PoMP), which predicts diseases using patient health narratives including textual descriptions and demographic information. By applying PoMP, patients can gain a clearer comprehension of their conditions, empowering them to directly seek appropriate medical specialists and thereby reducing the time spent navigating healthcare communication to locate suitable doctors. We conducted extensive experiments using real-world data from Haodf to showcase the effectiveness of PoMP.

cs.CL↗

InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior

3D Gaussians have recently emerged as an efficient representation for novel view synthesis. This work studies its editability with a particular focus on the inpainting task, which aims to supplement an incomplete set of 3D Gaussians with additional points for visually harmonious rendering. Compared to 2D inpainting, the crux of inpainting 3D Gaussians is to figure out the rendering-relevant properties of the introduced points, whose optimization largely benefits from their initial 3D positions. To this end, we propose to guide the point initialization with an image-conditioned depth completion model, which learns to directly restore the depth map based on the observed image. Such a design allows our model to fill in depth values at an aligned scale with the original depth, and also to harness strong generalizability from largescale diffusion prior. Thanks to the more accurate depth completion, our approach, dubbed InFusion, surpasses existing alternatives with sufficiently better fidelity and efficiency under various complex scenarios. We further demonstrate the effectiveness of InFusion with several practical applications, such as inpainting with user-specific texture or with novel object insertion.

cs.CV↗

Tame quivers and affine bases II: nonsimply-laced cases

In [Tame_quivers_and_affine_bases_I], we give a Ringel-Hall algebra approach to the canonical bases in the symmetric affine cases. In this paper, we extend the results to general symmetrizable affine cases by using Ringel-Hall algebras of representations of a valued quiver. We obtain a bar-invariant basis $\mathbf{B}'=\{C(\mathbf{c},t_λ)|(\mathbf{c},t_λ)\in\mathcal{G}^a\}$ in the generic composition algebra $\mathcal{C}^*$ and prove that $\mathcal{B}'=\mathbf{B}'\sqcup(-\mathbf{B}')$ coincides with Lusztig's signed canonical basis $\mathcal{B}$. Moreover, in type $\tilde{B}_n,\tilde{C}_n$, $\mathbf{B}'$ is the canonical basis $\mathbf{B}$.

math.RT↗

Motivic cluster multiplication formulas in 2-Calabi-Yau categories

We introduce a notion of motivic cluster characters via virtual Poincaré polynomials, and prove a motivic version of multiplication formulas obtained by Chen-Xiao-Xu for weighted quantum cluster characters associated to a 2-Calabi-Yau triangulated category $\mathcal{C}$ with a cluster tilting object. Furthermore, a refined form of this formula is also given. When $\mathcal{C}$ is the cluster category of an acyclic quiver, our certain refined multiplication formula is a motivic version of the multiplication formula in [International Mathematics Research Notices, rnad172(2023)].

math.RT↗