arXiv subjects

Fengyu Sun

Publications and source records attributed to Fengyu Sun.

At least 19 recordsLinked to original sources

arXiv2026

Generation of Isolated Collimated Polarized $\gamma$-ray Beams via Spatiotemporal Optical Vortex Modulation

Attosecond, collimated, bright, polarized $\gamma$-ray sources are in high demand across nuclear physics, astrophysics, and high-energy physics. However, realizing attosecond duration, high collimation, high brilliance, and high polarization simultaneously within a single isolated source remains an outstanding challenge, owing to the inherent trade-offs between beam trapping and radiative dynamics. Here, we propose a novel scheme to generate an isolated, collimated, high-brilliance, polarized attosecond $\gamma$-ray beam from conventional solid foils irradiated by a linearly polarized spatiotemporal optical vortex (STOV) laser pulse accessible in Lab. Three-dimensional spin-resolved particle-in-cell simulations reveal that this relativistic-intensity STOV pulse can trap and accelerate electrons at its spatiotemporal singularity, producing a compact isolated electron bunch. This electron bunch subsequently undergoes head-on collision with the reflected laser pulse, which generates isolated $\gamma$-ray beams through nonlinear Compton scattering. With a peak intensity of $7\times10^{21}$ W/cm$^2$, we observe an isolated collimated ($\sim1.5^{\circ}$) $\gamma$-ray beam with an average linear polarization of $>60\%$ and a duration of $\sim$500 attoseconds. This approach is feasible with current or upcoming laser facilities and robust against variations in laser and target parameters, highlighting the capability of spatiotemporal structured light field modulation to address outstanding problems in plasma physics.

physics.plasm-ph↗

arXiv2026

Generation of dense relativistic electron beams via vortex laser-driven self-generated magnetic pinching

In multi-petawatt laser plasma accelerators, achieving high-density relativistic electron beams is typically accompanied by large transverse divergence, limiting the attainable effective electron density needed for high-flux interaction regimes relevant to laboratory astrophysics. Here we report experimental demonstration of self-generated magnetic pinching (SMP), a collective mechanism that actively regulates transverse beam dynamics using a Laguerre-Gaussian laser at strong relativistic intensity (~8 x 10^19 W/cm^2) interacting with an underdense plasma. The electron beam evolves from a two-lobe high-charge injection structure into a compressed, high-density profile, yielding a threefold reduction in divergence and nearly an order-of-magnitude enhancement in effective beam density compared with a Gaussian driver. Particle-in-cell simulations agree with the experimental observations and reveal that a self-generated azimuthal magnetic field governs the electron dynamics within the SMP regime, which is defined by the forming condition S = 0.717 l a0 [ne(10^18 cm^-3)]^-3/4 = 1, where l, a0, and ne are topological charge, laser amplitude, and plasma density, respectively. A transient kick from a dense inner sheath electron population drives collective magnetic pinching, transforming an initially separated electron distribution into a compressed and well-collimated beam. For higher-power laser systems, the forming condition can be extended to higher plasma densities and larger orbital angular momentum modes, potentially enabling electron beams with charges exceeding several nC and effective densities above 10^19 cm^-3. This mechanism provides a route to overcoming transverse expansion and enhancing rare interaction processes relevant to high-flux particle sources.

physics.plasm-ph↗

arXiv2025

Generation of ultra-intense spatiotemporal optical vortex

Spatiotemporal optical vortex (STOV) with transverse orbital angular momentum (TOAM) can induce some novel properties in high energy density physics. However, the current STOV pulse energy is limited to the mJ level, which greatly hinders the development of the research field of relativistic laser-matter interaction. Combined with the large-scale grating pair in high-peak-power laser facility, the method for generating of STOV with ultra-high intensity up to 1021 W/cm2 is proposed. The numerical simulation proves that the wave packet with 60 fs duration and 83 J energy can be generated in the far field, maintaining an integral spatiotemporal vortex construction. Finally, STOVs with 1.1 mJ single pulse energy were obtained in a proof-of-principle experiment, and characterized by a home-made measuring device.

physics.optics↗

arXiv2025

GLASS: Global-Local Aggregation for Inference-time Sparsification of LLMs

Inference-time sparsification is a promising path to deploy large language models (LLMs) on resource-constrained devices, yet existing training-free methods typically estimate feedforward network (FFN) neuron importance from the input prompt alone. We show this prompt-only signal is often unreliable, especially for short prompts and long-form decoding, leading to inaccurate masks and degraded generation fidelity. We propose GLASS, a plug-and-play, training-free framework that stabilizes dynamic FFN pruning by aggregating two complementary views of neuron criticality: local prompt-specific activations and a global model-intrinsic prior. GLASS fuses global and local signals via rank aggregation, yielding robust critical-neuron selection even when the prompt is short. We interpret GLASS as the maximum-a-posteriori consensus ranking under a permutation-based probabilistic model, providing a principled foundation for its weighted rank-aggregation rule. We apply GLASS to a diverse set of open-source LLMs, and show that it yields substantial improvements over prior training-free baselines in the challenging short-prompt, long-generation scenarios, achieving up to 45.10% lower perplexity and 25.73% lower KL divergence, while delivering significant on-device decoding speedup.

cs.LG↗

arXiv2025

Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metric

AI-driven video generation techniques have made significant progress in recent years. However, AI-generated videos (AGVs) involving human activities often exhibit substantial visual and semantic distortions, hindering the practical application of video generation technologies in real-world scenarios. To address this challenge, we conduct a pioneering study on human activity AGV quality assessment, focusing on visual quality evaluation and the identification of semantic distortions. First, we construct the AI-Generated Human activity Video Quality Assessment (Human-AGVQA) dataset, consisting of 6,000 AGVs derived from 15 popular text-to-video (T2V) models using 400 text prompts that describe diverse human activities. We conduct a subjective study to evaluate the human appearance quality, action continuity quality, and overall video quality of AGVs, and identify semantic issues of human body parts. Based on Human-AGVQA, we benchmark the performance of T2V models and analyze their strengths and weaknesses in generating different categories of human activities. Second, we develop an objective evaluation metric, named AI-Generated Human activity Video Quality metric (GHVQ), to automatically analyze the quality of human activity AGVs. GHVQ systematically extracts human-focused quality features, AI-generated content-aware quality features, and temporal continuity features, making it a comprehensive and explainable quality metric for human activity AGVs. The extensive experimental results show that GHVQ outperforms existing quality metrics on the Human-AGVQA dataset by a large margin, demonstrating its efficacy in assessing the quality of human activity AGVs. The Human-AGVQA dataset and GHVQ metric will be released at https://github.com/zczhang-sjtu/GHVQ.git.

cs.CV↗

arXiv2025

The Fourth Monocular Depth Estimation Challenge

This paper presents the results of the fourth edition of the Monocular Depth Estimation Challenge (MDEC), which focuses on zero-shot generalization to the SYNS-Patches benchmark, a dataset featuring challenging environments in both natural and indoor settings. In this edition, we revised the evaluation protocol to use least-squares alignment with two degrees of freedom to support disparity and affine-invariant predictions. We also revised the baselines and included popular off-the-shelf methods: Depth Anything v2 and Marigold. The challenge received a total of 24 submissions that outperformed the baselines on the test set; 10 of these included a report describing their approach, with most leading methods relying on affine-invariant predictions. The challenge winners improved the 3D F-Score over the previous edition's best result, raising it from 22.58% to 23.05%.

cs.CV↗

arXiv2025

FRAP: Faithful and Realistic Text-to-Image Generation with Adaptive Prompt Weighting

Text-to-image (T2I) diffusion models have demonstrated impressive capabilities in generating high-quality images given a text prompt. However, ensuring the prompt-image alignment remains a considerable challenge, i.e., generating images that faithfully align with the prompt's semantics. Recent works attempt to improve the faithfulness by optimizing the latent code, which potentially could cause the latent code to go out-of-distribution and thus produce unrealistic images. In this paper, we propose FRAP, a simple, yet effective approach based on adaptively adjusting the per-token prompt weights to improve prompt-image alignment and authenticity of the generated images. We design an online algorithm to adaptively update each token's weight coefficient, which is achieved by minimizing a unified objective function that encourages object presence and the binding of object-modifier pairs. Through extensive evaluations, we show FRAP generates images with significantly higher prompt-image alignment to prompts from complex datasets, while having a lower average latency compared to recent latent code optimization methods, e.g., 4 seconds faster than D&B on the COCO-Subject dataset. Furthermore, through visual comparisons and evaluation of the CLIP-IQA-Real metric, we show that FRAP not only improves prompt-image alignment but also generates more authentic images with realistic appearances. We also explore combining FRAP with prompt rewriting LLM to recover their degraded prompt-image alignment, where we observe improvements in both prompt-image alignment and image quality. We release the code at the following link: https://github.com/LiyaoJiang1998/FRAP/.

cs.CV↗

arXiv2025

PixelMan: Consistent Object Editing with Diffusion Models via Pixel Manipulation and Generation

Recent research explores the potential of Diffusion Models (DMs) for consistent object editing, which aims to modify object position, size, and composition, etc., while preserving the consistency of objects and background without changing their texture and attributes. Current inference-time methods often rely on DDIM inversion, which inherently compromises efficiency and the achievable consistency of edited images. Recent methods also utilize energy guidance which iteratively updates the predicted noise and can drive the latents away from the original image, resulting in distortions. In this paper, we propose PixelMan, an inversion-free and training-free method for achieving consistent object editing via Pixel Manipulation and generation, where we directly create a duplicate copy of the source object at target location in the pixel space, and introduce an efficient sampling approach to iteratively harmonize the manipulated object into the target location and inpaint its original location, while ensuring image consistency by anchoring the edited image to be generated to the pixel-manipulated image as well as by introducing various consistency-preserving optimization techniques during inference. Experimental evaluations based on benchmark datasets as well as extensive visual comparisons show that in as few as 16 inference steps, PixelMan outperforms a range of state-of-the-art training-based and training-free methods (usually requiring 50 steps) on multiple consistent object editing tasks.

cs.CV↗

arXiv2025

Enhanced Proton Acceleration via Petawatt Laguerre-Gaussian Lasers

High-energy, high-flux collimated proton beams with high repetition rates are critical for applications such as proton therapy, proton radiography, high-energy-density matter generation, and compact particle accelerators. However, achieving proton beam collimation has typically relied on complex and expensive target fabrication or precise control of auxiliary laser pulses, which poses significant limitations for high-repetition applications. Here, we demonstrate an all-optical method for collimated proton acceleration using a single femtosecond Laguerre-Gaussian (LG) laser with an intensity exceeding 1020 W/cm2 irradiating a simple planar target. Compared to conventional Gaussian laser-driven schemes, the maximum proton energy is enhanced by 60% (reaching 35 MeV) and beam divergence is much reduced. Particle-in-cell simulations reveal that a plasma jet is initially focused by the hollow electric sheath field of the LG laser, and then electrons in the jet are further collimated by self-generated magnetic fields. This process amplifies the charge-separation electric field between electrons and ions, leading to increased proton energy in the longitudinal direction and improved collimation in the transverse direction. This single-LG-laser-driven collimation mechanism offers a promising pathway for high-repetition, high-quality proton beam generation, with broad potential applications including proton therapy and fast ignition in inertial confinement fusion.

physics.plasm-ph↗

arXiv2024

Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Model

In recent years, artificial intelligence (AI)-driven video generation has gained significant attention. Consequently, there is a growing need for accurate video quality assessment (VQA) metrics to evaluate the perceptual quality of AI-generated content (AIGC) videos and optimize video generation models. However, assessing the quality of AIGC videos remains a significant challenge because these videos often exhibit highly complex distortions, such as unnatural actions and irrational objects. To address this challenge, we systematically investigate the AIGC-VQA problem, considering both subjective and objective quality assessment perspectives. For the subjective perspective, we construct the Large-scale Generated Video Quality assessment (LGVQ) dataset, consisting of 2,808 AIGC videos generated by 6 video generation models using 468 carefully curated text prompts. We evaluate the perceptual quality of AIGC videos from three critical dimensions: spatial quality, temporal quality, and text-video alignment. For the objective perspective, we establish a benchmark for evaluating existing quality assessment metrics on the LGVQ dataset. Our findings show that current metrics perform poorly on this dataset, highlighting a gap in effective evaluation tools. To bridge this gap, we propose the Unify Generated Video Quality assessment (UGVQ) model, designed to accurately evaluate the multi-dimensional quality of AIGC videos. The UGVQ model integrates the visual and motion features of videos with the textual features of their corresponding prompts, forming a unified quality-aware feature representation tailored to AIGC videos. Experimental results demonstrate that UGVQ achieves state-of-the-art performance on the LGVQ dataset across all three quality dimensions. Both the LGVQ dataset and the UGVQ model are publicly available on https://github.com/zczhang-sjtu/UGVQ.git.

cs.CV↗

arXiv2024

FunEditor: Achieving Complex Image Edits via Function Aggregation with Diffusion Models

Diffusion models have demonstrated outstanding performance in generative tasks, making them ideal candidates for image editing. Recent studies highlight their ability to apply desired edits effectively by following textual instructions, yet with two key challenges remaining. First, these models struggle to apply multiple edits simultaneously, resulting in computational inefficiencies due to their reliance on sequential processing. Second, relying on textual prompts to determine the editing region can lead to unintended alterations to the image. We introduce FunEditor, an efficient diffusion model designed to learn atomic editing functions and perform complex edits by aggregating simpler functions. This approach enables complex editing tasks, such as object movement, by aggregating multiple functions and applying them simultaneously to specific areas. Our experiments demonstrate that FunEditor significantly outperforms recent inference-time optimization methods and fine-tuned models, either quantitatively across various metrics or through visual comparisons or both, on complex tasks like object movement and object pasting. In the meantime, with only 4 steps of inference, FunEditor achieves 5-24x inference speedups over existing popular methods. The code is available at: mhmdsmdi.github.io/funeditor/.

cs.CV↗

arXiv2024

Isolated Attosecond $γ$-Ray Pulse Generation with Transverse Orbital Angular Momentum Using Intense Spatiotemporal Optical Vortex Lasers

An isolated attosecond vortex $γ$-ray pulse is generated by using a relativistic spatiotemporal optical vortex (STOV) laser in particle-in-cell simulations. A $\sim$ 300-attosecond electron slice with transverse orbital angular momentum (TOAM) is initially selected and accelerated by the central spatiotemporal singularity of the STOV laser. This slice then collides with the laser's reflected Gaussian-like front from a planar target, initiating nonlinear Compton scattering and resulting in an isolated, attosecond ($\sim$ 300 as), highly collimated ($\sim$ 4$\degree$), ultra-brilliant ($\sim 5\times 10^{24}$ photons/s/mm$^2$/mrad$^2$/0.1\%BW at 1 MeV) $γ$-ray pulse. This STOV-driven approach overcomes the significant beam divergence and complex two-laser requirements of prior Gaussian-based methods while introducting TOAM to the attosecond $γ$-ray pulse, which opens avenues for ultrafast imaging, nuclear excitation, and detection applications.

physics.plasm-ph↗

arXiv2024

LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models

The explosive growth of videos on streaming media platforms has underscored the urgent need for effective video quality assessment (VQA) algorithms to monitor and perceptually optimize the quality of streaming videos. However, VQA remains an extremely challenging task due to the diverse video content and the complex spatial and temporal distortions, thus necessitating more advanced methods to address these issues. Nowadays, large multimodal models (LMMs), such as GPT-4V, have exhibited strong capabilities for various visual understanding tasks, motivating us to leverage the powerful multimodal representation ability of LMMs to solve the VQA task. Therefore, we propose the first Large Multi-Modal Video Quality Assessment (LMM-VQA) model, which introduces a novel spatiotemporal visual modeling strategy for quality-aware feature extraction. Specifically, we first reformulate the quality regression problem into a question and answering (Q&A) task and construct Q&A prompts for VQA instruction tuning. Then, we design a spatiotemporal vision encoder to extract spatial and temporal features to represent the quality characteristics of videos, which are subsequently mapped into the language space by the spatiotemporal projector for modality alignment. Finally, the aligned visual tokens and the quality-inquired text tokens are aggregated as inputs for the large language model (LLM) to generate the quality score and level. Extensive experiments demonstrate that LMM-VQA achieves state-of-the-art performance across five VQA benchmarks, exhibiting an average improvement of $5\%$ in generalization ability over existing methods. Furthermore, due to the advanced design of the spatiotemporal encoder and projector, LMM-VQA also performs exceptionally well on general video understanding tasks, further validating its effectiveness. Our code will be released at https://github.com/Sueqk/LMM-VQA.

cs.CV↗

arXiv2024

CascadedGaze: Efficiency in Global Context Extraction for Image Restoration

Image restoration tasks traditionally rely on convolutional neural networks. However, given the local nature of the convolutional operator, they struggle to capture global information. The promise of attention mechanisms in Transformers is to circumvent this problem, but it comes at the cost of intensive computational overhead. Many recent studies in image restoration have focused on solving the challenge of balancing performance and computational cost via Transformer variants. In this paper, we present CascadedGaze Network (CGNet), an encoder-decoder architecture that employs Global Context Extractor (GCE), a novel and efficient way to capture global information for image restoration. The GCE module leverages small kernels across convolutional layers to learn global dependencies, without requiring self-attention. Extensive experimental results show that our computationally efficient approach performs competitively to a range of state-of-the-art methods on synthetic image denoising and single image deblurring tasks, and pushes the performance boundary further on the real image denoising task.

eess.IV↗

arXiv2024

Building Optimal Neural Architectures using Interpretable Knowledge

Neural Architecture Search is a costly practice. The fact that a search space can span a vast number of design choices with each architecture evaluation taking nontrivial overhead makes it hard for an algorithm to sufficiently explore candidate networks. In this paper, we propose AutoBuild, a scheme which learns to align the latent embeddings of operations and architecture modules with the ground-truth performance of the architectures they appear in. By doing so, AutoBuild is capable of assigning interpretable importance scores to architecture modules, such as individual operation features and larger macro operation sequences such that high-performance neural networks can be constructed without any need for search. Through experiments performed on state-of-the-art image classification, segmentation, and Stable Diffusion models, we show that by mining a relatively small set of evaluated architectures, AutoBuild can learn to build high-quality architectures directly or help to reduce search space to focus on relevant areas, finding better architectures that outperform both the original labeled ones and ones found by search baselines. Code available at https://github.com/Ascend-Research/AutoBuild

cs.CV↗

arXiv2024

Exploring the Naturalness of AI-Generated Images

The proliferation of Artificial Intelligence-Generated Images (AGIs) has greatly expanded the Image Naturalness Assessment (INA) problem. Different from early definitions that mainly focus on tone-mapped images with limited distortions (e.g., exposure, contrast, and color reproduction), INA on AI-generated images is especially challenging as it has more diverse contents and could be affected by factors from multiple perspectives, including low-level technical distortions and high-level rationality distortions. In this paper, we take the first step to benchmark and assess the visual naturalness of AI-generated images. First, we construct the AI-Generated Image Naturalness (AGIN) database by conducting a large-scale subjective study to collect human opinions on the overall naturalness as well as perceptions from technical and rationality perspectives. AGIN verifies that naturalness is universally and disparately affected by technical and rationality distortions. Second, we propose the Joint Objective Image Naturalness evaluaTor (JOINT), to automatically predict the naturalness of AGIs that aligns human ratings. Specifically, JOINT imitates human reasoning in naturalness evaluation by jointly learning both technical and rationality features. We demonstrate that JOINT significantly outperforms baselines for providing more subjectively consistent results on naturalness assessment.

cs.CV↗

arXiv2023

Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Models

Recent advancements in Multi-modality Large Language Models (MLLMs) have demonstrated remarkable capabilities in complex high-level vision tasks. However, the exploration of MLLM potential in visual quality assessment, a vital aspect of low-level vision, remains limited. To address this gap, we introduce Q-Boost, a novel strategy designed to enhance low-level MLLMs in image quality assessment (IQA) and video quality assessment (VQA) tasks, which is structured around two pivotal components: 1) Triadic-Tone Integration: Ordinary prompt design simply oscillates between the binary extremes of $positive$ and $negative$. Q-Boost innovates by incorporating a `middle ground' approach through $neutral$ prompts, allowing for a more balanced and detailed assessment. 2) Multi-Prompt Ensemble: Multiple quality-centric prompts are used to mitigate bias and acquire more accurate evaluation. The experimental results show that the low-level MLLMs exhibit outstanding zeros-shot performance on the IQA/VQA tasks equipped with the Q-Boost strategy.

cs.CV↗

arXiv2023

RepQ: Generalizing Quantization-Aware Training for Re-Parametrized Architectures

Existing neural networks are memory-consuming and computationally intensive, making deploying them challenging in resource-constrained environments. However, there are various methods to improve their efficiency. Two such methods are quantization, a well-known approach for network compression, and re-parametrization, an emerging technique designed to improve model performance. Although both techniques have been studied individually, there has been limited research on their simultaneous application. To address this gap, we propose a novel approach called RepQ, which applies quantization to re-parametrized networks. Our method is based on the insight that the test stage weights of an arbitrary re-parametrized layer can be presented as a differentiable function of trainable parameters. We enable quantization-aware training by applying quantization on top of this function. RepQ generalizes well to various re-parametrized models and outperforms the baseline method LSQ quantization scheme in all experiments.

cs.LG↗