Searcharxiv⌕ Search

arXiv subjects

Shuai Yang

Publications and source records attributed to Shuai Yang.

At least 109 records · Page 6Linked to original sources

OpenRSD: Towards Open-prompts for Object Detection in Remote Sensing Images

Remote sensing object detection has made significant progress, but most studies still focus on closed-set detection, limiting generalization across diverse datasets. Open-vocabulary object detection (OVD) provides a solution by leveraging multimodal associations between text prompts and visual features. However, existing OVD methods for remote sensing (RS) images are constrained by small-scale datasets and fail to address the unique challenges of remote sensing interpretation, include oriented object detection and the need for both high precision and real-time performance in diverse scenarios. To tackle these challenges, we propose OpenRSD, a universal open-prompt RS object detection framework. OpenRSD supports multimodal prompts and integrates multi-task detection heads to balance accuracy and real-time requirements. Additionally, we design a multi-stage training pipeline to enhance the generalization of model. Evaluated on seven public datasets, OpenRSD demonstrates superior performance in oriented and horizontal bounding box detection, with real-time inference capabilities suitable for large-scale RS image analysis. Compared to YOLO-World, OpenRSD exhibits an 8.7\% higher average precision and achieves an inference speed of 20.8 FPS. Codes and models will be released.

cs.CV↗

Language-based Image Colorization: A Benchmark and Beyond

Image colorization aims to bring colors back to grayscale images. Automatic image colorization methods, which requires no additional guidance, struggle to generate high-quality images due to color ambiguity, and provides limited user controllability. Thanks to the emergency of cross-modality datasets and models, language-based colorization methods are proposed to fully utilize the efficiency and flexibly of text descriptions to guide colorization. In view of the lack of a comprehensive review of language-based colorization literature, we conduct a thorough analysis and benchmarking. We first briefly summarize existing automatic colorization methods. Then, we focus on language-based methods and point out their core challenge on cross-modal alignment. We further divide these methods into two categories: one attempts to train a cross-modality network from scratch, while the other utilizes the pre-trained cross-modality model to establish the textual-visual correspondence. Based on the analyzed limitations of existing language-based methods, we propose a simple yet effective method based on distilled diffusion model. Extensive experiments demonstrate that our simple baseline can produces better results than previous complex methods with 14 times speed up. To the best of our knowledge, this is the first comprehensive review and benchmark on language-based image colorization field, providing meaningful insights for the community. The code is available at https://github.com/lyf1212/Color-Turbo.

cs.CV↗

MEAT: Multiview Diffusion Model for Human Generation on Megapixels with Mesh Attention

Multiview diffusion models have shown considerable success in image-to-3D generation for general objects. However, when applied to human data, existing methods have yet to deliver promising results, largely due to the challenges of scaling multiview attention to higher resolutions. In this paper, we explore human multiview diffusion models at the megapixel level and introduce a solution called mesh attention to enable training at 1024x1024 resolution. Using a clothed human mesh as a central coarse geometric representation, the proposed mesh attention leverages rasterization and projection to establish direct cross-view coordinate correspondences. This approach significantly reduces the complexity of multiview attention while maintaining cross-view consistency. Building on this foundation, we devise a mesh attention block and combine it with keypoint conditioning to create our human-specific multiview diffusion model, MEAT. In addition, we present valuable insights into applying multiview human motion videos for diffusion training, addressing the longstanding issue of data scarcity. Extensive experiments show that MEAT effectively generates dense, consistent multiview human images at the megapixel level, outperforming existing multiview diffusion methods.

cs.CV↗

Numerical evidence for spin chirality emerging from itinerant ferromagnets in bands with Berry curvature

The behavior of strongly interacting electrons in bands with Berry curvature is a problem of wide interest. In this paper, we study this problem by numerically studying a fluxed Hubbard-type model on square lattice. Using this model, we demonstrate a metallic ferromagnet in electron bands equipped with Berry curvature can develop non-coplanar spin order in which spin polarization axes at different position span finite solid angles. We find spin chirality can emerge in this setting by doping or adding gauge flux on top of a collinear ferromagnet. This result supports the prediction of spin chirality occurring through an emergent spin orbital interaction. Meanwhile, our result shows that, on top a ferromagnetic background, the spin chirality emerges at a finite threshold value of orbital magnetization, resembling the predicted behavior in theory.

cond-mat.str-el↗

Citrus: Leveraging Expert Cognitive Pathways in a Medical Language Model for Advanced Medical Decision Support

Large language models (LLMs), particularly those with reasoning capabilities, have rapidly advanced in recent years, demonstrating significant potential across a wide range of applications. However, their deployment in healthcare, especially in disease reasoning tasks, is hindered by the challenge of acquiring expert-level cognitive data. In this paper, we introduce Citrus, a medical language model that bridges the gap between clinical expertise and AI reasoning by emulating the cognitive processes of medical experts. The model is trained on a large corpus of simulated expert disease reasoning data, synthesized using a novel approach that accurately captures the decision-making pathways of clinicians. This approach enables Citrus to better simulate the complex reasoning processes involved in diagnosing and treating medical conditions. To further address the lack of publicly available datasets for medical reasoning tasks, we release the last-stage training data, including a custom-built medical diagnostic dialogue dataset. This open-source contribution aims to support further research and development in the field. Evaluations using authoritative benchmarks such as MedQA, covering tasks in medical reasoning and language understanding, show that Citrus achieves superior performance compared to other models of similar size. These results highlight Citrus potential to significantly enhance medical decision support systems, providing a more accurate and efficient tool for clinical decision-making.

cs.AI↗

LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generation

3D immersive scene generation is a challenging yet critical task in computer vision and graphics. A desired virtual 3D scene should 1) exhibit omnidirectional view consistency, and 2) allow for free exploration in complex scene hierarchies. Existing methods either rely on successive scene expansion via inpainting or employ panorama representation to represent large FOV scene environments. However, the generated scene suffers from semantic drift during expansion and is unable to handle occlusion among scene hierarchies. To tackle these challenges, we introduce Layerpano3D, a novel framework for full-view, explorable panoramic 3D scene generation from a single text prompt. Our key insight is to decompose a reference 2D panorama into multiple layers at different depth levels, where each layer reveals the unseen space from the reference views via diffusion prior. Layerpano3D comprises multiple dedicated designs: 1) We introduce a new panorama dataset Upright360, comprising 9k high-quality and upright panorama images, and finetune the advanced Flux model on Upright360 for high-quality, upright and consistent panorama generation. 2) We pioneer the Layered 3D Panorama as underlying representation to manage complex scene hierarchies and lift it into 3D Gaussians to splat detailed 360-degree omnidirectional scenes with unconstrained viewing paths. Extensive experiments demonstrate that our framework generates state-of-the-art 3D panoramic scene in both full view consistency and immersive exploratory experience. We believe that Layerpano3D holds promise for advancing 3D panoramic scene creation with numerous applications.

cs.CV↗

Microscopic study of 3D Potts phase transition via Fuzzy Sphere Regularization

The Potts model describes interacting spins with $Q$ different components, which is a direct generalization of the Ising model ($Q=2$). Compared to the existing exact solutions in 2D, the phase transitions and critical phenomena in the 3D Potts model have been less explored. Here, we systematically investigate a quantum $(2+1)$-D Potts model with $Q=3$ using a fuzzy sphere regularization scheme. We first construct a microscopic model capable of achieving a magnetic phase transition that separates a spin $S_3$ permutationally symmetric paramagnet and a spontaneous symmetry-breaking ferromagnet. Importantly, the energy spectrum at the phase transition point exhibits an approximately conformal symmetry, implying that an underlying conformal field theory may govern this transition. Moreover, when tuning along the phase transition line in the mapped phase diagram, we find that the dimension of the subleading $S_3$ singlet operator flows and drifts around the critical value $\sim 3$, which is believed to be crucial for understanding this phase transition, although determining its precise value remains challenging due to the limitations of our finite-size calculations. These findings suggest a discontinuous transition in the 3D 3-state Potts model, characterized by pseudo-critical behavior, which we argue results from a nearby multicritical or complex fixed point.

cond-mat.stat-mech↗

Reducing disorder in PbTe nanowires for Majorana research

Material challenges are the key issue in Majorana research where surface disorder constrains device performance. Here, we tackle this challenge by embedding PbTe nanowires within a lattice-constant-matched crystal. The wire edges are shaped by self-organized growth instead of lithography, resulting in nearly-atomic-flat facets along both cross-sectional and longitudinal directions. Quantized conductance is observed at zero magnetic field with channel lengths maximally reaching 1.7 $μ$m, significantly surpassing the state-of-the-art of III-V nanowires (an order-of-magnitude improvement compared to InSb). Coupling PbTe to a Pb film unveils a flat interface spanning microns and a large superconducting gap of 1 meV. Our result not only represents a stride toward meeting the stringent low-disorder requirement for Majoranas, but may also open the door to various hybrid quantum devices requiring a low level of disorder.

cond-mat.mes-hall↗

Anisotropy of PbTe nanowires with and without a superconductor

We investigate the anisotropic behaviors in PbTe and PbTe-Pb hybrid nanowires. In previous studies on PbTe, wire-to-wire variations in anisotropy indicate poor device control, posing a serious challenge for applications. Here, we achieve reproducible anisotropy in PbTe nanowires through a substantial reduction of disorder. We then couple PbTe to a superconductor Pb, and observe a pronounced deviation in the anisotropy behavior compared to bare PbTe nanowires. This deviation is gate-tunable and attributed to spin-orbit interaction and orbital effect, controlled by charge transfer between Pb and PbTe. These results provide a guidance for the controlled engineering of exotic quantum states in this hybrid material platform.

cond-mat.mes-hall↗

Position reconstruction using deep learning for the HERD PSD beam test

The High Energy cosmic-Radiation Detection (HERD) facility is a dedicated high energy astronomy and particle physics experiment planned to be installed on the Chinese space station, aiming to detect high-energy cosmic rays (GeV $\sim$ PeV) and high-energy gamma rays ($>$ 500 MeV). The Plastic Scintillator Detector (PSD) is one of the sub-detectors of HERD, with its main function of providing real-time anti-conincidence signals for gamma-ray detection and the secondary function of measuring the charge of cosmic-rays. In 2023, a prototype of PSD was developed and tested at CERN PS&SPS. In this paper, we investigate the position response of the PSD using two reconstruction algorithms: the classic dual-readout ratio and the deep learning method (KAN & MLP neural network). With the latter, we achieved a position resolution of 2 mm (1$σ$), which is significantly better than the classic method.

astro-ph.IM↗

Revealing the mystery of the double charm tetraquark in $pp$ collision

A novel approach is proposed to probe the nature of the double charm tetraquark through the prompt production asymmetry between $T_{\bar{c}\bar{c}}^-$ and $T_{cc}^+$ in $pp$ collisions. When comparing two theoretical pictures, i.e. the compact tetraquark and hadronic molecular pictures, we find that the former one exhibits a significantly larger production asymmetry, enabling the unambiguous determination of the tetraquark's internal structure. Additionally, distinctive differences in the transverse momentum and rapidity distributions of $T_{\bar{c}\bar{c}}^-$ and $T_{cc}^+$ cross sections emerge, particularly at $p_\mathrm{T}\approx 2~\mathrm{GeV}$ and $y\approx \pm 6$ at a center-of-mass energy of 14$~\mathrm{TeV}$. The insignificant asymmetry in hadronic molecular picture is because that hadronic molecules are produced in hadronic phase, where the phase space of their constituents needs to be taken into account rigorously. Our work can be extended to the exploration of other double heavy tetraquark candidates, offering a versatile approach to advance our understanding of exotic hadrons.

hep-ph↗

Imagine360: Immersive 360 Video Generation from Perspective Anchor

$360^\circ$ videos offer a hyper-immersive experience that allows the viewers to explore a dynamic scene from full 360 degrees. To achieve more user-friendly and personalized content creation in $360^\circ$ video format, we seek to lift standard perspective videos into $360^\circ$ equirectangular videos. To this end, we introduce Imagine360, the first perspective-to-$360^\circ$ video generation framework that creates high-quality $360^\circ$ videos with rich and diverse motion patterns from video anchors. Imagine360 learns fine-grained spherical visual and motion patterns from limited $360^\circ$ video data with several key designs. 1) Firstly we adopt the dual-branch design, including a perspective and a panorama video denoising branch to provide local and global constraints for $360^\circ$ video generation, with motion module and spatial LoRA layers fine-tuned on extended web $360^\circ$ videos. 2) Additionally, an antipodal mask is devised to capture long-range motion dependencies, enhancing the reversed camera motion between antipodal pixels across hemispheres. 3) To handle diverse perspective video inputs, we propose elevation-aware designs that adapt to varying video masking due to changing elevations across frames. Extensive experiments show Imagine360 achieves superior graphics quality and motion coherence among state-of-the-art $360^\circ$ video generation methods. We believe Imagine360 holds promise for advancing personalized, immersive $360^\circ$ video creation.

cs.CV↗

Approximate Quantum Circuit Synthesis for Diagonal Unitary

The quantum circuit synthesis problem bridges quantum algorithm design and quantum hardware implementation in the Noisy Intermediate-Scale Quantum (NISQ) era. In quantum circuit synthesis problems, diagonal unitary synthesis plays a crucial role due to its fundamental and versatile nature. Meanwhile, experimental results have shown that moderately approximating the original algorithm to conserve quantum resources can improve the fidelity of algorithms during quantum execution. Building on this insight, we propose a quantum circuit synthesis algorithm to design diagonal unitary implementations based on specified quantum resource limits. Our algorithm can synthesize diagonal unitary for quantum circuits with up to 15 qubits on an ordinary laptop. In algorithm efficiency, synthesizing an n-qubit unitary matrix with an exact algorithm requires $2^n$ CNOT gates as a baseline. Within the algorithm error $\varepsilon $ range of interest (0\%-12\%), our algorithm achieves a $3.2\varepsilon $ reduction in CNOT gates on average. In runtime, the algorithm efficiently performs, synthesizing 12-qubit diagonal unitary in an average of 6.57 seconds and 15-qubit in approximately 561.71 seconds.

quant-ph↗

Trajectory Attention for Fine-grained Video Motion Control

Recent advancements in video generation have been greatly driven by video diffusion models, with camera motion control emerging as a crucial challenge in creating view-customized visual content. This paper introduces trajectory attention, a novel approach that performs attention along available pixel trajectories for fine-grained camera motion control. Unlike existing methods that often yield imprecise outputs or neglect temporal correlations, our approach possesses a stronger inductive bias that seamlessly injects trajectory information into the video generation process. Importantly, our approach models trajectory attention as an auxiliary branch alongside traditional temporal attention. This design enables the original temporal attention and the trajectory attention to work in synergy, ensuring both precise motion control and new content generation capability, which is critical when the trajectory is only partially available. Experiments on camera motion control for images and videos demonstrate significant improvements in precision and long-range consistency while maintaining high-quality generation. Furthermore, we show that our approach can be extended to other video motion control tasks, such as first-frame-guided video editing, where it excels in maintaining content consistency over large spatial and temporal ranges.

cs.CV↗

Synthetic frequency-controlled gene circuits unlock expanded cellular states

Natural biological systems process environmental information through both amplitude and frequency-modulated signals, yet engineered biological circuits have largely relied on amplitude-based regulation alone. Despite the prevalence of frequency-encoded signals in natural systems, fundamental challenges in designing and implementing frequency-responsive gene circuits have limited their development in synthetic biology. Here we present a Time-Resolved Gene Circuit (TRGC) architecture that enables frequency-to-amplitude signal conversion in engineered biological systems. Through systematic analysis, we establish a theoretical framework that guides the design of synthetic circuits capable of distinct frequency-dependent responses, implementing both high-pass and low-pass filtering behaviors. To enable rigorous characterization of these dynamic circuits, we developed a high-throughput automated platform that ensures stable and reproducible measurements of frequency-dependent r esponses across diverse conditions. Using this platform, we demonstrate that these frequency-modulated circuits can access cellular states unreachable through conventional amplitude modulation, significantly expanding the controllable gene expression space in multi-gene systems. Our results show that frequency modulation expands the range of achievable expression patterns when controlling multiple genes through a single input, demonstrating a new paradigm for engineering cellular behaviors. This work establishes frequency modulation as a powerful strategy for expanding the capabilities of engineered biological systems and enhancing cellular response to dynamic signals.

physics.bio-ph↗

Grounded 3D-LLM with Referent Tokens

Prior studies on 3D scene understanding have primarily developed specialized models for specific tasks or required task-specific fine-tuning. In this study, we propose Grounded 3D-LLM, which explores the potential of 3D large multi-modal models (3D LMMs) to consolidate various 3D vision tasks within a unified generative framework. The model uses scene referent tokens as special noun phrases to reference 3D scenes, enabling it to handle sequences that interleave 3D and textual data. Per-task instruction-following templates are employed to ensure natural and diversity in translating 3D vision tasks into language formats. To facilitate the use of referent tokens in subsequent language modeling, we provide a large-scale, automatically curated grounded scene-text dataset with over 1 million phrase-to-region correspondences and introduce Contrastive Language-Scene Pre-training (CLASP) to perform phrase-level scene-text alignment using this data. Our comprehensive evaluation covers open-ended tasks like dense captioning and 3D question answering, alongside close-ended tasks such as object detection and language grounding. Experiments across multiple 3D benchmarks reveal the leading performance and the broad applicability of Grounded 3D-LLM. Code and datasets are available at the https://groundedscenellm.github.io/grounded_3d-llm.github.io.

cs.CV↗

Effect of Top Al$_2$O$_3$ Interlayer Thickness on Memory Window and Reliability of FeFETs With TiN/Al$_2$O$_3$/Hf$_{0.5}$Zr$_{0.5}$O$_2$/SiO$_x$/Si (MIFIS) Gate Structure

We investigate the effect of top Al2O3 interlayer thickness on the memory window (MW) of Si channel ferroelectric field-effect transistors (Si-FeFETs) with TiN/Al$_2$O$_3$/Hf$_{0.5}$Zr$_{0.5}$O$_2$/SiO$_x$/Si (MIFIS) gate structure. We find that the MW first increases and then remains almost constant with the increasing thickness of the top Al2O3. The phenomenon is attributed to the lower electric field of the ferroelectric Hf$_{0.5}$Zr$_{0.5}$O$_2$ in the MIFIS structure with a thicker top Al2O3 after a program operation. The lower electric field makes the charges trapped at the top Al2O3/Hf0.5Zr0.5O$_2$ interface, which are injected from the metal gate, cannot be retained. Furthermore, we study the effect of the top Al$_2$O$_3$ interlayer thickness on the reliability (endurance characteristics and retention characteristics). We find that the MIFIS structure with a thicker top Al$_2$O$_3$ interlayer has poorer retention and endurance characteristics. Our work is helpful in deeply understanding the effect of top interlayer thickness on the MW and reliability of Si-FeFETs with MIFIS gate stacks.

cond-mat.mtrl-sci↗

Video Diffusion Models are Training-free Motion Interpreter and Controller

Video generation primarily aims to model authentic and customized motion across frames, making understanding and controlling the motion a crucial topic. Most diffusion-based studies on video motion focus on motion customization with training-based paradigms, which, however, demands substantial training resources and necessitates retraining for diverse models. Crucially, these approaches do not explore how video diffusion models encode cross-frame motion information in their features, lacking interpretability and transparency in their effectiveness. To answer this question, this paper introduces a novel perspective to understand, localize, and manipulate motion-aware features in video diffusion models. Through analysis using Principal Component Analysis (PCA), our work discloses that robust motion-aware feature already exists in video diffusion models. We present a new MOtion FeaTure (MOFT) by eliminating content correlation information and filtering motion channels. MOFT provides a distinct set of benefits, including the ability to encode comprehensive motion information with clear interpretability, extraction without the need for training, and generalizability across diverse architectures. Leveraging MOFT, we propose a novel training-free video motion control framework. Our method demonstrates competitive performance in generating natural and faithful motion, providing architecture-agnostic insights and applicability in a variety of downstream tasks.

cs.CV↗