SearcharxivSearch

arXiv subjects

Yefeng Shen

Publications and source records attributed to Yefeng Shen.

At least 19 recordsLinked to original sources

Exploring the Performance Frontier of Compact Unified Image Generation Models

We present Swift-Image, a compact unified model for text-to-image generation, single-image editing, and multi-image editing. Our goal is to explore how far a relatively small visual generator can be pushed through systematic training engineering under a constrained computational budget. Swift-Image adopts an efficient 6B single-stream DiT and a progressive training pipeline that evolves from broad semantic coverage to higher resolution, stronger visual quality, and unified generation-editing supervision. For post-training, we employ parallel expert reinforcement learning followed by multi-teacher on-policy distillation to alleviate interference among heterogeneous objectives. We further decouple high-level reasoning from pixel-level rendering with a Prompt Enhancer that translates user requests into generator-aligned visual specifications. For efficient deployment, structural pruning and few-step distillation produce 3B and accelerated variants. Swift-Image achieves leading aggregate performance among evaluated open-source models with only 6B parameters and 243K GPU training hours; the compressed 3B model incurs nearly no loss, while few-step distillation further improves aggregate editing performance with substantially fewer sampling steps. Our study also summarizes practical lessons for architecture, data curriculum, post-training, prompt enhancement, and model compression.

cs.CV

From Corpora to Co-Evolving Capabilities: Capability-Centric Data Design for Generalist Image Generation

Large-scale image generation has benefited from advances in data scale, quality, rebalancing, and recaptioning, yet conventional pipelines typically optimize task-specific datasets in isolation. A central challenge is not only how to curate each task-specific corpus, but also how to organize heterogeneous supervision according to the dependencies among generative capabilities. We present a \textbf{capability-driven data infrastructure} that couples capability-specific supervision construction with capability-aligned curriculum scheduling. Its three specialized yet interoperable data engines build complementary relational supervision for text-image grounding, inter-image transformation, and image-knowledge association, while caption experts align T2I and editing supervision across tasks and granularities. A multi-stage curriculum jointly evolves task composition, visual-concept distribution, data quality, and image resolution along the dependency order of capability acquisition, with capability-aware evaluation closing the loop through targeted retrieval, expert construction, and gap-aware resampling. At scale, the framework curates a 440M-image T2I corpus, 120M editing pairs, and over 27M image-entity pairs. With this infrastructure, we train multimodal diffusion models at two scales from scratch, with 3B and 6B sizes respectively. We conduct quantitative evaluation on CPI-Bench, along with qualitative evaluations across diverse text-to-image and editing scenarios. Experimental results present broad visual coverage, versatile rendering, and effective transfer across generative capabilities.

cs.CV

CPI-Bench: A Comprehensive, Practical and Intelligent Benchmark for Real-World Image Editing

With the rapid advancement of image editing models and their widespread application across various domains, there is an increasingly urgent need to deploy these model capabilities directly into real-world scenarios. However, existing benchmarks remain confined to simple single-image tasks, suffering from limited coverage dimensions and an inability to effectively differentiate performance among diverse models. Consequently, they fail to reliably evaluate model performance in complex multi-image editing, highly demanding reasoning instructions, and practical deployment settings. To address these limitations, we propose CPI-Bench, a Comprehensive, Practical and Intelligent benchmark for real-world image editing. CPI-Bench comprises three core subsets: CPI-General-Bench, which comprehensively covers diverse editing tasks and introduces multi-image editing evaluation; CPI-Practical-Bench, which focuses on high-frequency real-user application scenarios; and CPI-Intelligent-Bench, which is dedicated to evaluating capabilities in highly demanding reasoning-based editing. Evaluation results of mainstream image editing models based on CPI-Bench demonstrate that CPI-Bench enhances performance differentiation among models. It provides a comprehensive and reliable quantification of gaps in general editing capabilities, practical deployment efficacy, and advanced reasoning-based editing, offering invaluable guidance for the future optimization of image editing models. Crucially, our ranking analysis reveals that CPI-Bench achieves the highest alignment with the Arena Image Edit Leaderboard, indicating stronger consistency with public human preference rankings, serving as an effective proxy for public human evaluations.

cs.CV

B-model Categorical Enumerative Invariants and holomorphic anomaly equations

In this paper, we study the B-model categorical enumerative invariants (CEI) associated with derived categories of coherent sheaves on smooth projective Calabi-Yau $3$-folds. We first prove the analogs of the dilaton, string, and divisor equations of CEI in a general context. Then we use these equations and the Givental quantization formula to prove that the B-model CEI for any miniversal family of smooth projective Calabi-Yau $3$-folds satisfies the holomorphic anomaly equations introduced by Bershadsky-Cecotti-Ooguri-Vafa. This provides strong evidence that CEI may be taken as a rigorous mathematical definition of the B-model topological string partition function.

math.AG

FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization

Human-centric video customization, particularly at the garment level, has shown significant commercial value. However, existing approaches cannot support low-latency and interactive garment control, which is crucial for applications such as e-commerce and content creation. This paper studies how to achieve interactive multi-garment video customization while preserving motion coherence using only single-garment video data. We present FashionChameleon, a real-time and interactive framework for human-garment customization in autoregressive video generation, where users can interactively switch garment during generation. FashionChameleon consists of three key techniques: (i) Instead of training on multi-garment video data, we train a Teacher Model with In-Context Learning on a single reference-garment pair. By retaining the image-to-video training paradigm while enforcing a mismatch between the reference and garment image, the model is encouraged to implicitly preserve coherence during single-garment switching. (ii) To achieve consistency and efficiency during generation, we introduce Streaming Distillation with In-Context Learning, which fine-tunes the model with in-context teacher forcing and improves extrapolation consistency via gradient-reweighted distribution matching distillation. (iii) To extend the model for interactive multi-garment video customization, we propose Training-Free KV Cache Rescheduling, which includes garment KV refresh, historical KV withdraw, and reference KV disentangle to achieve garment switching while preserving motion coherence. Our FashionChameleon uniquely supports interactive customization and consistent long-video extrapolation, while achieving real-time generation at 23.8 FPS on a single GPU, 30-180$\times$ faster than existing baselines.

cs.CV

Tstars-Tryon 1.0: Robust and Realistic Virtual Try-On for Diverse Fashion Items

Recent advances in image generation and editing have opened new opportunities for virtual try-on. However, existing methods still struggle to meet complex real-world demands. We present Tstars-Tryon 1.0, a commercial-scale virtual try-on system that is robust, realistic, versatile, and highly efficient. First, our system maintains a high success rate across challenging cases like extreme poses, severe illumination variations, motion blur, and other in-the-wild conditions. Second, it delivers highly photorealistic results with fine-grained details, faithfully preserving garment texture, material properties, and structural characteristics, while largely avoiding common AI-generated artifacts. Third, beyond apparel try-on, our model supports flexible multi-image composition (up to 6 reference images) across 8 fashion categories, with coordinated control over person identity and background. Fourth, to overcome the latency bottlenecks of commercial deployment, our system is heavily optimized for inference speed, delivering near real-time generation for a seamless user experience. These capabilities are enabled by an integrated system design spanning end-to-end model architecture, a scalable data engine, robust infrastructure, and a multi-stage training paradigm. Extensive evaluation and large-scale product deployment demonstrate that Tstars-Tryon1.0 achieves leading overall performance. To support future research, we also release a comprehensive benchmark. The model has been deployed at an industrial scale on the Taobao App, serving millions of users with tens of millions of requests.

cs.CV

Quantum spectrum and Gamma structure for standard flips

We investigate the quantum spectrum and Gamma structure for projective bundles, blow-ups, and standard flips. After restricting the quantum multiplication to the exceptional curve direction, we obtain a decomposition of the quantum cohomology of standard flips into asymptotic Gamma classes. We then show that this decomposition is compatible with the semi-orthogonal decompositions for these spaces constructed in work of Orlov and Belmans-Fu-Raedschelders. The proof involves a sequence of reductions to a local model and the asymptotic behavior of Meijer G-functions.

math.AG

Quantum spectrum and Gamma structures for quasi-homogeneous polynomials of general type

Let $W$ be a quasi-homogeneous polynomial of general type and $ $ be the cyclic symmetry group of $W$ generated by the exponential grading element $J$. We study the quantum spectrum and asymptotic behavior in Fan-Jarvis-Ruan-Witten theory of the Landau-Ginzburg pair $(W, )$. Inspired by Galkin-Golyshev-Iritani's Gamma conjectures for quantum cohomology of Fano manifolds, we propose Gamma conjectures for Fan-Jarvis-Ruan-Witten theory of general type. We prove the quantum spectrum conjecture and the Gamma conjectures for Fermat homogeneous polynomials and the mirror simple singularities. The Gamma structures in Fan-Jarvis-Ruan-Witten theory also provide a bridge from the category of matrix factorizations of the Landau-Ginzburg pair (the algebraic aspect) to its analytic aspect. We will explain the relationship among the Gamma structures, Orlov's semiorthogonal decompositions, and the Stokes phenomenon.

math.AG

Semisimple FJRW theory of polynomials with two variables

We study the Dubrovin-Frobenius manifold in the Fan-Jarvis-Ruan-Witten theory of Landau-Ginzburg pairs $(W, \ )$, where $W$ is an invertible nondegenerate quasihomogeneous polynomial with two variables and $\ $ is the minimal admissible group of $W$. We conjecture that the Dubrovin-Frobenius manifolds from these FJRW theory are semisimple. We show the conjecture holds true for simple singularities and almost all Brieskorn-Pham polynomials. For Brieskorn-Pham polynomials, the result follows from the calculation of a quantum Euler class in the FJRW theory. As a consequence, our result shows that for the FJRW theory of these Landau-Ginzburg pairs, both a Dubrovin type conjecture and a Virasoro conjecture hold true.

math.AG

A Landau-Ginzburg mirror theorem via matrix factorizations

For an in invertible quasihomogeneous singularity $w$ we prove an all-genus mirror theorem establishing an isomorphism between two cohomological field theories. On the $B$-side it is the Saito-Givental theory given by a certain choice of a primitive form. On the $A$-side, it is the reduced matrix factorization CohFT for the dual singularity $w^T$ with the maximal diagonal symmetry group.

math.AG

Virasoro constraints in quantum singularity theories

We introduce Virasoro operators for any Landau-Ginzburg pair (W, G) where W is a non-degenerate quasi-homogeneous polynomial and G is a certain group of diagonal symmetries. We propose a conjecture that the total ancestor potential of the FJRW theory of the pair (W,G) is annihilated by these Virasoro operators. We prove the conjecture in various cases, including: (1) invertible polynomials with the maximal group, (2) some two-variable polynomials with the minimal group, (3) certain Calabi-Yau polynomials with groups. We also discuss the connections among Virasoro constraints, mirror symmetry of Landau-Ginzburg models, and Landau-Ginzburg/Calabi-Yau correspondence.

math.AG

Higher Genus FJRW Invariants of a Fermat Cubic

We reconstruct the all-genus Fan-Jarvis-Ruan-Witten invariants of a Fermat cubic Landau-Ginzburg space $(x_1^3+x_2^3+x_3^3: [\mathbb{C}^3/ \mathboldμ_3]\to \mathbb{C})$ from genus-one primary invariants, using tautological relations and axioms of Cohomological Field Theories. These genus-one invariants satisfy a Chazy equation by the Belorousski-Pandharipande relation. They are completely determined by a single genus-one invariant, which can be obtained from cosection localization and intersection theory on moduli of three spin curves. We solve an all-genus Landau-Ginzburg/Calabi-Yau Correspondence Conjecture for the Fermat cubic Landau-Ginzburg space using Cayley transformation on quasi-modular forms. This transformation relates two non-semisimple CohFT theories: the Fan-Jarvis-Ruan-Witten theory of the Fermat cubic polynomial and the Gromov-Witten theory of the Fermat cubic curve. As a consequence, Fan-Jarvis-Ruan-Witten invariants at any genus can be computed using Gromov-Witten invariants of the elliptic curve. They also satisfy nice structures including holomorphic anomaly equations and Virasoro constraints.

math.AG

A genus-one FJRW invariant via two methods

We calculate a genus-one FJRW invariant of an LG pair $(W_3=x_1^3+x_2^3+x_3^3, μ_3)$ via two different methods. In the first method, we apply the cosection localization technique to get a genus-one three-spin virtual class explicitly and then calculate the target FJRW invariant via self-intersections of the three-spin virtual class. In the second method, we apply the Mixed Spin P-fields method for the pair and calculate the invariant using the localization formula. This invariant is the building block in establishing the all-genera LG/CY correspondence and its determination enables one to compute the all-genera FJRW invariants for the LG pair.

math.AG

Landau-Ginzburg Mirror Symmetry Conjecture

We prove the Landau-Ginzburg mirror symmetry conjecture between invertible quasi-homogeneous polynomial singularities at all genera. That is, we show that the FJRW theory (LG A-model) of such a polynomial is equivalent to the Saito-Givental theory (LG B-model) of the mirror polynomial.

math.AG

LG/CY Correspondence for Elliptic Orbifold Curves via Modularity

We prove the Landau-Ginzburg/Calabi-Yau correspondence between the Gromov-Witten theory of each elliptic orbifold curve and its Fan-Jarvis-Ruan-Witten theory counterpart via modularity. We show that the correlation functions in these two enumerative theories are different representations of the same set of quasi-modular forms, expanded around different points on the upper-half plane. We relate these two representations by the Cayley transform.

math.AG

Ramanujan Identities and Quasi-Modularity in Gromov-Witten Theory

We prove that the ancestor Gromov-Witten correlation functions of one-dimensional compact Calabi-Yau orbifolds are quasi-modular forms. This includes the pillowcase orbifold which can not yet be handled by using Milanov-Ruan's B-model technique. We first show that genus zero modularity is obtained from the phenomenon that the system of WDVV equations is essentially equivalent to the set of Ramanujan identities satisfied by the generators of the ring of quasi-modular forms for a certain modular group associated to the orbifold curve. Higher genus modularity then follows by using tautological relations.

math.AG

Gromov-Witten Theory of Quotient of Fermat Calabi-Yau varieties

We construct a global B-model for weighted homogeneous polynomials based on K. Saito's theory of primitive forms. Our main motivation is to give a rigorous statement of the so called global mirror symmetry conjecture relating Gromov-Witten invariants and Fan--Jarvis--Ruan--Witten invariants. Furthermore, our construction allows us to generalize the notion of a quasi-modular form and holomorphic anomaly equations. Finally, we prove the global mirror symmetry conjecture for the Fermat polynomials.

math.AG

Mirror symmetry for exceptional unimodular singularities

In this paper, we prove the mirror symmetry conjecture between the Saito-Givental theory of exceptional unimodular singularities on Landau-Ginzburg B-side and the Fan-Jarvis-Ruan-Witten theory of their mirror partners on Landau-Ginzburg A-side. On the B-side, we compute the genus-zero generating function from a perturbative formula of primitive forms introduced by the first three authors recently. This computation matches the orbifold-Grothendieck-Riemann-Roch and WDVV calculations in FJRW theory on the A-side. The coincidence of the full data at all genera is established by reconstruction techniques. Our result establishes the first examples of LG-LG mirror symmetry of all genera for weighted homogeneous polynomials of central charge greater than one (i.e. which contain negative degree deformation parameters).

math.AG