Searcharxiv⌕ Search

arXiv subjects

Jaewoo Jung

Publications and source records attributed to Jaewoo Jung.

32 records · Page 2Linked to original sources

On quadratic persistence and Pythagoras numbers of totally real projective varieties

In this paper, we study the relationship between quadratic persistence and the Pythagoras number of totally real projective varieties. Building upon the foundational work of Blekherman et al. in arXiv:1902.02754, we extend their characterizations of arithmetically Cohen-Macaulay varieties with next-to-maximal quadratic persistence to arbitrary case. Our main result classifies totally real non-aCM varieties of codimension $c$ and degree $d$ that exhibit next-to-maximal quadratic persistence in the cases where $c=3$ and $d \geq 6$ or $c \geq 4$ and $d \geq 2c+3$. We further investigate the quadratic persistence and Pythagoras number in the context of curves of maximal regularity and linearly normal smooth curves of genus 3.

math.AG↗

Vid-CamEdit: Video Camera Trajectory Editing with Generative Rendering from Estimated Geometry

We introduce Vid-CamEdit, a novel framework for video camera trajectory editing, enabling the re-synthesis of monocular videos along user-defined camera paths. This task is challenging due to its ill-posed nature and the limited multi-view video data for training. Traditional reconstruction methods struggle with extreme trajectory changes, and existing generative models for dynamic novel view synthesis cannot handle in-the-wild videos. Our approach consists of two steps: estimating temporally consistent geometry, and generative rendering guided by this geometry. By integrating geometric priors, the generative model focuses on synthesizing realistic details where the estimated geometry is uncertain. We eliminate the need for extensive 4D training data through a factorized fine-tuning framework that separately trains spatial and temporal components using multi-view image and video data. Our method outperforms baselines in producing plausible videos from novel camera trajectories, especially in extreme extrapolation scenarios on real-world footage.

cs.CV↗

A Fröberg type theorem for higher secant complexes

We generalize the celebrated Fröberg's theorem to embedded joins of copies of a simplicial complex, namely higher secant complexes to the simplicial complex, in terms of property $N_{q+1,p}$ due to Green and Lazarsfeld. Furthermore, we investigate combinatorial phenomena parallel to geometric ones observed for higher secant varieties of minimal degree.

math.AC↗

URECA: Unique Region Caption Anything

Region-level captioning aims to generate natural language descriptions for specific image regions while highlighting their distinguishing features. However, existing methods struggle to produce unique captions across multi-granularity, limiting their real-world applicability. To address the need for detailed region-level understanding, we introduce URECA dataset, a large-scale dataset tailored for multi-granularity region captioning. Unlike prior datasets that focus primarily on salient objects, URECA dataset ensures a unique and consistent mapping between regions and captions by incorporating a diverse set of objects, parts, and background elements. Central to this is a stage-wise data curation pipeline, where each stage incrementally refines region selection and caption generation. By leveraging Multimodal Large Language Models (MLLMs) at each stage, our pipeline produces distinctive and contextually grounded captions with improved accuracy and semantic diversity. Building upon this dataset, we present URECA, a novel captioning model designed to effectively encode multi-granularity regions. URECA maintains essential spatial properties such as position and shape through simple yet impactful modifications to existing MLLMs, enabling fine-grained and semantically rich region descriptions. Our approach introduces dynamic mask modeling and a high-resolution mask encoder to enhance caption uniqueness. Experiments show that URECA achieves state-of-the-art performance on URECA dataset and generalizes well to existing region-level captioning benchmarks.

cs.CV↗

Cross-View Completion Models are Zero-shot Correspondence Estimators

In this work, we explore new perspectives on cross-view completion learning by drawing an analogy to self-supervised correspondence learning. Through our analysis, we demonstrate that the cross-attention map within cross-view completion models captures correspondence more effectively than other correlations derived from encoder or decoder features. We verify the effectiveness of the cross-attention map by evaluating on both zero-shot matching and learning-based geometric matching and multi-frame depth estimation. Project page is available at https://cvlab-kaist.github.io/ZeroCo/.

cs.CV↗

Domain Generalization Using Large Pretrained Models with Mixture-of-Adapters

Learning robust vision models that perform well in out-of-distribution (OOD) situations is an important task for model deployment in real-world settings. Despite extensive research in this field, many proposed methods have only shown minor performance improvements compared to the simplest empirical risk minimization (ERM) approach, which was evaluated on a benchmark with a limited hyperparameter search space. Our focus in this study is on leveraging the knowledge of large pretrained models to improve handling of OOD scenarios and tackle domain generalization problems. However, prior research has revealed that naively fine-tuning a large pretrained model can impair OOD robustness. Thus, we employ parameter-efficient fine-tuning (PEFT) techniques to effectively preserve OOD robustness while working with large models. Our extensive experiments and analysis confirm that the most effective approaches involve ensembling diverse models and increasing the scale of pretraining. As a result, we achieve state-of-the-art performance in domain generalization tasks. Our code and project page are available at: https://cvlab-kaist.github.io/MoA

cs.CV↗

Relaxing Accurate Initialization Constraint for 3D Gaussian Splatting

3D Gaussian splatting (3DGS) has recently demonstrated impressive capabilities in real-time novel view synthesis and 3D reconstruction. However, 3DGS heavily depends on the accurate initialization derived from Structure-from-Motion (SfM) methods. When the quality of the initial point cloud deteriorates, such as in the presence of noise or when using randomly initialized point cloud, 3DGS often undergoes large performance drops. To address this limitation, we propose a novel optimization strategy dubbed RAIN-GS (Relaing Accurate Initialization Constraint for 3D Gaussian Splatting). Our approach is based on an in-depth analysis of the original 3DGS optimization scheme and the analysis of the SfM initialization in the frequency domain. Leveraging simple modifications based on our analyses, RAIN-GS successfully trains 3D Gaussians from sub-optimal point cloud (e.g., randomly initialized point cloud), effectively relaxing the need for accurate initialization. We demonstrate the efficacy of our strategy through quantitative and qualitative comparisons on multiple datasets, where RAIN-GS trained with random point cloud achieves performance on-par with or even better than 3DGS trained with accurate SfM point cloud. Our project page and code can be found at https://ku-cvlab.github.io/RAIN-GS.

cs.CV↗

Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

This work delves into the task of pose-free novel view synthesis from stereo pairs, a challenging and pioneering task in 3D vision. Our innovative framework, unlike any before, seamlessly integrates 2D correspondence matching, camera pose estimation, and NeRF rendering, fostering a synergistic enhancement of these tasks. We achieve this through designing an architecture that utilizes a shared representation, which serves as a foundation for enhanced 3D geometry understanding. Capitalizing on the inherent interplay between the tasks, our unified framework is trained end-to-end with the proposed training strategy to improve overall model accuracy. Through extensive evaluations across diverse indoor and outdoor scenes from two real-world datasets, we demonstrate that our approach achieves substantial improvement over previous methodologies, especially in scenarios characterized by extreme viewpoint changes and the absence of accurate camera poses.

cs.CV↗

Self-Evolving Neural Radiance Fields

Recently, neural radiance field (NeRF) has shown remarkable performance in novel view synthesis and 3D reconstruction. However, it still requires abundant high-quality images, limiting its applicability in real-world scenarios. To overcome this limitation, recent works have focused on training NeRF only with sparse viewpoints by giving additional regularizations, often called few-shot NeRF. We observe that due to the under-constrained nature of the task, solely using additional regularization is not enough to prevent the model from overfitting to sparse viewpoints. In this paper, we propose a novel framework, dubbed Self-Evolving Neural Radiance Fields (SE-NeRF), that applies a self-training framework to NeRF to address these problems. We formulate few-shot NeRF into a teacher-student framework to guide the network to learn a more robust representation of the scene by training the student with additional pseudo labels generated from the teacher. By distilling ray-level pseudo labels using distinct distillation schemes for reliable and unreliable rays obtained with our novel reliability estimation method, we enable NeRF to learn a more accurate and robust geometry of the 3D scene. We show and evaluate that applying our self-training framework to existing models improves the quality of the rendered images and achieves state-of-the-art performance in multiple settings.

cs.CV↗

An Eisenbud-Goto type inequality for Stanley-Reisner ideals and simplicial complexes

The Leray number of an abstract simplicial complex is the minimal integer $d$ where its induced subcomplexes have trivial homology groups in dimension $d$ or greater. We give an upper bound on the Leray number of a complex in terms of how the facets are attached to each other. We also describe the structure of complexes for the equality of the bound that we found. Through the Stanley-Reisner correspondence, our results give an Eisenbud-Goto type inequality for any square-free monomial ideals. This generalizes Terai's result.

math.AC↗

Sums of squares, Hankel index, and almost real rank

The Hankel index of a real variety $X$ is an invariant that quantifies the difference between nonnegative quadrics and sums of squares on $X$. In [5], the authors proved an intriguing bound on the Hankel index in terms of the Green-Lazarsfeld index, which measures the "linearity" of the minimal free resolution of the ideal of $X$. In all previously known cases this bound was tight. We provide the first class of examples where the bound is not tight; in fact the difference between Hankel index and Green-Lazarsfeld index can be arbitrarily large. Our examples are outer projections of rational normal curves, where we identify the center of projection with a binary form $F$. The Green-Lazarsfeld index of the projected curve is given by the complex Waring border rank of $F$ [15]. We show that the Hankel index is given by the "almost real" rank of $F$, which is a new notion that comes from decomposing $F$ as a sum of powers of almost real forms. We determine the range of possible and typical almost real ranks for binary forms.

math.AG↗

Bounds on Regularity of Quadratic Monomial Ideals

Castelnuovo-Mumford regularity is a measure of algebraic complexity of an ideal. Regularity of monomial ideals can be investigated combinatorially. We use a simple graph decomposition and results from structural graph theory to prove, improve and generalize many of the known bounds on regularity of quadratic square-free monomial ideals.

math.AC↗

Entropy production and fluctuation theorems on complex networks

Entropy production (EP) is known as a fundamental quantity for measuring the irreversibility of processes in thermal equilibrium and states far from equilibrium. In stochastic thermodynamics, the EP becomes more visible in terms of the probability density functions of the trajectories of a particle in the state space. Inspired by a previous result that complex networks can serve as state spaces, we consider a data packet transport problem on complex networks. Entropy is produced owing to the complexity of pathways as the packet travels back and forth between two nodes. The EPs are exactly enumerated along the shortest paths between every pair of nodes, and the functional form of the EP distribution is determined by extreme value analysis. The asymptote of the accumulated EP distribution is found to follow the Gumbel distribution.

cond-mat.stat-mech↗