Searcharxiv⌕ Search

arXiv subjects

Guanghui Wang

Publications and source records attributed to Guanghui Wang.

At least 55 records · Page 3Linked to original sources

Distilling 3D Spatial Reasoning into a Lightweight Vision-Language Model with CoT

Large-scale 3D vision-language models (VLMs) like LLaVA-3D offer strong spatial reasoning but are difficult to deploy due to high computational costs. We propose a knowledge distillation framework that transfers spatial reasoning from a 7B teacher to a 2.29B student model. Our approach achieves 8.7x lower inference latency and a 3x reduction in model size while retaining 54-72% of the teacher's performance. The framework utilizes VGGT as the vision encoder and a multi-task distillation pipeline with uncertainty-aware loss weighting. To improve reasoning without chain-of-thought (CoT) data, we introduce "Hidden CoT": learnable latent tokens that serve as an internal scratchpad before answer generation. This is the first use of latent scratchpad reasoning in distilled 3D VLMs. The student model jointly performs spatial description, depth estimation, and object detection. Experiments on ScanNet and 3D-FRONT show strong spatial understanding, reaching 68-72% accuracy on proximity and contact tasks. Our framework enables efficient 3D scene QA on resource-constrained platforms.

cs.CV↗

Reliever: Relieving the Burden of Costly Model Fits for Changepoint Detection

Changepoint detection typically relies on a grid-search strategy for optimal data segmentation. When model fitting itself is expensive, repeatedly fitting a model on every candidate segment dominates the computation. Existing approaches mitigate this by pruning the grid, thus reducing the number of segments (and model fits). We propose Reliever, which instead cuts the number of model fits directly and nests seamlessly within standard grid-search routines. Reliever fits a small, deterministic collection of proxy models and reuses them wherever they apply, making it compatible with a wide range of existing algorithms. For high-dimensional regression with changepoints, coupling Reliever with an optimal grid-search method yields changepoint and coefficient estimators that are rate-optimal up to a logarithmic factor. Extensive numerical experiments demonstrate that Reliever rapidly and accurately detects changepoints across a wide range of high-dimensional and nonparametric models.

stat.ME↗

Changepoint Detection in Complex Models: Cross-Fitting Is Needed

Changepoint detection is commonly formulated by minimizing the sum of in-sample losses to quantify the model's overall fit. However, for flexible modeling procedures -- especially those involving high-dimensional parameter spaces or hyperparameter tuning -- this strategy can lead to inaccurate changepoint estimation due to over-adaptivity biases. To mitigate this issue, we propose a novel cross-fitting methodology based on out-of-sample loss evaluations, which decouples model fitting from changepoint search. We establish a general theoretical framework for consistent changepoint estimation under mild conditions, and further extend it to temporally dependent data. A key implication of the theory is that consistency depends primarily on the models' predictive accuracy over nearly homogeneous segments. Numerical experiments show that the proposed method substantially improves the reliability and adaptability of changepoint detection in complex scenarios.

stat.ME↗

A double-exponential lower bound for $r_4(5,n)$

The Ramsey number $r_k(s,n)$ is the smallest integer $N$ such that every $N$-vertex $k$-graph contains either a copy of $K_s^{(k)}$ or an independent set of size $n$. We prove that $r_4(5,n)\ge 2^{2^{cn^{1/7}}}$, where $c>0$ is an absolute constant. As a consequence, we determine the tower growth rate of $r_k(k+1,n)$, which completely solves the problem of establishing the tower growth rate for all classical off-diagonal hypergraph Ramsey numbers, first posed by Erdős and Hajnal in 1972.

math.CO↗

Hindsight Preference Optimization for Financial Time Series Advisory

Time series models predict numbers; decision-makers need advisory -- directional signals with reasoning, actionable suggestions, and risk management. Training language models for such predictive advisory faces a fundamental challenge: quality depends on outcomes unknown at prediction time. We bridge two ideas from reinforcement learning -- using information unavailable during execution to retrospectively generate training signal, and preference alignment -- and propose Hindsight Preference Optimization: observed outcomes let an LLM judge rank candidate advisories on dimensions that scalar metrics cannot capture, producing preference pairs for DPO without human annotation. We apply this to Vision-Language-Model-based predictive advisories on S&P 500 equity time series, demonstrated by a 4B model outperforming its 235B teacher on both accuracy and advisory quality.

cs.LG↗

Analysis of Efficient Scheduling in Layered Decoding of GLDPC Codes

In this study, we investigate the characteristics of scheduling sequences that enable efficient decoding of generalized low-density parity-check (GLDPC) codes under the layered message-passing algorithm. In particular, we show that scheduling sequences leading to higher decoding efficiency should prioritize the update of constraint nodes corresponding to subcodes with larger minimum distance, fewer minimum-weight codewords, and shorter code length. Based on these characteristics, we design a scheduling algorithm, which further demonstrates the effectiveness of these characteristics through simulation experiments.

cs.IT↗

Beyond ZOH: Advanced Discretization Strategies for Vision Mamba

Vision Mamba, as a state space model (SSM), employs a zero-order hold (ZOH) discretization, which assumes that input signals remain constant between sampling instants. This assumption degrades temporal fidelity in dynamic visual environments and constrains the attainable accuracy of modern SSM-based vision models. In this paper, we present a systematic and controlled comparison of six discretization schemes instantiated within the Vision Mamba framework: ZOH, first-order hold (FOH), bilinear/Tustin transform (BIL), polynomial interpolation (POL), higher-order hold (HOH), and the fourth-order Runge-Kutta method (RK4). We evaluate each method on standard visual benchmarks to quantify its influence in image classification, semantic segmentation, and object detection. Our results demonstrate that POL and HOH yield the largest gains in accuracy at the cost of higher training-time computation. In contrast, the BIL provides consistent improvements over ZOH with modest additional overhead, offering the most favorable trade-off between precision and efficiency. These findings elucidate the pivotal role of discretization in SSM-based vision architectures and furnish empirically grounded justification for adopting BIL as the default discretization baseline for state-of-the-art SSM models.

cs.CV↗

Transversal Structures in Graph Systems: A Survey

Given a system $\mathcal{G} =\{G_1,G_2,\dots,G_m\}$ of graphs/digraphs/hypergraphs on the common vertex set $V$ of size $n$, an $m$-edge graph/digraph/hypergraph $H$ on $V$ is transversal in $\mathcal{G}$ if there exists a bijection $ϕ:E(H)\rightarrow [m]$ such that $e \in E(G_{ϕ(e)})$ for all $e\in E(H)$. In this survey, we consider extremal problems for transversal structures in graph systems. More precisely, we summarize some sufficient conditions that ensure the existence of transversal structures in graph/digraph/hypergraph systems, which generalize several classical theorems in extremal graph theory to transversal version. We also include a number of conjectures and open problems.

math.CO↗

Transversal Hamilton cycles in digraph collections

Given a collection $\mathcal{D} =\{D_1,D_2,\ldots,D_m\}$ of digraphs on the common vertex set $V$, an $m$-edge digraph $H$ with vertices in $V$ is \textit{transversal} in $\mathcal{D}$ if there exists a bijection $φ:E(H)\rightarrow [m]$ such that $e \in E(D_{φ(e)})$ for all $e\in E(H)$. Ghouila-Houri proved that any $n$-vertex digraph with minimum semi-degree at least $\frac{n}{2}$ contains a directed Hamilton cycle. In this paper, we provide a transversal generalization of Ghouila-Houri's theorem, thereby solving a problem proposed by Chakraborti, Kim, Lee and Seo. Our proof utilizes the absorption method for transversals, the regularity method for digraph collections, as well as the transversal blow-up lemma and the related machinery. As an application, when $n$ is sufficiently large, our result implies the transversal version of Dirac's theorem, which was proved by Joos and Kim.

math.CO↗

From Debate to Decision: Conformal Social Choice for Safe Multi-Agent Deliberation

Multi-agent debate improves LLM reasoning, yet agreement among agents is not evidence of correctness. When agents converge on a wrong answer through social reinforcement, consensus-based stopping commits that error to an automated action with no recourse. We introduce Conformal Social Choice, a post-hoc decision layer that converts debate outputs into calibrated act-versus-escalate decisions. Verbalized probability distributions from heterogeneous agents are aggregated via a linear opinion pool and calibrated with split conformal prediction, yielding prediction sets with a marginal coverage guarantee: the correct answer is included with probability ${\geq}\,1{-}α$, without assumptions on individual model calibration. A hierarchical action policy maps singleton sets to autonomous action and larger sets to human escalation. On eight MMLU-Pro domains with three agents (Claude Haiku, DeepSeek-R1, Qwen-3 32B), coverage stays within 1--2 points of the target. The key finding is not that debate becomes more accurate, but that the conformal layer makes its failures actionable: 81.9% of wrong-consensus cases are intercepted at $α{=}0.05$. Because the layer refuses to act on cases where debate is confidently wrong, the remaining conformal singletons reach 90.0--96.8% accuracy (up to 22.1pp above consensus stopping) -- a selection effect, not a reasoning improvement. This safety comes at the cost of automation, but the operating point is user-adjustable via $α$.

cs.AI↗

A Note on Generalized Erdős-Rogers Problems

For a $k$-uniform hypergraph $F$ and positive integers $s$ and $N$, the generalized Erdős-Rogers function $f^{(k)}_{F,s}(N)$ denotes the largest integer $m$ such that every $K_s^{(k)}$-free $k$-graph on $N$ vertices contains an $F$-free induced subgraph on $m$ vertices. In particular, if $F = K^{(k)}_t$, then we write $f^{(k)}_{t,s}(N)$ for $f^{(k)}_{F,s}(N)$. Mubayi and Suk (\emph{J. London. Math. Soc. 2018}) conjectured that $f^{(4)}_{5,6}(N)=(\log \log N)^{Θ(1)}$. Motivated by this conjecture, we prove that $f^{(4)}_{5^{-},6}(N)=(\log\log N)^{Θ(1)}$, where $5^{-}$ denotes the $4$-graph obtained from $K_5^{(4)}$ by deleting one edge. Our proof combines a probabilistic construction of a $2$-coloring of pairs with a stepping-up construction and an analysis of multi-layer local extremum structures. Furthermore, we derive an upper bound for a more general Erdős-Rogers function, which implies the lower bound $r_4(6,n)\ge 2^{2^{cn^{1/2}}}$. By applying a variant of the Erdős-Hajnal stepping-up lemma due to Mubayi and Suk, we also slightly improve the lower bound for $r_k(k+2,n)$.

math.CO↗

Tackling Over-smoothing on Hypergraphs: A Ricci Flow-guided Neural Diffusion Approach

Hypergraph neural networks (HGNNs) have demonstrated strong capabilities in modeling complex higher-order relationships. However, existing HGNNs often suffer from over-smoothing as the number of layers increases and lack effective control over message passing among nodes. Inspired by the theory of Ricci flow in differential geometry, we theoretically establish that introducing discrete Ricci flow into hypergraph structures can effectively regulate node feature evolution and thereby alleviate over-smoothing. Building on this insight, we propose Ricci Flow-guided Hypergraph Neural Diffusion(RFHND), a novel message passing paradigm for hypergraphs guided by discrete Ricci flow. Specifically, RFHND is based on a PDE system that describes the continuous evolution of node features on hypergraphs and adaptively regulates the rate of information diffusion at the geometric level, preventing feature homogenization and producing high-quality node representations. Experimental results show that RFHND significantly outperforms existing methods across multiple benchmark datasets and demonstrates strong robustness, while also effectively mitigating over-smoothing.

cs.LG↗

Verified Multi-Agent Orchestration: A Plan-Execute-Verify-Replan Framework for Complex Query Resolution

We present Verified Multi-Agent Orchestration (VMAO), a framework that coordinates specialized LLM-based agents through a verification-driven iterative loop. Given a complex query, our system decomposes it into a directed acyclic graph (DAG) of sub-questions, executes them through domain-specific agents in parallel, verifies result completeness via LLM-based evaluation, and adaptively replans to address gaps. The key contributions are: (1) dependency-aware parallel execution over a DAG of sub-questions with automatic context propagation, (2) verification-driven adaptive replanning that uses an LLM-based verifier as an orchestration-level coordination signal, and (3) configurable stop conditions that balance answer quality against resource usage. On 25 expert-curated market research queries, VMAO improves answer completeness from 3.1 to 4.2 and source quality from 2.6 to 4.1 (1-5 scale) compared to a single-agent baseline, demonstrating that orchestration-level verification is an effective mechanism for multi-agent quality assurance.

cs.AI↗

A step towards the Erdős-Rogers problem

For $2\le k\le t<s$, the Erdős-Rogers function $f^{(k)}_{t,s}(N)$ denotes the largest $m$ such that every $K^{(k)}_s$-free $k$-graph on $N$ vertices contains a $K^{(k)}_t$-free induced subgraph on $m$ vertices. Mubayi and Suk (J. London Math. Soc. 2018) conjectured that $f^{(k)}_{k+1,k+2}(N)=(\log_{(k-2)}N)^{Θ(1)}$ for $k\ge 4$, where $\log_{(i)}$ denotes the $i$-fold iterated logarithm. This is equivalent to the statement that $f^{(k)}_{k+1,s}(N)=(\log_{(k-2)}N)^{Θ(1)}$ for every $s\ge k+2$. In this paper, we introduce multi-color patterns into a random construction of a $2$-graph to build a $4$-graph, and for the first time, combine them with multi-layer extremum structures to prove that $f^{(4)}_{5,s}(N)=(\log \log N)^{Θ(1)}$ for every $s\ge 11$. More generally, using a variant of the Erdős-Hajnal stepping-up lemma, we also establish that $f^{(k)}_{k+1,s}(N)=(\log_{(k-2)}N)^{Θ(1)}$ for every $s\ge k+7$.

math.CO↗

Extremal problems in uniformly dense hypergraphs and digraphs

The uniform Turán density $π_{u}(F)$ of a $3$-uniform hypergraph (or $3$-graph) $F$ is the supremum of all $d$ such that there exist infinitely many $F$-free $3$-graphs $H$ in which every induced subhypergraph on a linearly sized vertex set has edge density at least $d$. Determining $π_{u}(F)$ for a given $3$-graph $F$ was proposed by Erdős and Sós in the 1980s, yet only a few cases are known. In particular, it remains open whether $1/2$ can occur as a value of $π_{u}$. In this paper, we establish a novel connection between Turán-type extremal problems for digraphs and uniform Turán densities of $3$-graphs. Using digraph extremal results, we give the first verifiable conditions for $3$-graphs $F$ with $π_{u}(F) = (r-1)/r$ and $π_{u}(F) = (r-1)^2/r^2$ for all $r \ge 2$, and identify the corresponding $3$-graphs. In particular, these $3$-graph classes contain some specific $3$-graphs, such as $K^{(3)-}_4$. We also present a sufficient condition ensuring $π_{u}(F)=4/27$ and construct $3$-graphs satisfying it; in particular, our examples are different from the tight $3$-uniform cycles whose uniform Turán density $4/27$ was determined in [{Trans. Amer. Math. Soc. 376 (2023), 4765-4809}]. Finally, we give a short proof of the existence of $3$-graphs $F$ with $π_{u}(F)=1/27$, originally established by Garbe, Král' and Lamaison [{Israel J. Math. 259 (2024), 701-726}] via the hypergraph regularity method.

math.CO↗

Feedback Does Not Increase the Capacity of Approximately Memoryless Surjective POST Channels

We study a class of finite-state channels, known as POST channels, in which the previous channel output serves as the current state. A POST channel is deemed approximately memoryless when the state-dependent transition matrices are sufficiently close to one another. For this family of channels, under a surjectivity condition on the associated memoryless reference channel, we show that the feedback capacity coincides with the non-feedback capacity. Consequently, for almost all approximately memoryless POST channels whose input alphabet size is no smaller than the output alphabet size, feedback provides no capacity gain. This result extends Shannon's classical theorem on discrete memoryless channels and demonstrates that the phenomenon holds well beyond the strictly memoryless case.

cs.IT↗

Hydrodynamic limit of rarefaction wave for the Vlasov-Maxwell-Landau system with Coulomb potential

In this paper, we investigate the hydrodynamic limit of rarefaction wave for the two-species Vlasov-Maxwell-Landau(VML) system with Coulomb potential. We prove that for any given time interval, the solution of the Vlasov-Maxwell-Landau system with appropriate initial data converges to a rarefaction wave as the Knudsen number $ε$ approaches zero. The main difficulty in the analysis lies in the loss of dissipation in the interaction between the electromagnetic field and the microscopic component, and the weak dissipation induced by the Lorentz force and the scaling with small parameter $ε$. For this, we introduce a velocity weight function and a space-time scaling parameter together with suitable $ε$-dependent energy estimates.

math.AP↗

Stability with minuscule structure for chromatic thresholds

The chromatic threshold $δ_χ(H)$ of a graph $H$ is the infimum of $d>0$ such that the chromatic number of every $n$-vertex $H$-free graph with minimum degree at least $d n$ is bounded by a constant depending only on $H$ and $d$. Allen, B{ö}ttcher, Griffiths, Kohayakawa, and Morris determined the chromatic threshold for every $H$; in particular, they showed that if $χ(H)=r\ge 3$, then $δ_χ(H) \in\{\frac{r-3}{r-2},~\frac{2 r-5}{2 r-3},~\frac{r-2}{r-1}\}$. While the chromatic thresholds have been completely determined, rather surprisingly the structural behaviors of extremal graphs near the threshold remain unexplored. In this paper, we establish the stability theorems for chromatic threshold problems. We prove that every $n$-vertex $H$-free graph $G$ with $δ(G)\ge (δ_χ(H)-o(1))n$ and $χ(G)=ω(1)$ must be structurally close to one of the extremal configurations. Furthermore, we give a stronger stability result when $H$ is a clique, showing that $G$ admits a partition into independent sets and a small subgraph on sublinear number of vertices. We show that this small subgraph has fractional chromatic number $2+o(1)$ and is homomorphic to a Kneser graph defined by subsets of a logarithmic size set; both these two bounds are best possible. This is the first stability result that captures the lower-order structural features of extremal graphs. We also study two variations of chromatic thresholds. Replacing chromatic number by its fractional counterpart, we determine the fractional chromatic thresholds for all graphs. Another variation is the bounded-VC chromatic thresholds, which was introduced by Liu, Shangguan, Skokan, and Xu very recently. Extending work of Łuczak and Thomass{é} on the triangle case, we determine the bounded-VC chromatic thresholds for all cliques.

math.CO↗