SearcharxivSearch

arXiv subjects

Congyi Luo

Publications and source records attributed to Congyi Luo.

3 recordsLinked to original sources

Entropy concavity for log-concave random variables: an asymmetric counterexample

The Ball-Nayar-Tkocz entropy concavity conjecture asserts that, if $X,Y$ are independent identically distributed real random variables with a common log-concave density, then the differential entropy of their weighted sum, \[ F(t)=h\bigl(\sqrt{1-t}\,X+\sqrt t\,Y\bigr),\qquad 0\le t\le1, \] is a concave function of the weight parameter $t$. We construct an asymmetric, strictly positive smooth probability density $f$ with mean zero, variance one, and $(\log f)''<-1/2$, for which the corresponding function satisfies $F''(t)>0$ throughout an endpoint neighborhood $0 0$ and $J_3<0$, and explicit remainder estimates verify the constructed density and its endpoint curvature. The counterexample does not address the conjecture with an additional symmetry assumption.

cs.IT

Cubic spectral cancellation and random geometric graph detection: a quadratic-kernel counterexample

We study whether an observed graph can distinguish a random graph generated by latent geometry from one with independent edges. In the geometric model, vertex positions are independent and uniform on a high-dimensional sphere. Conditional on these positions, edges occur independently, with probabilities determined by a connection function $K$ of the inner products of their endpoints. The comparison model is an Erd\H{o}s-R\'enyi graph with the same edge density. A general spectral conjecture asserts that if the cubic spectral trace, which corresponds to the signed triangle mean, is sufficiently small in the sense that \[ n^3[\operatorname{tr}(\kappa^3)]^2\longrightarrow0, \] where $n$ is the number of vertices and $\kappa$ is the centered and standardized spherical kernel operator, then the total variation distance between the two graph distributions tends to zero. Consequently, the lower limit of the sum of the two error probabilities of any sequence of tests is at least one. We give a counterexample to the formulation allowing dimension-dependent connection functions without monotonicity or a common-sign condition on the spectrum. Our quadratic connection functions are uniformly bounded away from zero and one. Their cubic trace vanishes identically through cancellation between positive and negative eigenvalues, whereas their quartic trace is strictly positive. When $d=\max\{3,\lfloor n^{1/20}\rfloor\}$, a signed four-cycle test has a sum of error probabilities tending to zero, and the total variation distance instead tends to one. A perturbation making the cubic trace strictly nonzero still satisfies the stated cubic-trace condition and yields strong detection. The construction and detection result follow, respectively, from a finite-rank spectral decomposition of the spherical kernel and estimates of the mean and variance of the four-cycle statistic.

math.PR

HeLM: Highlighted Evidence augmented Language Model for Enhanced Table-to-Text Generation

Large models have demonstrated significant progress across various domains, particularly in tasks related to text generation. In the domain of Table to Text, many Large Language Model (LLM)-based methods currently resort to modifying prompts to invoke public APIs, incurring potential costs and information leaks. With the advent of open-source large models, fine-tuning LLMs has become feasible. In this study, we conducted parameter-efficient fine-tuning on the LLaMA2 model. Distinguishing itself from previous fine-tuning-based table-to-text methods, our approach involves injecting reasoning information into the input by emphasizing table-specific row data. Our model consists of two modules: 1) a table reasoner that identifies relevant row evidence, and 2) a table summarizer that generates sentences based on the highlighted table. To facilitate this, we propose a search strategy to construct reasoning labels for training the table reasoner. On both the FetaQA and QTSumm datasets, our approach achieved state-of-the-art results. Additionally, we observed that highlighting input tables significantly enhances the model's performance and provides valuable interpretability.

cs.CL