SearcharxivSearch

arXiv subjects

Ching-Fang Li

Publications and source records attributed to Ching-Fang Li.

2 recordsLinked to original sources

Improved Bounds on Access-Redundancy Tradeoffs in Quantized Linear Computations

Consider the problem of computing quantized linear functions with only a few queries. Formally, given $\mathbf{x}\in \mathbb{R}^k$, our goal is to encode $\mathbf{x}$ as $\mathbf{c} \in \mathbb{R}^n$, for $n > k$, so that for any $\mathbf{w} \in A^k$, $\mathbf{w}^T \mathbf{x}$ can be computed using at most $\ell$ queries to $\mathbf{c}$. Here, $A$ is some finite set; in this paper we focus on the case where $|A| = 2$. Prior work \emph{(Ramkumar, Raviv, and Tamo, Trans. IT, 2024)} has given constructions and established impossibility results for this problem. We give improved impossibility results, both for the general problem, and for the specific class of construction (block construction) presented in that work. The latter establishes that the block constructions of prior work are optimal within that class. We also initiate the study of \emph{approximate} recovery for this problem, where the goal is not to recover $\mathbf{w}^T \mathbf{x}$ exactly but rather to approximate it up to a parameter $\varepsilon > 0$. We give several constructions, and give constructions for $\varepsilon = 0.1$ that outperform our impossibility result for exact schemes.

cs.IT

A Unified Study on Sequentiality in Universal Classification with Empirically Observed Statistics

In the binary hypothesis testing problem, it is well known that sequentiality in taking samples eradicates the trade-off between two error exponents, yet implementing the optimal test requires the knowledge of the underlying distributions, say $P_0$ and $P_1$. In the scenario where the knowledge of distributions is replaced by empirically observed statistics from the respective distributions, the gain of sequentiality is less understood when subject to universality constraints over all possible $P_0,P_1$. In this work, the gap is mended by a unified study on sequentiality in the universal binary classification problem, where the universality constraints are set on the expected stopping time as well as the type-I error exponent. The type-I error exponent is required to achieve a pre-set distribution-dependent constraint $\lambda(P_0,P_1)$ for all $P_0,P_1$. Under the proposed framework, different sequential setups are investigated so that fair comparisons can be made with the fixed-length counterpart. By viewing these sequential classification problems as special cases of a general sequential composite hypothesis testing problem, the optimal type-II error exponents are characterized. Specifically, in the general sequential composite hypothesis testing problem subject to universality constraints, upper and lower bounds on the type-II error exponent are proved, and a sufficient condition for which the bounds coincide is given. The results for sequential classification problems are then obtained accordingly. With the characterization of the optimal error exponents, the benefit of sequentiality is shown both analytically and numerically by comparing the sequential and the fixed-length cases in representative examples of type-I exponent constraint $\lambda$.

cs.IT