SearcharxivSearch

arXiv subjects

Debbie Lim

Publications and source records attributed to Debbie Lim.

10 recordsLinked to original sources

A Hierarchy for Constant Communication Complexity

Similarly to the Chomsky hierarchy, we offer a classification of communication complexity measures such that these measures are organized into equivalence classes. Different from previous attempts of this endeavor, we consider two communication complexity measures as equivalent, if, when one is constant, then the other is constant as well, and vice versa. Most previous considerations of similar topics have been using polylogarithmic input length as a defining characteristic of equivalence. In this paper, two measures ${\cal C}_1, {\cal C}_2$ are constant-equivalent, if and only if for all total Boolean (families of) functions $f:\{0, 1\}^n\times\{0, 1\}^n\rightarrow \{0, 1\}$ we have ${\cal C}_1(f)=O(1)$ if and only if ${\cal C}_2(f)=O(1)$. We identify five equivalence classes according to the above equivalence relation. Interestingly, the classification is counter-intuitive in that powerful models of communication are grouped with weak ones, and seemingly weaker models end up on the top of the hierarchy.

cs.CC

Expressivity Limits in Quantum Walk-based Optimization

Quantum algorithms have emerged as a promising tool to solve combinatorial optimization problems. The quantum walk optimization algorithm (QWOA) is one such variational approach that has recently gained attention. In the broader context of variational quantum algorithms (VQAs), understanding the expressivity of the ansatz has proven critical for evaluating their performance. A key method to study this aspect involves analyzing the dimension of the dynamic Lie algebra (DLA). In this work, we derive novel upper bounds on the DLA dimension for QWOA applied to arbitrary optimization problems. Specifically, we show that the DLA dimension scales at most quadratically with the number of distinct eigenvalues of the problem Hamiltonian. As a consequence, our bound guarantees a polynomial DLA dimension with respect to the input size for optimization problems in the class $\mathsf{NPO}\text{-}\mathsf{PB}$. This result, coupled with recently established performance bounds for QWOA, allows us to identify complexity-theoretic conditions under which QWOA must be overparameterized to obtain optimal or approximate solutions for $\mathsf{NPO}\text{-}\mathsf{PB}$ problems.

quant-ph

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model

We propose novel classical and quantum online algorithms for learning finite- and infinite-horizon Markov Decision Processes (MDPs). Our algorithms are based on a hybrid online-offline reinforcement learning model wherein the agent can, from time to time, freely interact with the environment in a generative sampling fashion, i.e., by having access to a "simulator". By employing known classical and new quantum algorithms for approximating optimal policies under a generative model within our learning algorithms, we show that it is possible to avoid several paradigms from RL like "optimism in the face of uncertainty" and "posterior sampling" and instead compute and use optimal policies directly, which yields better regret bounds compared to previous works. Our quantum algorithms obtain regret bounds which only a $\operatorname{poly}\log{T}$ dependence on the number of time steps $T$, thus breaking the $O(\sqrt{T})$ classical barrier. Our infinite-horizon discounted regret bound is brand new, while in the finite- and infinite-horizon undiscounted settings, our results match the time dependence of some prior quantum works, but with improved dependence on other parameters like state space size $S$ and action space size $A$.

cs.LG

Quantum Algorithm for Apprenticeship Learning

Apprenticeship learning is a method commonly used to train artificial intelligence systems to perform tasks that are challenging to specify directly using traditional methods. Based on the work of Abbeel and Ng (ICML'04), we present a quantum algorithm for apprenticeship learning via inverse reinforcement learning. As an intermediate step, we give a classical approximate apprenticeship learning algorithm to demonstrate the speedup obtained by our quantum algorithm. We prove convergence guarantees on our classical approximate apprenticeship learning algorithm, which also extends to our quantum apprenticeship learning algorithm. We also show that, as compared to its classical counterpart, our quantum algorithm achieves an improvement in the per-iteration time complexity by a quadratic factor in the dimension of the feature vectors $k$ and the size of the action space $A$.

quant-ph

Quantum Algorithm for Sparse Online Learning with Truncated Gradient Descent

Logistic regression, the Support Vector Machine (SVM), and least squares are well-studied methods in the statistical and computer science community, with various practical applications. High-dimensional data arriving on a real-time basis makes the design of online learning algorithms that produce sparse solutions essential. The seminal work of \hyperlink{cite.langford2009sparse}{Langford, Li, and Zhang (2009)} developed a method to obtain sparsity via truncated gradient descent, showing a near-optimal online regret bound. Based on this method, we develop a quantum sparse online learning algorithm for logistic regression, the SVM, and least squares. Given efficient quantum access to the inputs, we show that a quadratic speedup in the time complexity with respect to the dimension of the problem is achievable, while maintaining a regret of $O(1/\sqrt{T})$, where $T$ is the number of iterations.

cs.LG

Quantum Algorithms for the Pathwise Lasso

We present a novel quantum high-dimensional linear regression algorithm with an $\ell_1$-penalty based on the classical LARS (Least Angle Regression) pathwise algorithm. Similarly to available classical algorithms for Lasso, our quantum algorithm provides the full regularisation path as the penalty term varies, but quadratically faster per iteration under specific conditions. A quadratic speedup on the number of features $d$ is possible by using the simple quantum minimum-finding subroutine from D\"urr and Hoyer (arXiv'96) in order to obtain the joining time at each iteration. We then improve upon this simple quantum algorithm and obtain a quadratic speedup both in the number of features $d$ and the number of observations $n$ by using the approximate quantum minimum-finding subroutine from Chen and de Wolf (ICALP'23). In order to do so, we approximately compute the joining times to be searched over by the approximate quantum minimum-finding subroutine. As another main contribution, we prove, via an approximate version of the KKT conditions and a duality gap, that the LARS algorithm (and therefore our quantum algorithm) is robust to errors. This means that it still outputs a path that minimises the Lasso cost function up to a small error if the joining times are only approximately computed. Furthermore, we show that, when the observations are sampled from a Gaussian distribution, our quantum algorithm's complexity only depends polylogarithmically on $n$, exponentially better than the classical LARS algorithm, while keeping the quadratic improvement on $d$. Moreover, we propose a dequantised version of our quantum algorithm that also retains the polylogarithmic dependence on $n$, albeit presenting the linear scaling on $d$ from the standard LARS algorithm. Finally, we prove query lower bounds for classical and quantum Lasso algorithms.

quant-ph

Hybrid Quantum-Classical Algorithm For Robust Optimization via Stochastic-Gradient Online Learning

Optimization theory has been widely studied in academia and finds a large variety of applications in industry. The different optimization models in their discrete and/or continuous settings have catered to a rich source of research problems. Robust convex optimization is a branch of optimization theory in which the variables or parameters involved have a certain level of uncertainty. In this work, we consider the online robust optimization meta-algorithm by Ben-Tal et al. and show that for a large range of stochastic subgradients, this algorithm has the same guarantee as the original non-stochastic version. We develop a hybrid quantum-classical version of this algorithm and show that an at most quadratic improvement in terms of the dimension can be achieved. The speedup is due to the use of quantum state preparation, quantum norm estimation, and quantum multi-sampling. We apply our quantum meta-algorithm to examples such as robust linear programs and robust semidefinite programs and give applications of these robust optimization problems in finance and engineering.

quant-ph

A Quantum Online Portfolio Optimization Algorithm

Portfolio optimization plays a central role in finance to obtain optimal portfolio allocations that aim to achieve certain investment goals. Over the years, many works have investigated different variants of portfolio optimization. Portfolio optimization also provides a rich area to study the application of quantum computers to obtain advantages over classical computers. In this work, we give a sampling version of an existing classical online portfolio optimization algorithm by Helmbold et al., for which we in turn develop a quantum version. The quantum advantage is achieved by using techniques such as quantum state preparation, inner product estimation and multi-sampling. Our quantum algorithm provides a quadratic speedup in the time complexity, in terms of $n$, where $n$ is the number of assets in the portfolio. The transaction cost of both of our classical and quantum algorithms is independent of $n$ which is especially useful for practical applications with a large number of assets.

quant-ph

The aBc Problem and Equator Sampling Renyi Divergences

We investigate the problem of approximating the product $a^TBc$, where $a,c\in S^{n-1}$ and $B\in O_n$, in models of communication complexity and streaming algorithms. The worst meaningful approximation is to simply decide whether the product is 1 or -1, given the promise that it is either. We call that problem the aBc problem. This is a modification of computing approximate inner products, by allowing a basis change. While very efficient streaming algorithms and one-way communication protocols are known for simple inner products (approximating $a^Tc$) we show that no efficient one-way protocols/streaming algorithms exist for the aBc problem. In communication complexity we consider the 3-player number-in-hand model. 1) In communication complexity $a^TBc$ can be approximated within additive error $\epsilon$ with communication $O(\sqrt n/\epsilon^2)$ by a one-way protocol Charlie to Bob to Alice. 2) The $aBc$ problem has a streaming algorithm that uses space $O(\sqrt n \log n)$. 3) Any one-way communication protocol for $aBc$ needs communication at least $\Omega(n^{1/3})$, and we prove a tight results regarding a communication tradeoff: if Charlie and Bob communicate over many rounds such that Charlie communicates $o(n^{2/3})$ and Bob $o(n^{1/3})$, and then the transcript is sent to Alice, the error will be large. 4) To establish our lower bound we show concentration results for Renyi divergences under the event of restricting a density function on the sphere to a random equator and subsequently normalizing the restricted density function. This extends previous results by Klartag and Regev for set sizes to Renyi divergences of arbitrary density functions. 5) We show a strong concentration result for conditional Renyi divergences on bipartite systems for all $\alpha>1$.

cs.CC

The Power of One Clean Qubit in Communication Complexity

We study quantum communication protocols, in which the players' storage starts out in a state where one qubit is in a pure state, and all other qubits are totally mixed (i.e. in a random state), and no other storage is available (for messages or internal computations). This restriction on the available quantum memory has been studied extensively in the model of quantum circuits, and it is known that classically simulating quantum circuits operating on such memory is hard when the additive error of the simulation is exponentially small (in the input length), under the assumption that the polynomial hierarchy does not collapse. We study this setting in communication complexity. The goal is to consider larger additive error for simulation-hardness results, and to not use unproven assumptions. We define a complexity measure for this model that takes into account that standard error reduction techniques do not work here. We define a clocked and a semi-unclocked model, and describe efficient simulations between those. We characterize a one-way communication version of the model in terms of weakly unbounded error communication complexity. Our main result is that there is a quantum protocol using one clean qubit only and using $O(\log n)$ qubits of communication, such that any classical protocol simulating the acceptance behaviour of the quantum protocol within additive error $1/poly(n)$ needs communication $\Omega(n)$. We also describe a candidate problem, for which an exponential gap between the one-clean-qubit communication complexity and the randomized complexity is likely to hold, and hence a classical simulation of the one-clean-qubit model within {\em constant} additive error might be hard in communication complexity. We describe a geometrical conjecture that implies the lower bound.

quant-ph