SearcharxivSearch

arXiv subjects

James Melbourne

Publications and source records attributed to James Melbourne.

At least 19 recordsLinked to original sources

Optimality of Staircase Mechanisms for Vector Queries under Differential Privacy

We study the optimal design of additive mechanisms for vector-valued queries under $\epsilon$-differential privacy (DP). Given only the sensitivity of a query and a norm-monotone cost function measuring utility loss, we ask which noise distribution minimizes expected cost among all additive $\epsilon$-DP mechanisms. Using convex rearrangement theory, we show that this infinite-dimensional optimization problem admits a reduction to a one-dimensional compact and convex family of radially symmetric distributions whose extreme points are the staircase distributions. As a consequence, we prove that for any dimension, any norm, and any norm-monotone cost function, there exists an $\epsilon$-DP staircase mechanism that is optimal among all additive mechanisms. This result resolves a conjecture of Geng, Kairouz, Oh, and Viswanath, and provides a geometric explanation for the emergence of staircase mechanisms as extremal solutions in differential privacy.

cs.IT

A Quantitative Entropy Power Inequality for Dependent Random Vectors

The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis. Several extensions of the entropy power inequality have been developed for settings with dependence, including by Takano, Johnson, and Rioul. We extend these works by developing a quantitative version of the entropy power inequality for dependent random vectors. A notable consequence is that an entropy power inequality stated using conditional entropies holds for random vectors whose joint density is log-supermodular.

cs.IT

The stability of log-supermodularity under convolution

We study the behavior of log-supermodular functions under convolution. In particular we show that log-concave product densities preserve log-supermodularity, confirming in the special case of the standard Gaussian density, a conjecture of Zartash and Robeva. Additionally, this stability gives a ``conditional'' entropy power inequality for log-supermodular random variables. We also compare the Ahlswede-Daykin four function theorem and a recent four function version of the Prekopa-Leindler inequality due to Cordero-Erausquin and Maurey and giving transport proofs for the two theorems. In the Prekopa-Leindler case, the proof gives a generalization that seems to be new, which interpolates the classical three and the recent four function versions.

math.PR

A note on the Littlewood-Offord problem for discrete log-concave distributions

We present an extension of the famous Littlewood-Offord problem when Bernoulli distributions are replaced with discrete log-concave distributions. A variant of the Littlewood-Offord problem for arithmetic progressions, as well as an entropic version, is also discussed. Along the way, we recover and extend a result of Madiman and Woo (2015) on the entropy power inequality for discrete uniform distributions.

math.PR

On Convex Functions of Gaussian Variables

We investigate a convexity properties for normalized log moment generating function continuing a recent investigation of Chen of convex images of Gaussians. We show that any variable satisfying a ``Ehrhard-like'' property for its distribution function has a strictly convex normalized log moment generating function, unless the variable is Gaussian, in which case affine-ness is achieved. Moreover we characterize variables that satisfy the Ehrhard-like property as the convex images of Gaussians. As applications, we derive sharp comparisons between R\'enyi divergences for a Gaussian and a strongly log-concave variable, and characterize the equality case. We also demonstrate essentially optimal concentration bounds for the sequence of conic intrinsic volumes associated to convex cone and we obtain a reversal of McMullen's inequality between the sum of the (Euclidean) intrinsic volumes associated to a convex body and the body's mean width that generalizes and sharpens a result of Alonso-Hernandez-Yepes.

math.PR

Functional Liftings of Restricted Geometric Inequalities

We investigate what we term "generalized sup-convolutions". We show that functional inequalities that enjoy an interpretation as sup-convolution inequalities can be deduced from the special case of indicator functions corresponding to a geometric inequality. As consequences we derive a Borell-Brascamp Lieb inequality for the Gaussian Brunn-Minkowski inequality and give a functional analog of the log-Brunn Minkowski conjecture. Though we focus on Euclidean applications, our results are general and can be directly applied in more abstract settings, like groups or even topological measure spaces without algebraic structure, we instantiate this claim with a Borell-Brascamp-Lieb type inequality for nilpotent Lie groups.

math.FA

Rearrangements and infimum convolutions

We develop a general comparison result for inf convolution operators related to rearrangement. As a consequence we derive comparison results under spherically symmetric rearrangement for Laplace and polar transforms. As a by product we simplify existing proofs related to the functional Blaschke Santalo inequality of Keith Ball and derive a comparison result for some parabolic PDE.

math.PR

From simplex slicing to sharp reverse H\"older inequalities

Simplex slicing (Webb, 1996) is a sharp upper bound on the volume of central hyperplane sections of the regular simplex. We extend this to sharp bounds in the probabilistic framework of negative moments, and beyond, of centred log-concave random variables, establishing a curious phase transition of the extremising distribution for new sharp reverse H\"older-type inequalities.

math.MG

A R\'enyi entropy interpretation of anti-concentration and noncentral sections of convex bodies

We extend Bobkov and Chistyakov's (2015) upper bounds on concentration functions of sums of independent random variables to a multivariate entropic setting. The approach is based on pointwise estimates on densities of sums of independent random vectors uniform on centred Euclidean balls. In this vein, we also obtain sharp bounds on volumes of noncentral sections of isotropic convex bodies.

math.PR

Curvature and Other Local Inequalities in Markov Semigroups

Inspired by the approach of Ivanisvili and Volberg towards functional inequalities for probability measures with strictly convex potentials, we investigate the relationship between curvature bounds in the sense of Bakry-Emery and local functional inequalities. We will show that not only is the earlier approach for strictly convex potentials extendable to Markov semigroups and simplified through use of the $\Gamma$-calculus, providing a consolidating machinery for obtaining functional inequalities new and old in this general setting, but that a converse also holds. Local inequalities obtained are proven equivalent to Bakry-Emery curvature. Moreover we will develop this technique for metric measure spaces satisfying the RCD condition, providing a unified approach to functional and isoperimetric inequalities in non-smooth spaces with a synthetic Ricci curvature bound. Finally, we are interested in commutation properties for semi-group operators on $\mathbb{R}^n$ in the absence of positive curvature, based on a local eigenvalue criteria.

math.PR

Causal Structure Recovery of Linear Dynamical Systems: An FFT based Approach

Learning causal effects from data is a fundamental and well-studied problem across science, especially when the cause-effect relationship is static in nature. However, causal effect is less explored when there are dynamical dependencies, i.e., when dependencies exist between entities across time. Identifying dynamic causal effects from time-series observations is computationally expensive when compared to the static scenario. We demonstrate that the computational complexity of recovering the causation structure for the vector auto-regressive (VAR) model is $O(Tn^3N^2)$, where $n$ is the number of nodes, $T$ is the number of samples, and $N$ is the largest time-lag in the dependency between entities. We report a method, with a reduced complexity of $O(Tn^3 \log N)$, to recover the causation structure to obtain frequency-domain (FD) representations of time-series. Since FFT accumulates all the time dependencies on every frequency, causal inference can be performed efficiently by considering the state variables as random variables at any given frequency. We additionally show that, for systems with interactions that are LTI, do-calculus machinery can be realized in the FD resulting in versions of the classical single-door (with cycles), front and backdoor criteria. We demonstrate, for a large class of problems, graph reconstruction using multivariate Wiener projections results in a significant computational advantage with $O(n)$ complexity over reconstruction algorithms such as the PC algorithm which has $O(n^q)$ complexity, where $q$ is the maximum neighborhood size. This advantage accrues due to some remarkable properties of the phase response of the frequency-dependent Wiener coefficients which is not present in any time-domain approach.

cs.LG

Minimum entropy of a log-concave variable for fixed variance

We show that for log-concave real random variables with fixed variance the Shannon differential entropy is minimized for an exponential random variable. We apply this result to derive upper bounds on capacities of additive noise channels with log-concave noise. We also improve constants in the reverse entropy power inequalities for log-concave random variables.

math.PR

Quantitative limit theorems via relative log-concavity

In this paper we develop tools for studying limit theorems by means of convexity. We establish bounds for the discrepancy in total variation between probability measures $\mu$ and $\nu$ such that $\nu$ is log-concave with respect to $\mu$. We discuss a variety of applications, which include geometric and binomial approximations to sums of random variables, and discrepancy between Gamma distributions. As special cases we obtain a law of rare events for intrinsic volumes, quantitative bounds on proximity to geometric for infinitely divisible distributions, as well as binomial and Poisson approximation for matroids.

math.PR

On a Conjecture of Feige for Discrete Log-Concave Distributions

A remarkable conjecture of Feige (2006) asserts that for any collection of $n$ independent non-negative random variables $X_1, X_2, \dots, X_n$, each with expectation at most $1$, $$ \mathbb{P}(X < \mathbb{E}[X] + 1) \geq \frac{1}{e}, $$ where $X = \sum_{i=1}^n X_i$. In this paper, we investigate this conjecture for the class of discrete log-concave probability distributions and we prove a strengthened version. More specifically, we show that the conjectured bound $1/e$ holds when $X_i$'s are independent discrete log-concave with arbitrary expectation.

math.PR

Concentration inequalities for log-concave sequences

We investigate quantitative implications of the notion of log-concavity through a probabilistic interpretation. In particular, we derive concentration inequalities, moment and entropy bounds for random variables satisfying a precise degree of log-concavity. Along the way, we recover, improve, and simplify several results existing in the literature. Our approach is based on majorization in the convex order.

math.PR

A discrete complement of Lyapunov's inequality and its information theoretic consequences

We establish a reversal of Lyapunov's inequality for monotone log-concave sequences, settling a conjecture of Havrilla-Tkocz and Melbourne-Tkocz. A strengthened version of the same conjecture is disproved through counter example. We also derive several information theoretic inequalities as consequences. In particular sharp bounds are derived for the varentropy, R\'enyi entropies, and the concentration of information of monotone log-concave random variables. Moreover, the majorization approach utilized in the proof of the main theorem, is applied to derive analogous information theoretic results in the symmetric setting, where the Lyapunov reversal is known to fail.

cs.IT

Transport-majorization to analytic and geometric inequalities

We introduce a transport-majorization argument that establishes a majorization in the convex order between two densities, based on control of the gradient of a transportation map between them. As applications, we give elementary derivations of some delicate Fourier analytic inequalities, which in turn yield geometric "slicing-inequalities" in both continuous and discrete settings. As a further consequence of our investigation we prove that any strongly log-concave probability density majorizes the Gaussian density and thus the Gaussian density maximizes the R\'enyi and Tsallis entropies of all orders among all strongly log-concave densities.

math.FA