Searcharxiv⌕ Search

arXiv subjects

Sumit Mukherjee

Publications and source records attributed to Sumit Mukherjee.

At least 73 records · Page 4Linked to original sources

privGAN: Protecting GANs from membership inference attacks at low cost

Generative Adversarial Networks (GANs) have made releasing of synthetic images a viable approach to share data without releasing the original dataset. It has been shown that such synthetic data can be used for a variety of downstream tasks such as training classifiers that would otherwise require the original dataset to be shared. However, recent work has shown that the GAN models and their synthetically generated data can be used to infer the training set membership by an adversary who has access to the entire dataset and some auxiliary information. Current approaches to mitigate this problem (such as DPGAN) lead to dramatically poorer generated sample quality than the original non--private GANs. Here we develop a new GAN architecture (privGAN), where the generator is trained not only to cheat the discriminator but also to defend membership inference attacks. The new mechanism provides protection against this mode of attack while leading to negligible loss in downstream performances. In addition, our algorithm has been shown to explicitly prevent overfitting to the training set, which explains why our protection is so effective. The main contributions of this paper are: i) we propose a novel GAN architecture that can generate synthetic data in a privacy preserving manner without additional hyperparameter tuning and architecture selection, ii) we provide a theoretical understanding of the optimal solution of the privGAN loss function, iii) we demonstrate the effectiveness of our model against several white and black--box attacks on several benchmark datasets, iv) we demonstrate on three common benchmark datasets that synthetic images generated by privGAN lead to negligible loss in downstream performance when compared against non--private GANs.

cs.LG↗

Detecting Structured Signals in Ising Models

In this paper, we study the effect of dependence on detecting a class of signals in Ising models, where the signals are present in a structured way. Examples include Ising Models on lattices, and Mean-Field type Ising Models (Erdős-Rényi, Random regular, and dense graphs). Our results rely on correlation decay and mixing type behavior for Ising Models, and demonstrate the beneficial behavior of criticality in the detection of strictly lower signals. As a by-product of our proof technique, we develop sharp control on mixing and spin-spin correlation for several Mean-Field type Ising Models in all regimes of temperature -- which might be of independent interest.

math.PR↗

Persistence exponents in Markov chains

We prove the existence of the persistence exponent $$\logλ:=\lim_{n\to\infty}\frac{1}{n}\log \mathbb{P}_μ(X_0\in S,\ldots,X_n\in S)$$ for a class of time homogeneous Markov chains $\{X_i\}_{i\geq 0}$ taking values in a Polish space, where $S$ is a Borel measurable set and $μ$ is an initial distribution. Focusing on the case of AR($p$) and MA($q$) processes with $p,q\in \mathbb{N}$ and continuous innovation distribution, we study the existence of $λ$ and its continuity in the parameters of the AR and MA processes, respectively, for $S=\mathbb{R}_{\geq 0}$. For AR processes with log-concave innovation distribution, we prove the strict monotonicity of $λ$. Finally, we compute new explicit exponents in several concrete examples.

math.PR↗

Exact and Asymptotic Results on Coarse Ricci Curvature of Graphs

Ricci curvature was proposed by Ollivier in a general framework of metric measure spaces, and it has been studied extensively in the context of graphs in recent years. In this paper we prove upper bounds for Ollivier's Ricci curvature for bipartite graphs and for the graphs with girth at least 5. We also prove a general lower bound on the Ricci curvature in terms of the size of the maximum matching in an appropriate subgraph. As a consequence, we characterize the Ricci-flat graphs of girth 5. Moreover, using our general lower bound and the Birkhoff-von Neumann theorem, we give a necessary and sufficient condition for the structure of Ricci-flat regular graphs of girth 4. Finally, we obtain the asymptotic Ricci curvature of random bipartite graphs $G(n,n, p)$ and random graphs $G(n, p)$, in various regimes of $p$.

math.CO↗

The Second Moment Phenomenon for Monochromatic Subgraphs

What is the chance that among a group of $n$ friends, there are $s$ friends all of whom have the same birthday? This is the celebrated birthday problem which can be formulated as the existence of a monochromatic $s$-clique $K_s$ ($s$-matching birthdays) in the complete graph $K_n$, where every vertex of $K_n$ is uniformly colored with $365$ colors (corresponding to birthdays). More generally, for a general connected graph $H$, let $T(H, G_n)$ be the number of monochromatic copies of $H$ in a uniformly random coloring of the vertices of the graph $G_n$ with $c_n$ colors. In this paper we show that $T(H, G_n)$ converges to $\mathrm{Pois}(λ)$ whenever $\mathbb E T(H, G_n) \rightarrow λ$ and $\mathrm{Var} T(H, G_n) \rightarrow λ$, that is, the asymptotic Poisson distribution of $T(H, G_n)$ is determined just by the convergence of its mean and variance. Moreover, this condition is necessary if and only if $H$ is a star-graph. In fact, the second-moment phenomenon is a consequence of a more general theorem about the convergence of $T(H,G_n)$ to a finite linear combination of independent Poisson random variables. As an application, we derive the limiting distribution of $T(H, G_n)$, when $G_n\sim G(n, p)$ is the Erd\H os-Rényi random graph. Multiple phase-transitions emerge as $p$ varies from 0 to 1, depending on whether the graph $H$ is balanced or unbalanced.

math.PR↗

Demonstration of quantum delayed-choice experiment on a quantum computer

Wave-particle duality of quantum objects is one of the most striking features of quantum physics and has been widely studied in past decades. Developments of quantum technologies enable us to experimentally realize several quantum phenomena. Observation of wave-particle morphing behavior in the context of the quantum delayed-choice experiment (QDCE) is one of them. Adopting the scheme of QDCE, we demonstrate how the coexistence of wave and particle nature emerges as a consequence of the uncertainty in the quantum controlled experimental setup, using a five-qubit cloud-based quantum processor. We also show that an entanglement-assisted scheme of the same reproduces the predictions of quantum mechanics. We put evidence that a local hidden variable theory is incompatible with quantum mechanical predictions by comparing the variation of intensities obtained from our experiment with hidden variable predictions.

quant-ph↗

Asymptotic Distribution of Bernoulli Quadratic Forms

Consider the random quadratic form $T_n=\sum_{1 \leq u < v \leq n} a_{uv} X_u X_v$, where $((a_{uv}))_{1 \leq u, v \leq n}$ is a $\{0, 1\}$-valued symmetric matrix with zeros on the diagonal, and $X_1,$ $X_2, \ldots, X_n$ are i.i.d. $\mathrm{Ber}(p_n)$. In this paper, we prove various characterization theorems about the limiting distribution of $T_n$, in the sparse regime, where $0 < p_n \ll 1$ such that $\mathbb E(T_n)=O(1).$ The main result is a decomposition theorem showing that distributional limits of $T_n$ is the sum of three components: a mixture which consists of a quadratic function of independent Poisson variables; a linear Poisson mixture, where the mean of the mixture is itself a (possibly infinite) linear combination of independent Poisson random variables; and another independent Poisson component. This is accompanied with a universality result which allows us to replace the Bernoulli distribution with a large class of other discrete distributions. Another consequence of the general theorem is a necessary and sufficient condition for Poisson convergence, where an interesting second moment phenomenon emerges.

math.PR↗

Risks of Using Non-verified Open Data: A case study on using Machine Learning techniques for predicting Pregnancy Outcomes in India

Artificial intelligence (AI) has evolved considerably in the last few years. While applications of AI is now becoming more common in fields like retail and marketing, application of AI in solving problems related to developing countries is still an emerging topic. Specially, AI applications in resource-poor settings remains relatively nascent. There is a huge scope of AI being used in such settings. For example, researchers have started exploring AI applications to reduce poverty and deliver a broad range of critical public services. However, despite many promising use cases, there are many dataset related challenges that one has to overcome in such projects. These challenges often take the form of missing data, incorrectly collected data and improperly labeled variables, among other factors. As a result, we can often end up using data that is not representative of the problem we are trying to solve. In this case study, we explore the challenges of using such an open dataset from India, to predict an important health outcome. We highlight how the use of AI without proper understanding of reporting metrics can lead to erroneous conclusions.

cs.LG↗

Persistence of quantum violation of macrorealism for large spins even under coarsening of measurement times

We investigate quantum violation of macrorealism for multilevel spin systems under the condition of coarsening of measurement times -- i.e., when measurement times have experimental indeterminacy. This is studied together with the effect of coarsening of measurement outcomes for which individual outcomes cannot be unambiguously discriminated. In our treatment, along with different measurement outcomes being clubbed together into two groups in order to model the coarsening of measurement outcomes, importantly, varying degrees of coarsening of measurement time intervals have also been considered. This then reveals that while for a given dimension, the magnitude of quantum violation of macrorealism decreases with the increasing degree of coarsening of measurement times, interestingly, this effect of coarsening of measurement times can be annulled by increasing the dimension of the spin system so that in the limit of large spin, the quantum violation of macrorealism continues to persist. Thus, the result obtained demonstrates that classicality for large spins does not emerge from quantum mechanics in spite of the coarsening of measurement times.

quant-ph↗

Degeneracy in sparse ERGMs with functions of degrees as sufficient statistics

A sufficient criterion for "non-degeneracy" is given for Exponential Random Graph Models on sparse graphs with sufficient statistics which are functions of the degree sequence. This criterion explains why statistics such as alternating $k$-star are non-degenerate, whereas subgraph counts are degenerate. It is further shown that this criterion is "almost" tight. Existence of consistent estimates is then proved for non-degenerate Exponential Random Graph Models.

math.PR↗

Joint estimation of parameters in Ising model

We study joint estimation of the inverse temperature and magnetization parameters $(β,B)$ of an Ising model with a non-negative coupling matrix $A_n$ of size $n\times n$, given one sample from the Ising model. We give a general bound on the rate of consistency of the bi-variate pseudolikelihood estimator. Using this, we show that estimation at rate $n^{-1/2}$ is always possible if $A_n$ is the adjacency matrix of a bounded degree graph. If $A_n$ is the scaled adjacency matrix of a graph whose average degree goes to $+\infty$, the situation is a bit more delicate. In this case estimation at rate $n^{-1/2}$ is still possible if the graph is not regular (in an asymptotic sense). Finally, we show that consistent estimation of both parameters is impossible if the graph is Erdös-Renyi with parameter $p>0$ free of $n$, thus confirming that estimation is harder on approximately regular graphs with large degree.

math.ST↗

Limit Theorems for Monochromatic Stars

Let $T(K_{1, r}, G_n)$ be the number of monochromatic copies of the $r$-star $K_{1, r}$ in a uniformly random coloring of the vertices of the graph $G_n$. In this paper we provide a complete characterization of the limiting distribution of $T(K_{1, r}, G_n)$, in the regime where $\mathbb E(T(K_{1, r}, G_n))$ is bounded, for any growing sequence of graphs $G_n$. The asymptotic distribution is a sum of mutually independent components, each term of which is a polynomial of a single Poisson random variable of degree at most $r$. Conversely, any limiting distribution of $T(K_{1, r}, G_n)$ has a representation of this form. Examples and connections to the birthday problem are discussed.

math.PR↗

Global Testing Against Sparse Alternatives under Ising Models

In this paper, we study the effect of dependence on detecting sparse signals. In particular, we focus on global testing against sparse alternatives for the means of binary outcomes following an Ising model, and establish how the interplay between the strength and sparsity of a signal determines its detectability under various notions of dependence. The profound impact of dependence is best illustrated under the Curie-Weiss model where we observe the effect of a "thermodynamic" phase transition. In particular, the critical state exhibits a subtle "blessing of dependence" phenomenon in that one can detect much weaker signals at criticality than otherwise. Furthermore, we develop a testing procedure that is broadly applicable to account for dependence and show that it is asymptotically minimax optimal under fairly general regularity conditions.

math.ST↗

On Estimation in Tournaments and Graphs under Monotonicity Constraints

We consider the problem of estimating the probability matrix governing a tournament or linkage in graphs from incomplete observations, under the assumption that the probability matrix satisfies natural monotonicity constraints after being permuted in both rows and columns by some latent permutation. This condition is classical in the social sciences literature (see Fishburn(1973)) and has been studied in the statistics literature in recent work (see Chatterjee (2015) and Shah et al. (2016)). In this paper, we investigate in detail a natural estimator which bypasses the need to search over all possible latent permutations and hence is computationally tractable, and derive asymptotic risk bounds for our estimator. In addition, we prove an automatic adaptation property of our estimator for several sub classes of our parameter space which are of natural interest. These sub classes include generalizations of the popular Bradley Terry Model in the Tournament case, the Beta model and Stochastic Block Model in the Graph case, and Holder smooth matrices in the tournament and graph settings.

math.ST↗

Detection Thresholds for the $β$-Model on Sparse Graphs

In this paper we study sharp thresholds for detecting sparse signals in $β$-models for potentially sparse random graphs. The results demonstrate interesting interplay between graph sparsity, signal sparsity, and signal strength. In regimes of moderately dense signals, irrespective of graph sparsity, the detection thresholds mirror corresponding results in independent Gaussian sequence problems. For sparser signals, extreme graph sparsity implies that all tests are asymptotically powerless, irrespective of the signal strength. On the other hand, sharp detection thresholds are obtained, up to matching constants, on denser graphs. The phase transition mentioned above are sharp. As a crucial ingredient, we study a version of the Higher Criticism Test which is provably sharp up to optimal constants in the regime of sparse signals. The theoretical results are further verified by numerical simulations.

math.ST↗

Inference in Ising Models

The Ising spin glass is a one-parameter exponential family model for binary data with quadratic sufficient statistic. In this paper, we show that given a single realization from this model, the maximum pseudolikelihood estimate (MPLE) of the natural parameter is $\sqrt {a_N}$-consistent at a point whenever the log-partition function has order $a_N$ in a neighborhood of that point. This gives consistency rates of the MPLE for ferromagnetic Ising models on general weighted graphs in all regimes, extending the results of Chatterjee (2007) where only $\sqrt N$-consistency of the MPLE was shown. It is also shown that consistent testing, and hence estimation, is impossible in the high temperature phase in ferromagnetic Ising models on a converging sequence of simple graphs, which include the Curie--Weiss model. In this regime, the sufficient statistic is distributed as a weighted sum of independent $χ^2_1$ random variables, and the asymptotic power of the most powerful test is determined. We also illustrate applications of our results on synthetic and real-world network data.

math.ST↗

Persistence of Gaussian processes: non-summable correlations

Suppose the auto-correlations of real-valued, centered Gaussian process $Z(\cdot)$ are non-negative and decay as $ρ(|s-t|)$ for some $ρ(\cdot)$ regularly varying at infinity of order $-α\in [-1,0)$. With $I_ρ(t)=\int_0^t ρ(s)ds$ its primitive, we show that the persistence probabilities decay rate of $ -\log\mathbb{P}(\sup_{t \in [0,T]}\{Z(t)\}<0)$ is precisely of order $(T/I_ρ(T)) \log I_ρ(T)$, thereby closing the gap between the lower and upper bounds of \cite{NR}, which stood as such for over fifty years. We demonstrate its usefulness by sharpening recent results of \cite{Sak} about the dependence on $d$ of such persistence decay for the Langevin dynamics of certain $\grad ϕ$-interface models on $\Z^d$.

math.PR↗

Fixed points and cycle structure of random permutations

Using the recently developed notion of permutation limits this paper derives the limiting distribution of the number of fixed points and cycle structure for any convergent sequence of random permutations, under mild regularity conditions. In particular this covers random permutations generated from Mallows Model with Kendall's Tau, $μ$ random permutations introduced in [11], as well as a class of exponential families introduced in [15].

math.PR↗