Searcharxiv⌕ Search

arXiv subjects

Anand N. Vidyashankar

Publications and source records attributed to Anand N. Vidyashankar.

At least 19 recordsLinked to original sources

Domain Adaptation with Target Information via Doubly-Anchored Distributionally Robust Optimization

Domain Adaptation (DA) often lacks worst-case guarantees, while Distributionally Robust Optimization (DRO) based only on source data centers its ambiguity set at the source law and ignores available target structure. To bridge this gap, we introduce a doubly-anchored DRO framework whose ambiguity set is the intersection of $ϕ$-divergence balls centered at the source law and a source-completed target reference law, the latter pairing the target covariate law with the source conditional law. We derive dual-induced adversarial bridge geometries for symmetric and asymmetric divergence pairings, notably introducing a Kullback--Leibler/squared-Hellinger (KL/HD) bridge. This asymmetric formulation yields a Lambert-$W$ geometry in which source-side exponential risk tilting and target-side Hellinger stabilization enter through distinct terms, attenuating, but not bounding, the effect of large likelihood ratios. Furthermore, without imposing covariate shift, we establish finite-sample generalization bounds for the minimizer of a structural, loss-agnostic density-bridge risk under bounded-overlap conditions; these bounds do not apply directly to the loss-aware DRO min--max estimator. We translate our framework into a bridge-weighted Nadaraya--Watson estimator, proving uniform consistency for the source regression function and pointwise asymptotic normality, with target recovery when the source and target regression functions coincide, as under covariate shift. Finally, an empirical evaluation on a domain-shifted Fashion-MNIST dataset illustrates the finite-sample stability of the asymmetric KL/HD bridge under severe synthetic target-covariate corruption.

stat.ML↗

Large Deviations for Controlled Branching Processes: Random Slopes, Harmonic Moments, and Transfer Principles

Let \(\{X_n:n\ge0\}\) be a controlled branching process with controls \(ϕ_n\), and let \(N_n=ϕ_n(X_n)\) be its progenitor count. We study large deviations of \(X_{n+1}/N_n\), \(N_n/X_n\), and \(X_{n+1}/X_n\), on their natural positive-denominator events, in supercritical and critical regimes. We treat generation-wide random slopes and asymptotically deterministic first-order slopes. For asymptotically affine random-slope controls, an affine recursion and a random environmental product yield a sharp Bahadur--Rao--Petrov upper-tail asymptotic. A positive Cramér tilt identifies the prefactor via a nontrivial normalized limit, and conditional on the upper-deviation event the three ratios concentrate around their environmental centers. With individual-sum controls, the process is an exact branching process in a random environment with immigration (BPREI). Motivated by this connection, we establish sharp upper large-deviation asymptotics for BPREI and transfer its positive-transform and harmonic-moment profiles to the controlled process. In the nondecreasing supercritical case, harmonic moments exhibit an exact environmental--boundary--persistence trichotomy. In a centered finite-variance critical class, finite-horizon-minimum methods yield exact \(n^{-1/2}\)-scale limits for all positive harmonic orders and for the three ratio-deviation probabilities. For deterministic first-order slopes, the environmental-product mechanism disappears. Matched lower and upper probability-generating-function envelopes transfer auxiliary exact-recursion profiles to controls without an exact branching recursion, producing distinct supercritical and critical harmonic-moment trichotomies. Thus the location of first-order randomness determines the lower-tail mechanism, while immigration may change a sharp constant, a phase boundary, or the decay exponent.

math.PR↗

Robust Estimation of Polychoric Correlation for Complex Survey Designs Using Minimum Divergence Methods

Standard maximum likelihood estimation of polychoric correlations is highly sensitive to contamination in survey data, including response errors, interviewer effects, and careless responding, yet assigns equal weight to all observations regardless of data quality. We develop robust estimators for polychoric correlation under complex survey designs based on two minimum divergence criteria -- Hellinger distance (HD) and negative exponential disparity (NED) -- incorporating survey weights through Horvitz--Thompson adjusted cell frequencies. For HD, we propose penalized Ridge and Lasso variants that regularize nuisance parameters while leaving the correlation unpenalized, and establish consistency and asymptotic normality with a sandwich covariance reflecting the sampling design. The influence function is finite but not uniformly bounded, reflecting Hellinger's sensitivity to sparse cells. Simulations under Poisson proportional-to-size sampling examine three contamination geometries -- concordant upper, concordant lower, and discordant mixed corner -- crossed with standard and non-standard latent marginals. The two estimator classes offer complementary advantages: penalized HD methods achieve the lowest mean squared error under concordant contamination, while NED performs best under discordant contamination and under compound misspecification--contamination effects. We provide practical guidelines for method selection based on anticipated contamination patterns in survey practice.

stat.ME↗

Private Minimum Hellinger Distance Estimation via Hellinger Distance Differential Privacy

Objective functions based on Hellinger distance yield robust and efficient estimators of model parameters. Motivated by privacy and regulatory requirements encountered in contemporary applications, we derive in this paper \emph{private minimum Hellinger distance estimators}. The estimators satisfy a new privacy constraint, namely, Hellinger differential privacy, while retaining the robustness and efficiency properties. We demonstrate that Hellinger differential privacy shares several features of standard differential privacy while allowing for sharper inference. Additionally, for computational purposes, we also develop Hellinger differentially private gradient descent and Newton-Raphson algorithms. We illustrate the behavior of our estimators in finite samples using numerical experiments and verify that they retain robustness properties under gross-error contamination.

math.ST↗

Hellinger loss function for Generative Adversarial Networks

We propose Hellinger-type loss functions for training Generative Adversarial Networks (GANs), motivated by the boundedness, symmetry, and robustness properties of the Hellinger distance. We define an adversarial objective based on this divergence and study its statistical properties within a general parametric framework. We establish the existence, uniqueness, consistency, and joint asymptotic normality of the estimators obtained from the adversarial training procedure. In particular, we analyze the joint estimation of both generator and discriminator parameters, offering a comprehensive asymptotic characterization of the resulting estimators. We introduce two implementations of the Hellinger-type loss and we evaluate their empirical behavior in comparison with the classic (Maximum Likelihood-type) GAN loss. Through a controlled simulation study, we demonstrate that both proposed losses yield improved estimation accuracy and robustness under increasing levels of data contamination.

stat.ML↗

Divergence-Minimization for Latent-Structure Models: Monotone Operators, Contraction Guarantees, and Robust Inference

We develop a divergence-minimization (DM) framework for robust and efficient inference in latent-mixture models. By optimizing a residual-adjusted divergence, the DM approach recovers EM as a special case and yields robust alternatives through different divergence choices. We establish that the sample objective decreases monotonically along the iterates, leading the DM sequence to stationary points under standard conditions, and that at the population level the operator exhibits local contractivity near the minimizer. Additionally, we verify consistency and $\sqrt{n}$-asymptotic normality of minimum-divergence estimators and of finitely many DM iterations, showing that under correct specification their limiting covariance matches the Fisher information. Robustness is analyzed via the residual-adjustment function, yielding bounded influence functions and a strictly positive breakdown bound for bounded-RAF divergences, and we contrast this with the non-robust behaviour of KL/EM. Next, we address the challenge of determining the number of mixture components by proposing a penalized divergence criterion combined with repeated sample splitting, which delivers consistent order selection and valid post-selection inference. Empirically, DM instantiations based on Hellinger and negative exponential divergences deliver accurate inference and remain stable under contamination in mixture and image-segmentation tasks. The results clarify connections to MM and proximal-point methods and offer practical defaults, making DM a drop-in alternative to EM for robust latent-structure inference.

math.ST↗

Minimum Hellinger Distance Estimators for Complex Survey Designs

Reliable inference from complex survey samples can be derailed by outliers and high-leverage observations induced by unequal inclusion probabilities and calibration. We develop a minimum Hellinger distance estimator (MHDE) for parametric superpopulation models under complex designs, including Poisson PPS and fixed-size SRS/PPS without replacement, with possibly stochastic post-stratified or calibrated weights. Using a Horvitz-Thompson-adjusted kernel density plug-in, we show: (i) $L^1$-consistency of the KDE with explicit large-deviation tail bounds driven by a variance-adaptive effective sample size; (ii) uniform exponential bounds for the Hellinger affinity that yield MHDE consistency under mild identifiability; (iii) an asymptotic Normal distribution for the MHDE with covariance $\mathbf A^{-1}\boldsymbolΣ\mathbf A^{\intercal}$ (and a finite-population correction under without-replacement designs); and (iv) robustness via the influence function and $α$-influence curves in the Hellinger topology. Simulations under Gamma and lognormal superpopulation models quantify efficiency-robustness trade-offs relative to weighted MLE under independent and high-leverage contamination. An application to NHANES 2021-2023 total water consumption shows that the MHDE remains stable despite extreme responses that markedly bias the MLE. The estimator is simple to implement via quadrature over a fixed grid and is extensible to other divergence families.

math.ST↗

Sharp Large Deviations and Gibbs Conditioning for Threshold Models in Portfolio Credit Risk

We obtain sharp large deviation estimates for exceedance probabilities in dependent triangular array threshold models with a diverging number of latent factors. The prefactors quantify how latent-factor dependence and tail geometry enter at leading order, yielding three regimes: Gaussian or exponential-power tails produce polylogarithmic refinements of the Bahadur-Rao $n^{-1/2}$ law; regularly varying tails yield index-driven polynomial scaling; and bounded-support (endpoint) cases lead to an $n^{-3/2}$ prefactor. We derive these results through Laplace-Olver asymptotics for exponential integrals and conditional Bahadur-Rao estimates for the triangular arrays. Using these estimates, we establish a Gibbs conditioning principle in total variation: conditioned on a large exceedance event, the default indicators become asymptotically i.i.d., and the loss-given-default distribution is exponentially tilted (with the boundary case handled by an endpoint analysis). As illustrations, we obtain second-order approximations for Value-at-Risk and Expected Shortfall, clarifying when portfolios operate in the genuine large-deviation regime. The results provide a transferable set of techniques-localization, curvature, and tilt identification-for sharp rare-event analysis in dependent threshold systems.

math.PR↗

Ancestral Inference and Learning for Branching Processes in Random Environments

Ancestral inference for branching processes in random environments involves determining the ancestor distribution parameters using the population sizes of descendant generations. In this paper, we introduce a new methodology for ancestral inference utilizing the generalized method of moments. We demonstrate that the estimator's behavior is critically influenced by the coefficient of variation of the environment sequence. Furthermore, despite the process's evolution being heavily dependent on the offspring means of various generations, we show that the joint limiting distribution of the ancestor and offspring estimators of the mean, under appropriate centering and scaling, decouple and converge to independent Gaussian random variables when the ratio of the number of generations to the logarithm of the number of replicates converges to zero. Additionally, we provide estimators for the limiting variance and illustrate our findings through numerical experiments and data from Polymerase Chain Reaction experiments and COVID-19 data.

math.ST↗

Grouping predictors via network-wide metrics

When multitudes of features can plausibly be associated with a response, both privacy considerations and model parsimony suggest grouping them to increase the predictive power of a regression model. Specifically, the identification of groups of predictors significantly associated with the response variable eases further downstream analysis and decision-making. This paper proposes a new data analysis methodology that utilizes the high-dimensional predictor space to construct an implicit network with weighted edges %and weights on the edges to identify significant associations between the response and the predictors. Using a population model for groups of predictors defined via network-wide metrics, a new supervised grouping algorithm is proposed to determine the correct group, with probability tending to one as the sample size diverges to infinity. For this reason, we establish several theoretical properties of the estimates of network-wide metrics. A novel model-assisted bootstrap procedure that substantially decreases computational complexity is developed, facilitating the assessment of uncertainty in the estimates of network-wide metrics. The proposed methods account for several challenges that arise in the high-dimensional data setting, including (i) a large number of predictors, (ii) uncertainty regarding the true statistical model, and (iii) model selection variability. The performance of the proposed methods is demonstrated through numerical experiments, data from sports analytics, and breast cancer data.

stat.ME↗

Functional limit laws for the intensity measure of point processes and applications

Motivated by applications to the study of depth functions for tree-indexed random variables generated by point processes, we describe functional limit theorems for the intensity measure of point processes. Specifically, we establish uniform laws of large numbers and uniform central limit theorems over a class of bounded measurable functions for estimates of the intensity measure. Using these results, we derive the uniform asymptotic properties of half-space depth and, as corollaries, obtain the asymptotic behavior of medians and other quantiles of the standardized intensity measure. Additionally, we obtain uniform concentration upper bound for the estimator of half-space depth. As a consequence of our results, we also derive uniform consistency and uniform asymptotic normality of Lotka-Nagaev and Harris-type estimators for the Laplace transform of the point processes in a branching random walk.

math.PR↗

Branching Processes in Random Environments with Thresholds

Motivated by applications to COVID dynamics, we describe a branching process in random environments model $\{Z_n\}$ whose characteristics change when crossing upper and lower thresholds. This introduces a cyclical path behavior involving periods of increase and decrease leading to supercritical and subcritical regimes. Even though the process is not Markov, we identify subsequences at random time points $\{(τ_j, ν_j)\}$ - specifically the values of the process at crossing times, {\it{viz.}}, $\{(Z_{τ_j}, Z_{ν_j})\}$ - along which the process retains the Markov structure. Under mild moment and regularity conditions, we establish that the subsequences possess a regenerative structure and prove that the limiting normal distribution of the growth rates of the process in supercritical and subcritical regimes decouple. For this reason, we establish limit theorems concerning the length of supercritical and subcritical regimes and the proportion of time the process spends in these regimes. As a byproduct of our analysis, we explicitly identify the limiting variances in terms of the functionals of the offspring distribution, threshold distribution, and environmental sequences.

math.PR↗

Analytical and statistical properties of local depth functions motivated by clustering applications

Local general depth ($LGD$) functions are used for describing the local geometric features and mode(s) in multivariate distributions. In this paper, we undertake a rigorous systematic study of $LGD$ and establish several analytical and statistical properties. First, we show that, when the underlying probability distribution is absolutely continuous with density $f(\cdot)$, the scaled version of $LGD$ (referred to as $τ$-approximation) converges, uniformly and in $L^d(\mathbb{R}^p)$ to $f(\cdot)$ when $τ$ converges to zero. Second, we establish that, as the sample size diverges to infinity the centered and scaled sample $LGD$ converge in distribution to a centered Gaussian process uniformly in the space of bounded functions on $\mathcal{H}_G$, a class of functions yielding $LGD$. Third, using the sample version of the $τ$-approximation ($S τA$) and the gradient system analysis, we develop a new clustering algorithm. The validity of this algorithm requires several results concerning the uniform finite difference approximation of the gradient system associated with $S τA$. For this reason, we establish \emph{Bernstein}-type inequality for deviations between the centered and scaled sample $LGD$, which is also of independent interest. Finally, invoking the above results, we establish consistency of the clustering algorithm. Applications of the proposed methods to mode estimation and upper level set estimation are also provided. Finite sample performance of the methodology are evaluated using numerical experiments and data analysis.

math.ST↗

Central limit Theorem for an Adaptive Randomly Reinforced Urn Model

The generalized Pòlya urn (GPU) models and their variants have been investigated in several disciplines. However, typical assumptions made with respect to the GPU do not include urn models with diagonal replacement matrix, which arise in several applications, specifically in clinical trials. To facilitate mathematical analyses of models in these applications, we introduce an adaptive randomly reinforced urn model that uses accruing statistical information to adaptively skew the urn proportion toward specific targets. We study several probabilistic aspects that are important in implementing the urn model in practice. Specifically, we establish the law of large numbers and a central limit theorem for the number of sampled balls. To establish these results, we develop new techniques involving last exit times and crossing time analyses of the proportion of balls in the urn. To obtain precise estimates in these techniques, we establish results on the harmonic moments of the total number of balls in the urn. Finally, we describe our main results in the context an application to response-adaptive randomization in clinical trials. Our simulation experiments in this context demonstrate the ease and scope of our model.

math.PR↗

Rare event simulation for processes generated via stochastic fixed point equations

In a number of applications, particularly in financial and actuarial mathematics, it is of interest to characterize the tail distribution of a random variable $V$ satisfying the distributional equation $V\stackrel{\mathcal{D}}{=}f(V)$, where $f(v)=A\max\{v,D\}+B$ for $(A,B,D)\in(0,\infty)\times {\mathbb{R}}^2$. This paper is concerned with computational methods for evaluating these tail probabilities. We introduce a novel importance sampling algorithm, involving an exponential shift over a random time interval, for estimating these rare event probabilities. We prove that the proposed estimator is: (i) consistent, (ii) strongly efficient and (iii) optimal within a wide class of dynamic importance sampling estimators. Moreover, using extensions of ideas from nonlinear renewal theory, we provide a precise description of the running time of the algorithm. To establish these results, we develop new techniques concerning the convergence of moments of stopped perpetuity sequences, and the first entrance and last exit times of associated Markov chains on $\mathbb{R}$. We illustrate our methods with a variety of numerical examples which demonstrate the ease and scope of the implementation.

math.PR↗

Tail estimates for stochastic fixed point equations via nonlinear renewal theory

This paper presents precise large deviation estimates for solutions to stochastic fixed point equations of the type V =_d f(V), where f(v) = Av + g(v) for a random function g(v) = o(v) a.s. as v tends to infinity. Specifically, we provide an explicit characterization of the pair (C,r) in the tail estimate P(V > u) ~ C u^-r as u tends to infinity, and also present a Lundberg-type upper bound of the form P(V > u) <= D(u) u^-r. To this end, we introduce a novel dual change of measure on a random time interval and analyze the path properties, using nonlinear renewal theory, of the Markov chain resulting from the forward iteration of the given stochastic fixed point equation. In the process, we establish several new results in the realm of nonlinear renewal theory for these processes. As a consequence of our techniques, we also establish a new characterization of the extremal index. Finally, we provide some extensions of our methods to Markov-driven sequences.

math.PR↗

Asymptotic inference for high-dimensional data

In this paper, we study inference for high-dimensional data characterized by small sample sizes relative to the dimension of the data. In particular, we provide an infinite-dimensional framework to study statistical models that involve situations in which (i) the number of parameters increase with the sample size (that is, allowed to be random) and (ii) there is a possibility of missing data. Under a variety of tail conditions on the components of the data, we provide precise conditions for the joint consistency of the estimators of the mean. In the process, we clarify and improve some of the recent consistency results that appeared in the literature. An important aspect of the work presented is the development of asymptotic normality results for these models. As a consequence, we construct different test statistics for one-sample and two-sample problems concerning the mean vector and obtain their asymptotic distributions as a corollary of the infinite-dimensional results. Finally, we use these theoretical results to develop an asymptotically justifiable methodology for data analyses. Simulation results presented here describe situations where the methodology can be successfully applied. They also evaluate its robustness under a variety of conditions, some of which are substantially different from the technical conditions. Comparisons to other methods used in the literature are provided. Analyses of real-life data is also included.

math.ST↗

Weak Convergence Results for Multiple Generations of a Branching Process

We establish limit theorems involving weak convergence of multiple generations of critical and supercritical branching processes. These results arise naturally when dealing with the joint asymptotic behavior of functionals defined in terms of several generations of such processes. Applications of our main result include a functional central limit theorem (CLT), a Darling-Erdös result, and an extremal process result. The limiting process for our functional CLT is an infinite dimensional Brownian motion with sample paths in the infinite product space $(C_0[0,1])^{\infty}$, with the product topology, or in Banach subspaces of $(C_0[0,1])^{\infty}$ determined by norms related to the distribution of the population size of the branching process. As an application of this CLT we obtain a central limit theorem for ratios of weighted sums of generations of a branching processes, and also to various maximums of these generations. The Darling-Erdös result and the application to extremal distributions also include infinite dimensional limit laws. Some branching process examples where the CLT fails are also included.

math.PR↗