Searcharxiv⌕ Search

arXiv subjects

Mehmet Siddik Cadirci

Publications and source records attributed to Mehmet Siddik Cadirci.

7 recordsLinked to original sources

Bootstrap-Calibrated Spectral Divergence Tests for Online Detection of Covariance Matrix Changes

A covariance matrix rarely distorts in a single direction: a shift can expand all variances simultaneously, shift variance along one or two principal directions, displace spectral mass without changing marginal means, or rotate the dependence structure. Default mean-shift detectors are blind to these effects, and no existing online procedure calibrates a family of spectral deviation tests with provable false alarm control across both time and tracking window selection; this paper fills that gap. We consider four spectral deviations: $D_{KL}(P_{1}\|P_{0})$, $D_{KL}(P_{0}\|P_{1})$, Jeffreys, and Bhattacharyya, each evaluated on the eigenvalues of the empirical relative covariance operator $\widehatΣ_{0}^{-1/2}\widehatΣ_{t}\widehatΣ_{0}^{-1/2}$. Critical values come from a conditional parametric bootstrap that accounts for estimation uncertainty in both the past and tracking windows, an aspect asymptotic approaches typically overlook. The procedure controls the false alarm rate family-by-family over a predefined monitoring period and a range of candidate window sizes; when a single operational window is needed, a power-based criterion selects it. We prove consistency under constant alternatives via local spectral expansions with second-order sensitivity near the null. Simulations are conservative under the null and show detection power depends largely on spectral shape rather than magnitude: $D_{KL}(P_{1}\|P_{0})$ excels under global inflation, while Jeffreys and Bhattacharyya cover a broader range of alternatives. We illustrate the approach on three financial applications: European stock indices, Fama-French sector portfolios, and large-cap technology stocks.

stat.ME↗

Entropy-Based Goodness-of-Fit Tests for Generalized $κ$ -Gaussian Distributions

We introduce this class of multivariate Kappa-Gaussian distributions by maximizing a type of Kaniadakis $κ$ entropy subject to certain first- and second-moment constraints. This differs slightly from the approach of Rényi and Tsallis, because the $κ$-entropy arises from a relativity-consistent deformation of the exponential and logarithmic functions and yields a family of distributions whose tails follow a power law, a family that actually reverts to the standard Gaussian distribution as $κ\to 0$. We then create a $k$-nearest-neighbor (NN) estimator for $κ$-entropy and describe it using the difference between two NN functionals involving sums of powers. Next, we establish $L^2$-consistency and asymptotic normality, using the well-known subadditive Euclidean functional and moment expansion framework for NN entropy estimators. Furthermore, using a scaling identity for the $κ$-exponential, we derive a closed-form formula for the entropy of the $κ$-Gaussian distribution itself. From this, we determine the exact threshold value $κ< 2/(m+2)$ at which the distribution preserves finite variance; this is analogous to the ``degrees of freedom $>2$'' condition in the Student's-$t$ distribution. With these components, we construct a non-parametric goodness-of-fit test and then verify it through simulations. Finally, we mention the Sharma--Mittal entropy, which combines the Rényi and Tsallis entropies as a natural direction for future work.

math.ST↗

A New Estimator of Kullback--Leibler Divergence via Shannon Entropy

We examine the estimation of the Kullback-Leibler (KL) divergence and the use of the goodness-of-fit test for multivariate continuous distributions. Our starting point is the maximum entropy principle for Shannon entropy: among all distributions with a fixed mean vector and covariance matrix, the multivariate Gaussian distributions uniquely maximize entropy. As a result, the KL divergence from a moment-matched Gaussian distribution to an unknown density can then be written as the \emph{entropy difference}, which is a suitable information-theoretic measure of divergence from the Gaussian distribution. To estimate, we use $k$-nearest neighbor (kNN) estimators based on Shannon entropy and KL divergence derived from the Kozachenko-Leonenko approach and subsequent improvements, along with the consistency and $L^{2}$-convergence results established for these estimators. Motivated by previous entropy-based goodness-of-fit ideas developed for Rényi-type functionals under generalized Gaussian and Student-type models, we describe a KL-based test statistic as being the difference between (i) the entropy of a Gaussian model fitted to the sample mean and covariance and (ii) the KL divergence between the unknown entropy and the kNN estimate. The statistic converges to zero under multivariate normality and converges to a strictly positive bound under non-Gaussian alternatives. Results from Monte Carlo simulations on various dimensions and sample sizes indicate that the proposed procedure achieves accurate Type I error control and accurate, generally superior power compared to conventional multivariate tests of normality, particularly at medium and high dimensions.

math.ST↗

Statistical tests based on Renyi entropy estimation

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability distribution. In this paper we propose goodness-of-fit statistics for the multivariate Student and multivariate Pearson type II distributions, based on the maximum entropy principle and a class of estimators for Renyi entropy based on nearest neighbour distances. We prove the L2-consistency of these statistics using results on the subadditivity of Euclidean functionals on nearest neighbour graphs, and investigate their rate of convergence and asymptotic distribution using Monte Carlo methods.

stat.ME↗

Statistical tests based on Rényi entropy estimation

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability distribution. In this paper we propose goodness-of-fit statistics for the multivariate Student and multivariate Pearson type II distributions, based on the maximum entropy principle and a class of estimators for Rényi entropy based on nearest neighbour distances. We prove the L^2-consistency of these statistics using results on the subadditivity of Euclidean functionals on nearest neighbour graphs, and investigate their rate of convergence and asymptotic distribution using Monte Carlo methods. In addition we present a novel iterative method for estimating the shape parameter of the multivariate Student and multivariate Pearson type II distributions.

math.ST↗

The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond

We introduce some new classes of unimodal rotational invariant directional distributions, which generalize von Mises-Fisher distribution. We propose three types of distributions, one of which represents axial data. For each new type we provide formulae and short computational study of parameter estimators by the method of moments and the method of maximum likelihood. The main goal of the paper is to develop the goodness of fit test to detect that sample entries follow one of the introduced generalized von Mises--Fisher distribution based on the maximum entropy principle. We use $k$th nearest neighbour distances estimator of Shannon entropy and prove its $L^2$-consistency. We examine the behaviour of the test statistics, find critical values and compute power of the test on simulated samples. We apply the goodness of fit test to local fiber directions in a glass fibre reinforced composite material and detect the samples which follow axial generalized von Mises--Fisher distribution.

math.ST↗

Entropy-based test for generalized Gaussian distributions

In this paper, we provide the proof of $L^2$ consistency for the $k$th nearest neighbour distance estimator of the Shannon entropy for an arbitrary fixed $k\geq 1.$ We construct the non-parametric test of goodness-of-fit for a class of introduced generalized multivariate Gaussian distributions based on a maximum entropy principle. The theoretical results are followed by numerical studies on simulated samples.

math.ST↗