Searcharxiv⌕ Search

SEARCH · Searcharxiv

Results for “stat.OT”

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22Linked to original sources

A Probabilistic Proof of the Perron-Frobenius Theorem

The Perron-Frobenius theorem plays an important role in many areas of management science and operations research. This paper provides a probabilistic perspective on the theorem, by discussing a proof that exploits a probabilistic representation of the Perron-Frobenius eigenvalue and eigenvectors in terms of the dynamics of a Markov chain. The proof provides conditions in both the finite-dimensional and infinite-dimensional settings under which the Perron-Frobenius eigenvalue and eigenvectors exist. Furthermore, the probabilistic representations that arise can be used to produce a Monte Carlo algorithm for computing the Perron-Frobenius eigenvalue and eigenvectors that will be explored elsewhere.

math.PR↗

A Conversation with Jon Wellner

Jon August Wellner was born in Portland, Oregon, in August 1945. He received his Bachelor's degree from the University of Idaho in 1968 and his PhD degree from the University of Washington in 1975. From 1975 until 1983 he was an Assistant Professor and Associate Professor at the University of Rochester. In 1983 he returned to the University of Washington, and has remained at the UW as a faculty member since that time. Over the course of a long and distinguished career, Jon has made seminal contributions to a variety of areas including empirical processes, semiparametric theory, and shape-constrained inference, and has co-authored a number of extremely influential books. He has been honored as the Le Cam lecturer by both the IMS (2015) and the French Statistical Society (2017). He is a Fellow of the IMS, the ASA, and the AAAS, and an elected member of the International Statistical Institute. He has served as co-Editor of Annals of Statistics (2001--2003) and Editor of Statistical Science (2010--2013), and President of IMS (2016--2017). In 2010 he was made a Knight of the Order of the Netherlands Lion. In his free time, Jon enjoys mountain climbing and backcountry skiing in the Cascades and British Columbia.

stat.OT↗

On the mathematics of the free-choice paradigm

Chen and Risen pointed out a logical flaw affecting the conclusions of a number of past experiments that used the free-choice paradigm to measure choice-induced attitude change. They went on to design and implement a free-choice experiment that used a novel type of control group in order to avoid this logical pitfall. In this paper, we describe a method by which a free-choice experiment can be correctly conducted even without a control group.

stat.OT↗

Stakes are higher, risk is lower: Citation distributions are more equal in high quality journals

Psychology is a discipline standing at the crossroads of hard and social sciences. Therefore it is especially interesting to study bibliometric characteristics of psychology journals. We also take two adjacent disciplines, neurosciences and sociology. One is closer to hard sciences, another is a social science. We study not the journal citedness itself (impact factor etc.) but the citation distribution across papers within journals. This is, so to say, "indicators of the second order" which measure the digression from the journal's average of the citations received by individual papers. As is shown, such information about journals may also help authors to correct their publication strategies.

cs.DL↗

On Some Integral Means

Harmonic, Geometric, Arithmetic, Heronian and Contraharmonic means have been studied by many mathematicians. In 2003, H. Evens studied these means from geometrical point of view and established some of the inequalities between them in using a circle and its radius. In 1961, E. Beckenback and R. Bellman introduced several inequalities corresponding to means. In this paper, we will introduce the concept of mean functions and integral means and give bounds on some of these mean functions and integral means.

stat.OT↗

A Bayesian GED-Gamma stochastic volatility model for return data: a marginal likelihood approach

Several studies explore inferences based on stochastic volatility (SV) models, taking into account the stylized facts of return data. The common problem is that the latent parameters of many volatility models are high-dimensional and analytically intractable, which means inferences require approximations using, for example, the Markov Chain Monte Carlo or Laplace methods. Some SV models are expressed as a linear Gaussian state-space model that leads to a marginal likelihood, reducing the dimensionality of the problem. Others are not linearized, and the latent parameters are integrated out. However, these present a quite restrictive evolution equation. Thus, we propose a Bayesian GED-Gamma SV model with a direct marginal likelihood that is a product of the generalized Student's t-distributions in which the latent states are related across time through a stationary Gaussian evolution equation. Then, an approximation is made for the prior distribution of log-precision/volatility, without the need for model linearization. This also allows for the computation of the marginal likelihood function, where the high-dimensional latent states are integrated out and easily sampled in blocks using a smoothing procedure. In addition, extensions of our GED-Gamma model are easily made to incorporate skew heavy-tailed distributions. We use the Bayesian estimator for the inference of static parameters, and perform a simulation study on several properties of the estimator. Our results show that the proposed model can be reasonably estimated. Furthermore, we provide case studies of a Brazilian asset and the pound/dollar exchange rate to show the performance of our approach in terms of fit and prediction. Keywords: SV model, New sequential and smoothing procedures, Generalized Student's t-distribution, Non-Gaussian errors, Heavy tails, Skewness

q-fin.ST↗

Non-Gaussian Stochastic Volatility Model with Jumps via Gibbs Sampler

In this work, we propose a model for estimating volatility from financial time series, extending the non-Gaussian family of space-state models with exact marginal likelihood proposed by Gamerman, Santos and Franco (2013). On the literature there are models focused on estimating financial assets risk, however, most of them rely on MCMC methods based on Metropolis algorithms, since full conditional posterior distributions are not known. We present an alternative model capable of estimating the volatility, in an automatic way, since all full conditional posterior distributions are known, and it is possible to obtain an exact sample of parameters via Gibbs Sampler. The incorporation of jumps in returns allows the model to capture speculative movements of the data, so that their influence does not propagate to volatility. We evaluate the performance of the algorithm using synthetic and real data time series. Keywords: Financial time series, Stochastic volatility, Gibbs Sampler, Dynamic linear models.

q-fin.ST↗

Game time: statistical contests in the classroom

We describe a contest in variable selection which was part of a statistics course for graduate students. In particular, the possibility to create a contest themselves offered an additional challenge for more advanced students. Since working with data is becoming more important in teaching statistics, we greatly encourage other instructors to try the same.

stat.OT↗

Perspective from the Literature on the Role of Expert Judgment in Scientific and Statistical Research and Practice

This article, produced as a result of the Symposium on Statistical Inference, is an introduction to the literature on the function of expertise, judgment, and choice in the practice of statistics and scientific research. In particular, expert judgment plays a critical role in conducting Frequentist hypothesis tests and Bayesian models, especially in selection of appropriate prior distributions for model parameters. The subtlety of interpreting results is also discussed. Finally, external recommendations are collected for how to more effectively encourage proper use of judgment in statistics. The paper synthesizes the literature for the purpose of creating a single reference and inciting more productive discussions on how to improve the future of statistics and science.

stat.OT↗

Inter-Rater: Software for analysis of inter-rater reliability by permutating pairs of multiple users

Inter-Rater quantifies the reliability between multiple raters who evaluate a group of subjects. It calculates the group quantity, Fleiss kappa, and it improves on existing software by keeping information about each user and quantifying how each user agreed with the rest of the group. This is accomplished through permutations of user pairs. The software was written in Python, can be run in Linux, and the code is deposited in Zenodo and GitHub. This software can be used for evaluation of inter-rater reliability in systematic reviews, medical diagnosis algorithms, education applications, and others.

stat.OT↗

The distortion principle for insurance pricing: properties, identification and robustness

Distortion (Denneberg 1990) is a well known premium calculation principle for insurance contracts. In this paper, we study sensitivity properties of distortion functionals w.r.t. the assumptions for risk aversion as well as robustness w.r.t. ambiguity of the loss distribution. Ambiguity is measured by the Wasserstein distance. We study variances of distances for probability models and identify some worst case distributions. In addition to the direct problem we also investigate the inverse problem, that is how to identify the distortion density on the basis of observations of insurance premia.

q-fin.RM↗

Transmission of Macroeconomic Shocks to Risk Parameters: Their uses in Stress Testing

In this paper, we are interested in evaluating the resilience of financial portfolios under extreme economic conditions. Therefore, we use empirical measures to characterize the transmission process of macroeconomic shocks to risk parameters. We propose the use of an extensive family of models, called General Transfer Function Models, which condense well the characteristics of the transmission described by the impact measures. The procedure for estimating the parameters of these models is described employing the Bayesian approach and using the prior information provided by the impact measures. In addition, we illustrate the use of the estimated models from the credit risk data of a portfolio.

stat.AP↗

Modeling longitudinal data using matrix completion

In clinical practice and biomedical research, measurements are often collected sparsely and irregularly in time while the data acquisition is expensive and inconvenient. Examples include measurements of spine bone mineral density, cancer growth through mammography or biopsy, a progression of defective vision, or assessment of gait in patients with neurological disorders. Since the data collection is often costly and inconvenient, estimation of progression from sparse observations is of great interest for practitioners. From the statistical standpoint, such data is often analyzed in the context of a mixed-effect model where time is treated as both a fixed-effect (population progression curve) and a random-effect (individual variability). Alternatively, researchers analyze Gaussian processes or functional data where observations are assumed to be drawn from a certain distribution of processes. These models are flexible but rely on probabilistic assumptions, require very careful implementation, specific to the given problem, and tend to be slow in practice. In this study, we propose an alternative elementary framework for analyzing longitudinal data, relying on matrix completion. Our method yields estimates of progression curves by iterative application of the Singular Value Decomposition. Our framework covers multivariate longitudinal data, regression, and can be easily extended to other settings. As it relies on existing tools for matrix algebra it is efficient and easy to implement. We apply our methods to understand trends of progression of motor impairment in children with Cerebral Palsy. Our model approximates individual progression curves and explains 30% of the variability. Low-rank representation of progression trends enables identification of different progression trends in subtypes of Cerebral Palsy.

stat.ML↗

Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection

We consider two recent suggestions for how to perform an empirically motivated Monte Carlo study to help select a treatment effect estimator under unconfoundedness. We show theoretically that neither is likely to be informative except under restrictive conditions that are unlikely to be satisfied in many contexts. To test empirical relevance, we also apply the approaches to a real-world setting where estimator performance is known. Both approaches are worse than random at selecting estimators which minimise absolute bias. They are better when selecting estimators that minimise mean squared error. However, using a simple bootstrap is at least as good and often better. For now researchers would be best advised to use a range of estimators and compare estimates for robustness.

econ.EM↗

Can everyday AI be ethical. Fairness of Machine Learning Algorithms

Combining big data and machine learning algorithms, the power of automatic decision tools induces as much hope as fear. Many recently enacted European legislation (GDPR) and French laws attempt to regulate the use of these tools. Leaving aside the well-identified problems of data confidentiality and impediments to competition, we focus on the risks of discrimination, the problems of transparency and the quality of algorithmic decisions. The detailed perspective of the legal texts, faced with the complexity and opacity of the learning algorithms, reveals the need for important technological disruptions for the detection or reduction of the discrimination risk, and for addressing the right to obtain an explanation of the auto- matic decision. Since trust of the developers and above all of the users (citizens, litigants, customers) is essential, algorithms exploiting personal data must be deployed in a strict ethical framework. In conclusion, to answer this need, we list some ways of controls to be developed: institutional control, ethical charter, external audit attached to the issue of a label.

stat.OT↗

Markov Properties of Discrete Determinantal Point Processes

Determinantal point processes (DPPs) are probabilistic models for repulsion. When used to represent the occurrence of random subsets of a finite base set, DPPs allow to model global negative associations in a mathematically elegant and direct way. Discrete DPPs have become popular and computationally tractable models for solving several machine learning tasks that require the selection of diverse objects, and have been successfully applied in numerous real-life problems. Despite their popularity, the statistical properties of such models have not been adequately explored. In this note, we derive the Markov properties of discrete DPPs and show how they can be expressed using graphical models.

math.ST↗

I can see clearly now: reinterpreting statistical significance

Null hypothesis significance testing remains popular despite decades of concern about misuse and misinterpretation. We believe that much of the problem is due to language: significance testing has little to do with other meanings of the word "significance". Despite the limitations of null-hypothesis tests, we argue here that they remain useful in many contexts as a guide to whether a certain effect can be seen clearly in that context (e.g. whether we can clearly see that a correlation or between-group difference is positive or negative). We therefore suggest that researchers describe the conclusions of null-hypothesis tests in terms of statistical "clarity" rather than statistical "significance". This simple semantic change could substantially enhance clarity in statistical communication.

stat.OT↗

Helix modelling through the Mardia-Holmes model framework and an extension of the Mardia-Holmes model

For noisy two-dimensional data, which are approximately uniformly distributed near the circumference of an ellipse, Mardia and Holmes (1980) developed a model to fit the ellipse. In this paper we adapt their methodology to the analysis of helix data in three dimensions. If the helix axis is known, then the Mardia-Holmes model for the circular case can be fitted after projecting the helix data onto the plane normal to the helix axis. If the axis is unknown, an iterative algorithm has been developed to estimate the axis. The methodology is illustrated using simulated protein alpha-helices. We also give a multivariate version of the Mardia-Holmes model which will be applicable for fitting an ellipsoid and in particular a cylinder.

stat.OT↗