Searcharxiv⌕ Search

SEARCH · Searcharxiv

Results for “stat.OT”

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8Linked to original sources

Conditional quantile estimation through optimal quantization

In this paper, we use quantization to construct a nonparametric estimator of conditional quantiles of a scalar response $Y$ given a d-dimensional vector of covariates $X$. First we focus on the population level and show how optimal quantization of $X$, which consists in discretizing $X$ by projecting it on an appropriate grid of $N$ points, allows to approximate conditional quantiles of $Y$ given $X$. We show that this is approximation is arbitrarily good as $N$ goes to infinity and provide a rate of convergence for the approximation error. Then we turn to the sample case and define an estimator of conditional quantiles based on quantization ideas. We prove that this estimator is consistent for its fixed-$N$ population counterpart. The results are illustrated on a numerical example. Dominance of our estimators over local constant/linear ones and nearest neighbor ones is demonstrated through extensive simulations in the companion paper Charlier et al.(2014b).

stat.OT↗

The Sociotype, a New Conceptual Construct on Human Social Networks: Application in Mental Health and Quality of Life

The present work discusses the pertinence of a 'sociotype' construct, both theoretically and empirically oriented. The term, based on the conceptual chain genotype-phenotype-sociotype, suggests an evolutionary preference in the human species for some determined averages of social relationships. This core pattern or 'sociotype' has been explored herein for the networking relationships of young people--165 university students filling in a 20-items questionnaire on their social interactions. In spite that this is a preliminary study, interesting results have been obtained on gender conversation time, mental health, sociability level, and satisfaction with personal relationships. This sociotype hypothesis could be a timely enterprise for mental health and quality of life policies.

stat.OT↗

Discussion of "Single and Two-Stage Cross-Sectional and Time Series Benchmarking Procedures for SAE"

We congratulate the authors for a stimulating and valuable manuscript, providing a careful review of the state-of the-art in cross-sectional and time-series benchmarking procedures for small area estimation. They develop a novel two-stage benchmarking method for hierarchical time series models, where they evaluate their procedure by estimating monthly total unemployment using data from the U.S. Census Bureau. We discuss three topics: linearity and model misspecification, computational complexity and model comparisons, and, some aspects on small area estimation in practice. More specifically, we pose the following questions to the authors, that they may wish to answer: How robust is their model to misspecification? Is it time to perhaps move away from linear models of the type considered by (Battese et al. 1988; Fay and Herriot 1979)? What is the asymptotic computational complexity and what comparisons can be made to other models? Should the benchmarking constraints be inherently fixed or should they be random?

stat.OT↗

Statistique et Big Data Analytics; Volumétrie, L'Attaque des Clones

This article assumes acquired the skills and expertise of a statistician in unsupervised (NMF, k-means, SVD) and supervised learning (regression, CART, random forest). What skills and knowledge do a statistician must acquire to reach the "Volume" scale of big data? After a quick overview of the different strategies available and especially of those imposed by Hadoop, the algorithms of some available learning methods are outlined in order to understand how they are adapted to the strong stresses of the Map-Reduce functionalities

stat.OT↗

Bayesian hierarchical modelling for inferring genetic interactions in yeast

Identifying genetic interactions for a given microorganism such as yeast is difficult. Quantitative Fitness Analysis (QFA) is a high-throughput experimental and computational methodology for quantifying the fitness of microbial cultures. QFA can be used to compare between fitness observations for different genotypes and thereby infer genetic interaction strengths. Current "naive" frequentist statistical approaches used in QFA do not model between-genotype variation or difference in genotype variation under different conditions. In this thesis, a Bayesian approach is introduced to evaluate hierarchical models that better reflect the structure or design of QFA experiments. First, a two-stage approach is presented: a hierarchical logistic model is fitted to microbial culture growth curves and then a hierarchical interaction model is fitted to fitness summaries inferred for each genotype. Next, a one-stage Bayesian approach is presented: a joint hierarchical model which does not require a univariate summary of fitness, used to pass information between models. The new hierarchical approaches are then compared using a dataset examining the effect of telomere defects on yeast. By better describing the experimental structure, new evidence is found for genes and complexes which interact with the telomere cap. Various extensions of these models, including models for data transformation, batch effects, and intrinsically stochastic growth models are also considered.

stat.AP↗

Pythagoras at the Bat

The Pythagorean formula is one of the most popular ways to measure the true ability of a team. It is very easy to use, estimating a team's winning percentage from the runs they score and allow. This data is readily available on standings pages; no computationally intensive simulations are needed. Normally accurate to within a few games per season, it allows teams to determine how much a run is worth in different situations. This determination helps solve some of the most important economic decisions a team faces: How much is a player worth, which players should be pursued, and how much should they be offered. We discuss the formula and these applications in detail, and provide a theoretical justification, both for the formula as well as simpler linear estimators of a team's winning percentage. The calculations and modeling are discussed in detail, and when possible multiple proofs are given. We analyze the 2012 season in detail, and see that the data for that and other recent years support our modeling conjectures. We conclude with a discussion of work in progress to generalize the formula and increase its predictive power \emph{without} needing expensive simulations, though at the cost of requiring play-by-play data.

math.HO↗

A mobile web for enhancing statistics and mathematics education

A freely available educational application (a mobile website) is presented. This provides access to educational material and drilling on selected topics within mathematics and statistics with an emphasis on tablets and mobile phones. The application adapts to the student's performance, selecting from easy to difficult questions, or older material etc. These adaptations are based on statistical models and analyses of data from testing precursors of the system within several courses, from calculus and introductory statistics through multiple linear regression. The application can be used in both on-line and off-line modes. The behavior of the application is determined by parameters, the effects of which can be estimated statistically. Results presented include analyses of how the internal algorithms relate to passing a course and general incremental improvement in knowledge during a semester.

stat.OT↗

Using Google Scholar to predict self citation: A case study in Health Economics

Metrics designed to quantify the influence of academics are increasingly used and easily estimable, and perhaps the most popular is the h index. Metrics such as this are however potentially impacted through excessive self citation. This work explores the issue using a group of researchers working in a well defined sub field of economics, namely Health Economics. It then employs self citation identification software, and identifies the characteristics that best predict self citation. This provides evidence regarding the scale of self citation in the field, and the degree to which self citation impacts on inferences about the relative influence of individual Health Economists. Using data from 545 Health Economists, it suggests self citation to be associated with the geographical region and longevity of the Health Economist, with early career researchers and researchers from mainland Europe and Australasia self citing most frequently.

stat.OT↗

Spectrum Estimation: A Unified Framework for Covariance Matrix Estimation and PCA in Large Dimensions

Covariance matrix estimation and principal component analysis (PCA) are two cornerstones of multivariate analysis. Classic textbook solutions perform poorly when the dimension of the data is of a magnitude similar to the sample size, or even larger. In such settings, there is a common remedy for both statistical problems: nonlinear shrinkage of the eigenvalues of the sample covariance matrix. The optimal nonlinear shrinkage formula depends on unknown population quantities and is thus not available. It is, however, possible to consistently estimate an oracle nonlinear shrinkage, which is motivated on asymptotic grounds. A key tool to this end is consistent estimation of the set of eigenvalues of the population covariance matrix (also known as the spectrum), an interesting and challenging problem in its own right. Extensive Monte Carlo simulations demonstrate that our methods have desirable finite-sample properties and outperform previous proposals.

math.ST↗

Using an Online Learning Environment to Teach an Undergraduate Statistics Course: the tutor-web

A learning environment, the tutor-web (http://tutor-web.net), has been developed and used for educational research. The system is accessible and free to use for anyone having access to the Web. It is based on open source software and the teaching material is licensed under the Creative Commons Attribution-ShareAlike License. The system has been used for computer-assisted education in statistics and mathematics. It offers a unique way to structure and link together teaching material and includes interactive quizzes with the primary purpose of increasing learning rather than mere evaluation. The system was used in a course on basic statistics in the University of Iceland, spring 2013. A randomized trial was conducted to investigate the difference in learning between students doing regular homework and students using the system. The difference between the groups was not found to be significant.

stat.OT↗

Which of the world's institutions employ the most highly cited researchers? An analysis of the data from highlycited.com

A few weeks ago, Thomson Reuters published a list of the highly cited researchers worldwide (highlycited.com). Since the data is freely available for downloading and includes the names of the researchers' institutions, we produced a ranking of the institutions on the basis of the number of highly cited researchers per institution. This ranking is intended to be a helpful amendment of other available institutional rankings.

cs.DL↗

Tractable Measure of Component Overlap for Gaussian Mixture Models

The ability to quantify distinctness of a cluster structure is fundamental for certain simulation studies, in particular for those comparing performance of different classification algorithms. The intrinsic integral measure based on the overlap of corresponding mixture components is often analytically intractable. This is also the case for Gaussian mixture models with unequal covariance matrices when space dimension $d > 1$. In this work we focus on Gaussian mixture models and at the sample level we assume the class assignments to be known. We derive a measure of component overlap based on eigenvalues of a generalized eigenproblem that represents Fisher's discriminant task. We explain rationale behind it and present simulation results that show how well it can reflect the behavior of the integral measure in its linear approximation. The analyzed coefficient possesses the advantage of being analytically tractable and numerically computable even in complex setups.

math.ST↗

The Final Solutions of Monty Hall Problem and Three Prisoners Problem

Recently we proposed the linguistic interpretation of quantum mechanics (called quantum and classical measurement theory, or quantum language), which was characterized as a kind of metaphysical and linguistic turn of the Copenhagen interpretation. This turn from physics to language does not only extend quantum theory to classical systems but also yield the quantum mechanical world view (i.e., the philosophy of quantum mechanics, in other words, quantum philosophy).And we believe that this quantum language is the most powerful language to describe science. The purpose of this paper is to describe the Monty-Hall problem and the three prisoners problem in quantum language. We of course believe that our proposal is the final solutions of the two problems. Thus in this paper, we can answer the question: "Why have philosophers continued to stick to these problems?" And the readers will find that these problems are never elementary, and they can not be solved without the deep understanding of "probability" and "dualism". KEY WORDS: Philosophy of probability, Fisher Maximum Likelihood Method, Bayes' Method,The Principle of Equal (a priori) Probabilities

stat.OT↗

The two envelopes paradox in non-Bayesian and Bayesian statistics

The purpose of this paper is to clarify the (non-Bayesian and Bayesian) two-envelope problems in terms of quantum language (or, measurement theory), which was recently proposed as a linguistic turn of quantum mechanics (with the Copenhagen interpretation). The two envelopes paradox is only a kind of high school student's probability puzzle, and it may be exaggerated to say that this is an unsolved problem. However, since we are convinced that quantum language is just statistics of the future, we believe that there is no clear answer without the description by quantum language. In this sense, the readers are to find that quantum language provides the final answer (i.e., the easiest and deepest understanding) to the two envelope-problems in both non-Bayesian and Bayesian statistics. Also, we add the discussion about St. Petersburg two-envelope paradox.

stat.OT↗

Revealing the Beauty behind the Sleeping Beauty Problem

A large number of essays address the Sleeping Beauty problem, which undermines the validity of Bayesian inference and Bas Van Fraassen's 'Reflection Principle'. In this study a straightforward analysis of the problem based on probability theory is presented. The key difference from previous works is that apart from the random experiment imposed by the problem's description, a different one is also considered, in order to negate the confusion on the involved conditional probabilities. The results of the analysis indicate that no inconsistency takes place, whereas both Bayesian inference and 'Reflection Principle' are valid.

stat.OT↗

Differentially Private Exponential Random Graphs

We propose methods to release and analyze synthetic graphs in order to protect privacy of individual relationships captured by the social network. Proposed techniques aim at fitting and estimating a wide class of exponential random graph models (ERGMs) in a differentially private manner, and thus offer rigorous privacy guarantees. More specifically, we use the randomized response mechanism to release networks under $ε$-edge differential privacy. To maintain utility for statistical inference, treating the original graph as missing, we propose a way to use likelihood based inference and Markov chain Monte Carlo (MCMC) techniques to fit ERGMs to the produced synthetic networks. We demonstrate the usefulness of the proposed techniques on a real data example.

stat.OT↗

Tree Oriented Data Analysis

Complex data objects arise in many areas of modern science including evolutionary biology, nueroscience, dynamics of gene expression and medical imaging. Object oriented data analysis (OODA) is the statistical analysis of datasets of complex objects. Data analysis of tree data objects is an exciting research area with interesting questions and challenging problems. This thesis focuses on tree oriented statistical methodologies, and algorithms for solving related mathematical optimization problems. This research is motivated by the goal of analyzing a data set of images of human brain arteries. The approach we take here is to use a novel representation of brain artery systems as points in phylogenetic treespace. The treespace property of unique global geodesics leads to a notion of geometric center called a Fréchet mean. For a sample of data points, the Fréchet function is the sum of squared distances from a point to the data points, and the Fréchet mean is the minimizer of the Fréchet function. In this thesis we use properties of the Fréchet function to develop an algorithmic system for computing Fréchet means. Properties of the Fréchet function are also used to show a sticky law of large numbers which describes a surprising stability of the topological tree structure of sample Fréchet means at that of the population Fréchet mean. We also introduce non-parametric regression of brain artery tree structure as a response variable to age based on weighted Fréchet means.

stat.OT↗

Identifying the number of clusters in discrete mixture models

Research on cluster analysis for categorical data continues to develop, with new clustering algorithms being proposed. However, in this context, the determination of the number of clusters is rarely addressed. In this paper, we propose a new approach in which clustering of categorical data and the estimation of the number of clusters is carried out simultaneously. Assuming that the data originate from a finite mixture of multinomial distributions, we develop a method to select the number of mixture components based on a minimum message length (MML) criterion and implement a new expectation-maximization (EM) algorithm to estimate all the model parameters. The proposed EM-MML approach, rather than selecting one among a set of pre-estimated candidate models (which requires running EM several times), seamlessly integrates estimation and model selection in a single algorithm. The performance of the proposed approach is compared with other well-known criteria (such as the Bayesian information criterion-BIC), resorting to synthetic data and to two real applications from the European Social Survey. The EM-MML computation time is a clear advantage of the proposed method. Also, the real data solutions are much more parsimonious than the solutions provided by competing methods, which reduces the risk of model order overestimation and increases interpretability.

stat.ME↗