SearcharxivSearch

arXiv · 1705.00970

Inference of a Dyadic Measure and its Simplicial Geometry from Binary Feature Data and Application to Data Quality

Abstract

We propose a new method for representing data sets with a set of binary feature functions. We compute both the dyadic set structure determined by an order on the binary features together with the canonical product coefficient parameters for the associated dyadic measure and a variant of a nerve simplicial complex determined by the support of the dyadic measure together with its betti numbers. The product coefficient parameters characterize the relative skewness of the dyadic measure at dyadic scales and localities. The more abstract betti number statistics summarize the simplicial geometry of the support of the measure and satisfy a differential privacy property. Both types of statistics can be computed algorithmically from the binary feature representation of the data. This representation provides a new method for pre-processing data into automatically generated features which explicitly characterize the dyadic statistics and geometry of the data. useful for statistical fusion, decision-making, inference, multi-scale hypothesis testing and visualization. We illustrated the methods on a data quality data set. We exploit a representation lemma for dyadic measures on the unit interval (Fefferman, Kenig and Pipher) reformulated for measures on dyadic sets by Bassu, Jones, Ness and Shallcross. We prove that dyadic sets with dyadic measures have a canonical set of binary features and determine canonical nerve simplicial complexes. We compare our methods with other results for measures on sets with tree structures, recent multi-resolution theory, and persistent homology and suggest links to differential privacy, Bayesian reasoning and algebraic statistics.

Explore related subjects

Keep this discovery

BibTeXRIS

Linda Ness. 2017-04-29. Inference of a Dyadic Measure and its Simplicial Geometry from Binary Feature Data and Application to Data Quality. https://arxiv.org/abs/1705.00970

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

On the log-concavity of the composite Bessel function $x^{\alpha}J_{\nu }\left( \beta x^{\gamma}\right) $

For a twice differentiable function $f:\left( a,b\right) \rightarrow \mathbb{R}$ define $v\left( f\right) =f^{\prime}f^{\prime}-f^{\prime\prime }f.$ It is well known that the positivity of $v\left( f\right) $ implies that the function $\left\vert f\right\vert $ is strictly log-concave on each subinterval which does not contain zeros of $f.$ In this paper we provide criteria for the positivity of $v\left( F\right) $ for the composite Bessel function $F\left( x\right) =J_{\alpha,\beta,\gamma,\nu}\left( x\right) :=x^{\alpha}J_{\nu}\left( \beta x^{\gamma}\right) $ for positive numbers $\beta$ and $\gamma$ and real numbers $\alpha$ and $\nu.$

math.CA

Riesz capacity ratios with negative exponents

We investigate sharp inequalities for ratios of Riesz capacities with negative exponents by combining computational experiments with rigorous analysis. For finite subsets of the line, we prove positivity of equilibrium masses when $-1<p<0$, enabling numerical tests of conjectured extremal ratios. In the plane, comparisons of the disk with regular polygon vertex sets reveal a cascade of transitions among the tested competitors and suggest a precise conjecture for the equilibrium measure of odd polygons, for which we give a partial proof. Numerical intersections of equality curves show that the regions where these sets outperform the disk are not simply nested. Similar numerical intersections occur in three dimensions between the regular-simplex equality curve and those of explicit five-point and six-point configurations. Motivated by the dimensional dependence of these comparisons, we prove that for each fixed $p<-2<q<0$, the regular simplex has a larger capacity ratio than the ball in all sufficiently large dimensions. Accompanying Python and Mathematica code supports reproduction and further testing of the conjectures.

math.CA

Shorter proof of dimension-free $L^p$ estimates for maximal Riesz transforms

We provide a shorter and more direct proof of $L^p$ estimates for maximal Riesz transforms (of an arbitrary order) in terms of the corresponding Riesz transforms, with a constant independent of the dimension of the Euclidean space $\mathbb R^d$. This result was originally proved by Mateu, Orobitg, P\'erez and Verdera with a constant depending on the dimension, and improved to a dimension-free inequality by Kucharski, Wr\'obel and Zienkiewicz.

math.CA