arXiv subjects

Yen-Chi Chen

Publications and source records attributed to Yen-Chi Chen.

At least 55 records · Page 3Linked to original sources

arXiv2019

Algorithms and Statistical Models for Scientific Discovery in the Petabyte Era

The field of astronomy has arrived at a turning point in terms of size and complexity of both datasets and scientific collaboration. Commensurately, algorithms and statistical models have begun to adapt --- e.g., via the onset of artificial intelligence --- which itself presents new challenges and opportunities for growth. This white paper aims to offer guidance and ideas for how we can evolve our technical and collaborative frameworks to promote efficient algorithmic development and take advantage of opportunities for scientific discovery in the petabyte era. We discuss challenges for discovery in large and complex data sets; challenges and requirements for the next stage of development of statistical methodologies and algorithmic tool sets; how we might change our paradigms of collaboration and education; and the ethical implications of scientists' contributions to widely applicable algorithms and computational modeling. We start with six distinct recommendations that are supported by the commentary following them. This white paper is related to a larger corpus of effort that has taken place within and around the Petabytes to Science Workshops (https://petabytestoscience.github.io/).

astro-ph.IM↗

arXiv2019

Importance Sampling and its Optimality for Stochastic Simulation Models

We consider the problem of estimating an expected outcome from a stochastic simulation model. Our goal is to develop a theoretical framework on importance sampling for such estimation. By investigating the variance of an importance sampling estimator, we propose a two-stage procedure that involves a regression stage and a sampling stage to construct the final estimator. We introduce a parametric and a nonparametric regression estimator in the first stage and study how the allocation between the two stages affects the performance of the final estimator. We analyze the variance reduction rates and derive oracle properties of both methods. We evaluate the empirical performances of the methods using two numerical examples and a case study on wind turbine reliability evaluation.

stat.ME↗

arXiv2019

A statistical framework for measuring the temporal stability of human mobility patterns

Despite the growing popularity of human mobility studies that collect GPS location data, the problem of determining the minimum required length of GPS monitoring has not been addressed in the current statistical literature. In this paper we tackle this problem by laying out a theoretical framework for assessing the temporal stability of human mobility based on GPS location data. We define several measures of the temporal dynamics of human spatiotemporal trajectories based on the average velocity process, and on activity distributions in a spatial observation window. We demonstrate the use of our methods with data that comprise the GPS locations of 185 individuals over the course of 18 months. Our empirical results suggest that GPS monitoring should be performed over periods of time that are significantly longer than what has been previously suggested. Furthermore, we argue that GPS study designs should take into account demographic groups. KEYWORDS: Density estimation; global positioning systems (GPS); human mobility; spatiotemporal trajectories; temporal dynamics

stat.OT↗

arXiv2019

Nonparametric Inference via Bootstrapping the Debiased Estimator

In this paper, we propose to construct confidence bands by bootstrapping the debiased kernel density estimator (for density estimation) and the debiased local polynomial regression estimator (for regression analysis). The idea of using a debiased estimator was recently employed by Calonico et al. (2018b) to construct a confidence interval of the density function (and regression function) at a given point by explicitly estimating stochastic variations. We extend their ideas of using the debiased estimator and further propose a bootstrap approach for constructing simultaneous confidence bands. This modified method has an advantage that we can easily choose the smoothing bandwidth from conventional bandwidth selectors and the confidence band will be asymptotically valid. We prove the validity of the bootstrap confidence band and generalize it to density level sets and inverse regression problems. Simulation studies confirm the validity of the proposed confidence bands/sets. We apply our approach to an Astronomy dataset to show its applicability

stat.ME↗

arXiv2019

Alignment between filaments and galaxy spins from the MaNGA integral-field survey

Halos and galaxies acquire their angular momentum during the collapse of surrounding large-scale structure. This process imprints alignments between galaxy spins and nearby filaments and sheets. Low mass halos grow by accretion onto filaments, aligning their spins with the filaments, whereas high mass halos grow by mergers along filaments, generating spins perpendicular to the filament. We search for this alignment signal using filaments identified with the "Cosmic Web Reconstruction" algorithm applied to the Sloan Digital Sky Survey Main Galaxy Sample and galaxy spins from the MaNGA integral-field unit survey. MaNGA produces a map of the galaxy's rotational velocity, allowing direct measurement of the galaxy's spin direction, or unit angular momentum vector projected onto the sky. We find no evidence for alignment between galaxy spins and filament directions. We do find hints of a mass-dependent alignment signal, which is in 2-3$σ$ tension with the mass-dependent alignment signal in the MassiveBlack-II and Illustris hydrodynamical simulations. However, the tension vanishes when galaxy spin is measured using the H$α$ emission line velocity rather than stellar velocity. Finally, in simulations we find that the mass-dependent transition from aligned to anti-aligned dark matter halo spins is not necessarily present in stellar spins: we find a stellar spin transition in Illustris but not in MassiveBlack-II, highlighting the sensitivity of spin-filament alignments to feedback prescriptions and subgrid physics.

astro-ph.GA↗

arXiv2019

Nonparametric Pattern-Mixture Models for Inference with Missing Data

Pattern-mixture models provide a transparent approach for handling missing data, where the full-data distribution is factorized in a way that explicitly shows the parts that can be estimated from observed data alone, and the parts that require identifying restrictions. We introduce a nonparametric estimator of the full-data distribution based on the pattern-mixture model factorization. Our approach uses the empirical observed-data distribution and augments it with a nonparametric estimator of the missing-data distributions under a given identifying restriction. Our results apply to a large class of donor-based identifying restrictions that encompasses commonly used ones and can handle both monotone and nonmonotone missingness. We propose a Monte Carlo procedure to derive point estimates of functionals of interest, and the bootstrap to construct confidence intervals.

stat.ME↗

arXiv2019

The detection of the imprint of filaments on cosmic microwave background lensing

Galaxy redshift surveys, such as 2dF, SDSS, 6df, GAMA and VIPERS, have shown that the spatial distribution of matter forms a rich web, known as the cosmic web. The majority of galaxy survey analyses measure the amplitude of galaxy clustering as a function of scale, ignoring information beyond a small number of summary statistics. Since the matter density field becomes highly non-Gaussian as structure evolves under gravity, we expect other statistical descriptions of the field to provide us with additional information. One way to study the non-Gaussianity is to study filaments, which evolve non-linearly from the initial density fluctuations produced in the primordial Universe. In our study, we report the first detection of CMB (Cosmic Microwave Background) lensing by filaments and we apply a null test to confirm our detection. Furthermore, we propose a phenomenological model to interpret the detected signal and we measure how filaments trace the matter distribution on large scales through filament bias, which we measure to be around 1.5. Our study provides a new scope to understand the environmental dependence of galaxy formation. In the future, the joint analysis of lensing and Sunyaev-Zel'dovich observations might reveal the properties of `missing baryons', the vast majority of the gas which resides in the intergalactic medium and has so far evaded most observations.

astro-ph.CO↗

arXiv2019

Detecting Galaxy-Filament Alignments in the Sloan Digital Sky Survey III

Previous studies have shown the filamentary structures in the cosmic web influence the alignments of nearby galaxies. We study this effect in the LOWZ sample of the Sloan Digital Sky Survey using the "Cosmic Web Reconstruction" filament catalogue. We find that LOWZ galaxies exhibit a small but statistically significant alignment in the direction parallel to the orientation of nearby filaments. This effect is detectable even in the absence of nearby galaxy clusters, which suggests it is an effect from the matter distribution in the filament. A nonparametric regression model suggests that the alignment effect with filaments extends over separations of 30-40 Mpc. We find that galaxies that are bright and early-forming align more strongly with the directions of nearby filaments than those that are faint and late-forming; however, trends with stellar mass are less statistically significant, within the narrow range of stellar mass of this sample.

astro-ph.CO↗

arXiv2018

Measuring Human Activity Spaces from GPS Data with Density Ranking and Summary Curves

Activity spaces are fundamental to the assessment of individuals' dynamic exposure to social and environmental risk factors associated with multiple spatial contexts that are visited during activities of daily living. In this paper we survey existing approaches for measuring the geometry, size and structure of activity spaces based on GPS data, and explain their limitations. We propose addressing these shortcomings through a nonparametric approach called density ranking, and also through three summary curves: the mass-volume curve, the Betti number curve, and the persistence curve. We introduce a novel mixture model for human activity spaces, and study its asymptotic properties. We prove that the kernel density estimator which, at the present time, is one of the most widespread methods for measuring activity spaces is not a stable estimator of their structure. We illustrate the practical value of our methods with a simulation study, and with a recently collected GPS dataset that comprises the locations visited by ten individuals over a six months period.

stat.AP↗

arXiv2018

Generalized Cluster Trees and Singular Measures

In this paper, we study the $α$-cluster tree ($α$-tree) under both singular and nonsingular measures. The $α$-tree uses probability contents within a level set to construct a cluster tree so that it is well-defined for singular measures. We first derive the convergence rate for a density level set around critical points, which leads to the convergence rate for estimating an $α$-tree under nonsingular measures. For singular measures, we study how the kernel density estimator (KDE) behaves and prove that the KDE is not uniformly consistent but pointwisely consistent after rescaling. We further prove that the estimated $α$-tree fails to converge in the $L_\infty$ metric but is still consistent under the integrated distance. We also observe a new type of critical points--the dimensional critical points (DCPs)--of a singular measure. DCPs occur only at singular measures, and similar to the usual critical points, DCPs contribute to cluster tree topology as well. Building on the analysis of the KDE and DCPs, we prove the topological consistency of an estimated $α$-tree.

math.ST↗

arXiv2018

On the use of bootstrap with variational inference: Theory, interpretation, and a two-sample test example

Variational inference is a general approach for approximating complex density functions, such as those arising in latent variable models, popular in machine learning. It has been applied to approximate the maximum likelihood estimator and to carry out Bayesian inference, however, quantification of uncertainty with variational inference remains challenging from both theoretical and practical perspectives. This paper is concerned with developing uncertainty measures for variational inference by using bootstrap procedures. We first develop two general bootstrap approaches for assessing the uncertainty of a variational estimate and the study the underlying bootstrap theory in both fixed- and increasing-dimension settings. We then use the bootstrap approach and our theoretical results in the context of mixed membership modeling with multivariate binary data on functional disability from the National Long Term Care Survey. We carry out a two-sample approach to test for changes in the repeated measures of functional disability for the subset of individuals present in 1989 and 1994 waves.

stat.ME↗

arXiv2018

Functional Summaries of Persistence Diagrams

One of the primary areas of interest in applied algebraic topology is persistent homology, and, more specifically, the persistence diagram. Persistence diagrams have also become objects of interest in topological data analysis. However, persistence diagrams do not naturally lend themselves to statistical goals, such as inferring certain population characteristics, because their complicated structure makes common algebraic operations--such as addition, division, and multiplication-- challenging (e.g., the mean might not be unique). To bypass these issues, several functional summaries of persistence diagrams have been proposed in the literature (e.g. landscape and silhouette functions). The problem of analyzing a set of persistence diagrams then becomes the problem of analyzing a set of functions, which is a topic that has been studied for decades in statistics. First, we review the various functional summaries in the literature and propose a unified framework for the functional summaries. Then, we generalize the definition of persistence landscape functions, establish several theoretical properties of the persistence functional summaries, and demonstrate and discuss their performance in the context of classification using simulated prostate cancer histology data, and two-sample hypothesis tests comparing human and monkey fibrin images, after developing a simulation study using a new data generator we call the Pickup Sticks Simulator (STIX).

stat.ME↗

arXiv2018

An Analysis Framework for Understanding the Origin of Nuclear Activity in Low-Power Radio Galaxies

Using large samples containing nearly $2300$ active galaxies of low radio luminosity (1.4 GHz luminosity between $2\times 10^{23}$ and $3\times 10^{25}$ W/Hz, essentially low-excitation radio galaxies) at $z\lesssim 0.3$, we present a self-contained analysis of the dependence of the nuclear radio activity on both intrinsic and extrinsic properties of galaxies, with the goal of identifying the best predictors of the nuclear radio activity. While confirming the established result that stellar mass must play a key role in the triggering of radio activities, we point out that for central, most massive galaxies, the radio activity also shows a strong dependence on halo mass, which is unlikely due to enhanced interaction rates in denser regions in massive, cluster-scale halos. We thus further investigate the effects of various properties of the intracluster medium (ICM) in massive clusters on the radio activities, employing two standard statistical tools, Principle Component Analysis and Logistic Regression. It is found that ICM entropy, local cooling time, and pressure are the most effective in predicting the radio activity, pointing to the accretion of gas cooling out of a hot atmosphere to be the likely origin in triggering such activities in galaxies residing in massive dark matter halos. Our analysis framework enables us to logically discern the mechanisms responsible for the radio activity separately for central and satellite galaxies.

astro-ph.GA↗

arXiv2018

Intrinsic Alignment in redMaPPer clusters -- II. Radial alignment of satellites toward cluster centers

We study the orientations of satellite galaxies in redMaPPer clusters constructed from the Sloan Digital Sky Survey at $0.1<z<0.35$ to determine whether there is any preferential tendency for satellites to point radially toward cluster centers. We analyze the satellite alignment (SA) signal based on three shape measurement methods (re-Gaussianization, de Vaucouleurs, and isophotal shapes), which trace galaxy light profiles at different radii. The measured SA signal depends on these shape measurement methods. We detect the strongest SA signal in isophotal shapes, followed by de Vaucouleurs shapes. While no net SA signal is detected using re-Gaussianization shapes across the entire sample, the observed SA signal reaches a statistically significant level when limiting to a subsample of higher luminosity satellites. We further investigate the impact of noise, systematics, and real physical isophotal twisting effects in the comparison between the SA signal detected via different shape measurement methods. Unlike previous studies, which only consider the dependence of SA on a few parameters, here we explore a total of 17 galaxy and cluster properties, using a statistical model averaging technique to naturally account for parameter correlations and identify significant SA predictors. We find that the measured SA signal is strongest for satellites with the following characteristics: higher luminosity, smaller distance to the cluster center, rounder in shape, higher bulge fraction, and distributed preferentially along the major axis directions of their centrals. Finally, we provide physical explanations for the identified dependences, and discuss the connection to theories of SA.

astro-ph.GA↗

arXiv2017

Modal Regression using Kernel Density Estimation: a Review

We review recent advances in modal regression studies using kernel density estimation. Modal regression is an alternative approach for investigating relationship between a response variable and its covariates. Specifically, modal regression summarizes the interactions between the response variable and covariates using the conditional mode or local modes. We first describe the underlying model of modal regression and its estimators based on kernel density estimation. We then review the asymptotic properties of the estimators and strategies for choosing the smoothing bandwidth. We also discuss useful algorithms and similar alternative approaches for modal regression, and propose future direction in this field.

stat.ME↗

arXiv2017

A Note on Community Trees in Networks

We introduce the concept of community trees that summarizes topological structures within a network. A community tree is a tree structure representing clique communities from the clique percolation method (CPM). The community tree also generates a persistent diagram. Community trees and persistent diagrams reveal topological structures of the underlying networks and can be used as visualization tools. We study the stability of community trees and derive a quantity called the total star number (TSN) that presents an upper bound on the change of community trees. Our findings provide a topological interpretation for the stability of communities generated by the CPM.

stat.ML↗

arXiv2017

A Tutorial on Kernel Density Estimation and Recent Advances

This tutorial provides a gentle introduction to kernel density estimation (KDE) and recent advances regarding confidence bands and geometric/topological features. We begin with a discussion of basic properties of KDE: the convergence rate under various metrics, density derivative estimation, and bandwidth selection. Then, we introduce common approaches to the construction of confidence intervals/bands, and we discuss how to handle bias. Next, we talk about recent advances in the inference of geometric and topological features of a density function using KDE. Finally, we illustrate how one can use KDE to estimate a cumulative distribution function and a receiver operating characteristic curve. We provide R implementations related to this tutorial at the end.

stat.ME↗

arXiv2017

Statistical Inference using the Morse-Smale Complex

The Morse-Smale complex of a function $f$ decomposes the sample space into cells where $f$ is increasing or decreasing. When applied to nonparametric density estimation and regression, it provides a way to represent, visualize, and compare multivariate functions. In this paper, we present some statistical results on estimating Morse-Smale complexes. This allows us to derive new results for two existing methods: mode clustering and Morse-Smale regression. We also develop two new methods based on the Morse-Smale complex: a visualization technique for multivariate functions and a two-sample, multivariate hypothesis test.

math.ST↗