Searcharxiv⌕ Search

arXiv subjects

Xiao Fang

Publications and source records attributed to Xiao Fang.

At least 73 records · Page 4Linked to original sources

Billion-user Customer Lifetime Value Prediction: An Industrial-scale Solution from Kuaishou

Customer Life Time Value (LTV) is the expected total revenue that a single user can bring to a business. It is widely used in a variety of business scenarios to make operational decisions when acquiring new customers. Modeling LTV is a challenging problem, due to its complex and mutable data distribution. Existing approaches either directly learn from posterior feature distributions or leverage statistical models that make strong assumption on prior distributions, both of which fail to capture those mutable distributions. In this paper, we propose a complete set of industrial-level LTV modeling solutions. Specifically, we introduce an Order Dependency Monotonic Network (ODMN) that models the ordered dependencies between LTVs of different time spans, which greatly improves model performance. We further introduce a Multi Distribution Multi Experts (MDME) module based on the Divide-and-Conquer idea, which transforms the severely imbalanced distribution modeling problem into a series of relatively balanced sub-distribution modeling problems hence greatly reduces the modeling complexity. In addition, a novel evaluation metric Mutual Gini is introduced to better measure the distribution difference between the estimated value and the ground-truth label based on the Lorenz Curve. The ODMN framework has been successfully deployed in many business scenarios of Kuaishou, and achieved great performance. Extensive experiments on real-world industrial data demonstrate the superiority of the proposed methods compared to state-of-the-art baselines including ZILN and Two-Stage XGBoost models.

cs.LG↗

High order steady-state diffusion approximations

We derive and analyze new diffusion approximations of stationary distributions of Markov chains that are based on second- and higher-order terms in the expansion of the Markov chain generator. Our approximations achieve a higher degree of accuracy compared to diffusion approximations widely used for the past fifty years, while retaining a similar computational complexity. To support our approximations, we present a combination of theoretical and numerical results across three different models. Our approximations are derived recursively through Stein/Poisson equations, and the theoretical results are proved using Stein's method.

math.PR↗

From $p$-Wasserstein Bounds to Moderate Deviations

We use a new method via $p$-Wasserstein bounds to prove Cramér-type moderate deviations in (multivariate) normal approximations. In the classical setting that $W$ is a standardized sum of $n$ independent and identically distributed (i.i.d.) random variables with sub-exponential tails, our method recovers the optimal range of $0\leq x=o(n^{1/6})$ and the near optimal error rate $O(1)(1+x)(\log n+x^2)/\sqrt{n}$ for $P(W>x)/(1-Φ(x))\to 1$, where $Φ$ is the standard normal distribution function. Our method also works for dependent random variables (vectors) and we give applications to the combinatorial central limit theorem, Wiener chaos, homogeneous sums and local dependence. The key step of our method is to show that the $p$-Wasserstein distance between the distribution of the random variable (vector) of interest and a normal distribution grows like $O(p^αΔ)$, $1\leq p\leq p_0$, for some constants $α, Δ$ and $p_0$. In the above i.i.d. setting, $α=1, Δ=1/\sqrt{n}, p_0=n^{1/3}$. For this purpose, we obtain general $p$-Wasserstein bounds in (multivariate) normal approximations using Stein's method.

math.PR↗

Cosmology with the Roman Space Telescope -- Synergies with CMB lensing

We explore synergies between the Nancy Grace Roman Space Telescope and CMB lensing data to constrain dark energy and modified gravity scenarios. A simulated likelihood analysis of the galaxy clustering and weak lensing data from the Roman Space Telescope High Latitude Survey combined with CMB lensing data from the Simons Observatory is undertaken, marginalizing over important astrophysical effects and calibration uncertainties. Included in the modeling are the effects of baryons on small-scale clustering, scale-dependent growth suppression by neutrinos, as well as uncertainties in the galaxy clustering biases, in the intrinsic alignment contributions to the lensing signal, in the redshift distributions, and in the galaxy shape calibration. The addition of CMB lensing roughly doubles the dark energy figure-of-merit from Roman photometric survey data alone, varying from a factor of 1.7 to 2.4 improvement depending on the particular Roman survey configuration. Alternatively, the inclusion of CMB lensing information can compensate for uncertainties in the Roman galaxy shape calibration if it falls below the design goals. Furthermore, we report the first forecast of Roman constraints on a model-independent structure growth, parameterized by $σ_8 (z)$, and on the Hu-Sawicki f(R) gravity as well as an improved forecast of the phenomenological $(Σ_0,μ_0)$ model. We find that CMB lensing plays a crucial role in constraining $σ_8(z)$ at z>2, with percent-level constraints forecasted out to z=4. CMB lensing information does not improve constraints on the f(R) models substantially. It does, however, increase the $(Σ_0,μ_0)$ figure-of-merit by a factor of about 1.5.

astro-ph.CO↗

High-dimensional properties for empirical priors in linear regression with unknown error variance

We study full Bayesian procedures for high-dimensional linear regression. We adopt data-dependent empirical priors introduced in [1]. In their paper, these priors have nice posterior contraction properties and are easy to compute. Our paper extend their theoretical results to the case of unknown error variance . Under proper sparsity assumption, we achieve model selection consistency, posterior contraction rates as well as Bernstein von-Mises theorem by analyzing multivariate t-distribution.

math.ST↗

Posterior Consistency for Bayesian Relevance Vector Machines

Statistical modeling and inference problems with sample sizes substantially smaller than the number of available covariates are challenging. Chakraborty et al. (2012) did a full hierarchical Bayesian analysis of nonlinear regression in such situations using relevance vector machines based on reproducing kernel Hilbert space (RKHS). But they did not provide any theoretical properties associated with their procedure. The present paper revisits their problem, introduces a new class of global-local priors different from theirs, and provides results on posterior consistency as well as posterior contraction rates

stat.ML↗

Cosmology from Clustering, Cosmic Shear, CMB Lensing, and Cross Correlations: Combining Rubin Observatory and Simons Observatory

In the near future, the overlap of the Rubin Observatory Legacy Survey of Space and Time (LSST) and the Simons Observatory (SO) will present an ideal opportunity for joint cosmological dataset analyses. In this paper we simulate the joint likelihood analysis of these two experiments using six two-point functions derived from galaxy position, galaxy shear, and CMB lensing convergence fields. Our analysis focuses on realistic noise and systematics models and we find that the dark energy Figure-of-Merit (FoM) increases by 53% (92%) from LSST-only to LSST+SO in Year 1 (Year 6). We also investigate the benefits of using the same galaxy sample for both clustering and lensing analyses, and find the choice improves the overall signal-to-noise by ~30-40%, which significantly improves the photo-z calibration and mildly improves the cosmological constraints. Finally, we explore the effects of catastrophic photo-z outliers finding that they cause significant parameter biases when ignored. We develop a new mitigation approach termed "island model", which corrects a large fraction of the biases with only a few parameters while preserving the constraining power.

astro-ph.CO↗

Detection and Estimation of Local Signals

We study the maximum score statistic to detect and estimate local signals in the form of change-points in the level, slope, or other property of a sequence of observations, and to segment the sequence when there appear to be multiple changes. We find that when observations are serially dependent, the change-points can lead to upwardly biased estimates of autocorrelations, resulting in a sometimes serious loss of power. Examples involving temperature variations, the level of atmospheric greenhouse gases, suicide rates, incidence of COVID-19, and excess deaths during the pandemic illustrate the general theory.

math.ST↗

Cramér-type Moderate Deviation for Quadratic Forms with a Fast Rate

Let $X_1,\dots, X_n$ be independent and identically distributed random vectors in $\mathbb{R}^d$. Suppose $\mathbb{E} X_1=0$, $\mathrm{Cov}(X_1)=I_d$, where $I_d$ is the $d\times d$ identity matrix. Suppose further that there exist positive constants $t_0$ and $c_0$ such that $\mathbb{E} e^{t_0|X_1|}\leq c_0<\infty$, where $|\cdot|$ denotes the Euclidean norm. Let $W=\frac{1}{\sqrt{n}}\sum_{i=1}^n X_i$ and let $Z$ be a $d$-dimensional standard normal random vector. Let $Q$ be a $d\times d$ symmetric positive definite matrix whose largest eigenvalue is 1. We prove that for $0\leq x\leq \varepsilon n^{1/6}$, \begin{equation*} \left| \frac{\mathbb{P}(|Q^{1/2}W|>x)}{\mathbb{P}(|Q^{1/2}Z|>x)}-1 \right|\leq C \left( \frac{1+x^5}{\det{(Q^{1/2})}n}+\frac{x^6}{n}\right) \quad \text{for}\ d\geq 5 \end{equation*} and \begin{equation*} \left| \frac{\mathbb{P}(|Q^{1/2}W|>x)}{\mathbb{P}(|Q^{1/2}Z|>x)}-1 \right|\leq C \left( \frac{1+x^3}{\det{(Q^{1/2})}n^{\frac{d}{d+1}}}+\frac{x^6}{n}\right) \quad \text{for}\ 1\leq d\leq 4, \end{equation*} where $\varepsilon$ and $C$ are positive constants depending only on $d, t_0$, and $c_0$. This is a first extension of Cramér-type moderate deviation to the multivariate setting with a faster convergence rate than $1/\sqrt{n}$. The range of $x=o(n^{1/6})$ for the relative error to vanish and the dimension requirement $d\geq 5$ for the $1/n$ rate are both optimal. We prove our result using a new change of measure, a two-term Edgeworth expansion for the changed measure, and cancellation by symmetry for terms of the order $1/\sqrt{n}$.

math.PR↗

Dark Energy Survey Year 1 Results: Constraining Baryonic Physics in the Universe

Measurements of large-scale structure are interpreted using theoretical predictions for the matter distribution, including potential impacts of baryonic physics. We constrain the feedback strength of baryons jointly with cosmology using weak lensing and galaxy clustering observables (3$\times$2pt) of Dark Energy Survey (DES) Year 1 data in combination with external information from baryon acoustic oscillations (BAO) and Planck cosmic microwave background polarization. Our baryon modeling is informed by a set of hydrodynamical simulations that span a variety of baryon scenarios; we span this space via a Principal Component (PC) analysis of the summary statistics extracted from these simulations. We show that at the level of DES Y1 constraining power, one PC is sufficient to describe the variation of baryonic effects in the observables, and the first PC amplitude ($Q_1$) generally reflects the strength of baryon feedback. With the upper limit of $Q_1$ prior being bound by the Illustris feedback scenarios, we reach $\sim 20\%$ improvement in the constraint of $S_8=σ_8(Ω_{\rm m}/0.3)^{0.5}=0.788^{+0.018}_{-0.021}$ compared to the original DES 3$\times$2pt analysis. This gain is driven by the inclusion of small-scale cosmic shear information down to 2.5 arcmin, which was excluded in previous DES analyses that did not model baryonic physics. We obtain $S_8=0.781^{+0.014}_{-0.015}$ for the combined DES Y1+Planck EE+BAO analysis with a non-informative $Q_1$ prior. In terms of the baryon constraints, we measure $Q_1=1.14^{+2.20}_{-2.80}$ for DES Y1 only and $Q_1=1.42^{+1.63}_{-1.48}$ for DESY1+Planck EE+BAO, allowing us to exclude one of the most extreme AGN feedback hydrodynamical scenario at more than $2 σ$.

astro-ph.CO↗

Linear Systematics Mitigation in Galaxy Clustering in the Dark Energy Survey Year 1 Data

We implement a linear model for mitigating the effect of observing conditions and other sources of contamination in galaxy clustering analyses. Our treatment improves upon the fiducial systematics treatment of the Dark Energy Survey (DES) Year 1 (Y1) cosmology analysis in four crucial ways. Specifically, our treatment: 1) does not require decisions as to which observable systematics are significant and which are not, allowing for the possibility of multiple maps adding coherently to give rise to significant bias even if no single map leads to a significant bias by itself; 2) characterizes both the statistical and systematic uncertainty in our mitigation procedure, allowing us to propagate said uncertainties into the reported cosmological constraints; 3) explicitly exploits the full spatial structure of the galaxy density field to differentiate between cosmology-sourced and systematics-sourced fluctuations within the galaxy density field; 4) is fully automated, and can therefore be trivially applied to any data set. The updated correlation function for the DES Y1 redMaGiC catalog minimally impacts the cosmological posteriors from that analysis. Encouragingly, our analysis does improve the goodness of fit statistic of the DES Y1 3$\times$2pt data set ($Δχ^2 = -6.5$ with no additional parameters). This improvement is due in nearly equal parts to both the change in the correlation function and the added statistical and systematic uncertainties associated with our method. We expect the difference in mitigation techniques to become more important in future work as the size of cosmological data sets grows.

astro-ph.CO↗

Mitigating baryonic effects with a theoretical error covariance

One of the primary sources of uncertainties in modeling the cosmic-shear power spectrum on small scales is the effect of baryonic physics. Accurate cosmology for Stage-IV surveys requires knowledge of the matter power spectrum deep in the nonlinear regime at the percent level. Therefore, it is important to develop reliable mitigation techniques to take into account baryonic uncertainties if information from small scales is to be considered in the cosmological analysis. In this work, we develop a new mitigation method for dealing with baryonic physics for the case of the shear angular power spectrum. The method is based on an extended covariance matrix that incorporates baryonic uncertainties informed by hydrodynamical simulations. We use the results from 13 hydrodynamical simulations and the residual errors arising from a fit to a $Λ$CDM model using the extended halo model code {\tt HMCode} to account for baryonic physics. These residual errors are used to model a so-called theoretical error covariance matrix that is added to the original covariance matrix. In order to assess the performance of the method, we use the 2D tomographic shear from four hydrodynamical simulations that have different extremes of baryonic parameters as mock data and run a likelihood analysis comparing the residual bias on $Ω_m$ and $σ_8$ of our method and the HMCode for an LSST-like survey. We use different modelling of the theoretical error covariance matrix to test the robustness of the method. We show that it is possible to reduce the bias in the determination of the tested cosmological parameters at the price of a modest decrease in the precision.

astro-ph.CO↗

Large-dimensional Central Limit Theorem with Fourth-moment Error Bounds on Convex Sets and Balls

We prove the large-dimensional Gaussian approximation of a sum of $n$ independent random vectors in $\mathbb{R}^d$ together with fourth-moment error bounds on convex sets and Euclidean balls. We show that compared with classical third-moment bounds, our bounds have near-optimal dependence on $n$ and can achieve improved dependence on the dimension $d$. For centered balls, we obtain an additional error bound that has a sub-optimal dependence on $n$, but recovers the known result of the validity of the Gaussian approximation if and only if $d=o(n)$. We discuss an application to the bootstrap. We prove our main results using Stein's method.

math.PR↗

2D-FFTLog: Efficient computation of real space covariance matrices for galaxy clustering and weak lensing

Accurate covariance matrices for two-point functions are critical for inferring cosmological parameters in likelihood analyses of large-scale structure surveys. Among various approaches to obtaining the covariance, analytic computation is much faster and less noisy than estimation from data or simulations. However, the transform of covariances from Fourier space to real space involves integrals with two Bessel integrals, which are numerically slow and easily affected by numerical uncertainties. Inaccurate covariances may lead to significant errors in the inference of the cosmological parameters. In this paper, we introduce a 2D-FFTLog algorithm for efficient, accurate and numerically stable computation of non-Gaussian real space covariances for both 3D and projected statistics. The 2D-FFTLog algorithm is easily extended to perform real space bin-averaging. We apply the algorithm to the covariances for galaxy clustering and weak lensing for a Dark Energy Survey Year 3-like and a Rubin Observatory's Legacy Survey of Space and Time Year 1-like survey, and demonstrate that for both surveys, our algorithm can produce numerically stable angular bin-averaged covariances with the flat sky approximation, which are sufficiently accurate for inferring cosmological parameters. The code CosmoCov for computing the real space covariances with or without the flat sky approximation is released along with this paper.

astro-ph.CO↗

Line confusion in spectroscopic surveys and its possible effects: Shifts in Baryon Acoustic Oscillations position

Roman Space Telescope will survey about 17 million emission-line galaxies over a range of redshifts. Its main targets are H$α$ emission-line galaxies at low redshifts and [O III] emission-line galaxies at high redshifts. The Roman Space Telescope will estimate the redshift these galaxies with single line identification. This suggests that other emission-line galaxies may be misidentified as the main targets. In particular, it is hard to distinguish between the H$β$ and [O III] lines as the two lines are close in wavelength and hence the photometric information may not be sufficient to separate them reliably. Misidentifying H$β$ emitter as [O III] emitter will cause a shift in the inferred radial position of the galaxy by approximately 90 Mpc/h. This length scale is similar to the Baryon Acoustic Oscillation (BAO) scale and could shift and broaden the BAO peak, possibly introduce errors in determining the BAO peak position. We qualitatively describe the effect of this new systematic and further quantify it with a lightcone simulation with emission-line galaxies.

astro-ph.CO↗

Recommendation with Attribute-aware Product Networks: A Representation Learning Model

With the prosperity of business intelligence, recommender systems have evolved into a new stage that we not only care about what to recommend, but why it is recommended. Explainability of recommendations thus emerges as a focal point of research and becomes extremely desired in e-commerce. Existent studies along this line often exploit item attributes and correlations from different perspectives, but they yet lack an effective way to combine both types of information for deep learning of personalized interests. In light of this, we propose a novel graph structure, \emph{attribute network}, based on both items' co-purchase network and important attributes. A novel neural model called \emph{eRAN} is then proposed to generate recommendations from attribute networks with explainability and cold-start capability. Specifically, eRAN first maps items connected in attribute networks to low-dimensional embedding vectors through a deep autoencoder, and then an attention mechanism is applied to model the attractions of attributes to users, from which personalized item representation can be derived. Moreover, a pairwise ranking loss is constructed into eRAN to improve recommendations, with the assumption that item pairs co-purchased by a user should be more similar than those non-paired with negative sampling in personalized view. Experiments on real-world datasets demonstrate the effectiveness of our method compared with some state-of-the-art competitors. In particular, eRAN shows its unique abilities in recommending cold-start items with higher accuracy, as well as in understanding user preferences underlying complicated co-purchasing behaviors.

cs.IR↗

New error bounds in multivariate normal approximations via exchangeable pairs with applications to Wishart matrices and fourth moment theorems

We extend Stein's celebrated Wasserstein bound for normal approximation via exchangeable pairs to the multi-dimensional setting. As an intermediate step, we exploit the symmetry of exchangeable pairs to obtain an error bound for smooth test functions. We also obtain a continuous version of the multi-dimensional Wasserstein bound in terms of fourth moments. We apply the main results to multivariate normal approximations to Wishart matrices of size $n$ and degree $d$, where we obtain the optimal convergence rate $\sqrt{n^3/d}$ under only moment assumptions, and to quadratic forms and Poisson functionals, where we strengthen a few of the fourth moment bounds in the literature on the Wasserstein distance.

math.PR↗

High-dimensional Central Limit Theorems by Stein's Method

We obtain explicit error bounds for the $d$-dimensional normal approximation on hyperrectangles for a random vector that has a Stein kernel, or admits an exchangeable pair coupling, or is a non-linear statistic of independent random variables or a sum of $n$ locally dependent random vectors. We assume the approximating normal distribution has a non-singular covariance matrix. The error bounds vanish even when the dimension $d$ is much larger than the sample size $n$. We prove our main results using the approach of Götze (1991) in Stein's method, together with modifications of an estimate of Anderson, Hall and Titterington (1998) and a smoothing inequality of Bhattacharya and Rao (1976). For sums of $n$ independent and identically distributed isotropic random vectors having a log-concave density, we obtain an error bound that is optimal up to a $\log n$ factor. We also discuss an application to multiple Wiener-Itô integrals.

math.PR↗