Searcharxiv⌕ Search

arXiv subjects

Robert P. Lieli

Publications and source records attributed to Robert P. Lieli.

4 recordsLinked to original sources

Forecasting with Feedback

Systematically biased forecasts are typically interpreted as evidence of forecasters' irrationality and/or asymmetric loss. In this paper we propose an alternative explanation: when forecasts inform policy decisions, and the resulting actions affect the realisation of the forecast target itself, forecasts may be optimally biased even under quadratic loss. The result arises in environments in which the forecaster is uncertain about the policymaker's reaction to the forecast, which is presumably the case in most applications. We motivate our theory by reviewing some stylised properties of Greenbook inflation forecasts. Our results point out that the presence of policy feedback poses a challenge to traditional tests of forecast rationality.

econ.TH↗

Interacting Treatments with Endogenous Takeup

We study causal inference in randomized experiments (or quasi-experiments) following a $2\times 2$ factorial design. There are two treatments, denoted $A$ and $B$, and units are randomly assigned to one of four categories: treatment $A$ alone, treatment $B$ alone, joint treatment, or none. Allowing for endogenous non-compliance with the two binary instruments representing the intended assignment, as well as unrestricted interference across the two treatments, we derive the causal interpretation of various instrumental variable estimands under more general compliance conditions than in the literature. In general, if treatment takeup is driven by both instruments for some units, it becomes difficult to separate treatment interaction from treatment effect heterogeneity. We provide auxiliary conditions and various bounding strategies that may help zero in on causally interesting parameters. As an empirical illustration, we apply our results to a program randomly offering two different treatments, namely tutoring and financial incentives, to first year college students, in order to assess the treatments' effects on academic performance.

econ.EM↗

Inference for ROC Curves Based on Estimated Predictive Indices

We provide a comprehensive theory of conducting in-sample statistical inference about receiver operating characteristic (ROC) curves that are based on predicted values from a first stage model with estimated parameters (such as a logit regression). The term "in-sample" refers to the practice of using the same data for model estimation (training) and subsequent evaluation, i.e., the construction of the ROC curve. We show that in this case the first stage estimation error has a generally non-negligible impact on the asymptotic distribution of the ROC curve and develop the appropriate pointwise and functional limit theory. We propose methods for simulating the distribution of the limit process and show how to use the results in practice in comparing ROC curves.

econ.EM↗

Estimation of Conditional Average Treatment Effects with High-Dimensional Data

Given the unconfoundedness assumption, we propose new nonparametric estimators for the reduced dimensional conditional average treatment effect (CATE) function. In the first stage, the nuisance functions necessary for identifying CATE are estimated by machine learning methods, allowing the number of covariates to be comparable to or larger than the sample size. The second stage consists of a low-dimensional local linear regression, reducing CATE to a function of the covariate(s) of interest. We consider two variants of the estimator depending on whether the nuisance functions are estimated over the full sample or over a hold-out sample. Building on Belloni at al. (2017) and Chernozhukov et al. (2018), we derive functional limit theory for the estimators and provide an easy-to-implement procedure for uniform inference based on the multiplier bootstrap. The empirical application revisits the effect of maternal smoking on a baby's birth weight as a function of the mother's age.

econ.EM↗