arXiv subjects

Toru Kitagawa

Publications and source records attributed to Toru Kitagawa.

26 records · Page 2Linked to original sources

arXiv2023

Stochastic Treatment Choice with Empirical Welfare Updating

This paper proposes a novel method to estimate individualised treatment assignment rules. The method is designed to find rules that are stochastic, reflecting uncertainty in estimation of an assignment rule and about its welfare performance. Our approach is to form a prior distribution over assignment rules, not over data generating processes, and to update this prior based upon an empirical welfare criterion, not likelihood. The social planner then assigns treatment by drawing a policy from the resulting posterior. We show analytically a welfare-optimal way of updating the prior using empirical welfare; this posterior is not feasible to compute, so we propose a variational Bayes approximation for the optimal posterior. We characterise the welfare regret convergence of the assignment rule based upon this variational Bayes approximation, showing that it converges to zero at a rate of ln(n)/sqrt(n). We apply our methods to experimental data from the Job Training Partnership Act Study to illustrate the implementation of our methods.

econ.EM↗

arXiv2023

Best Arm Identification with Contextual Information under a Small Gap

We study the best-arm identification (BAI) problem with a fixed budget and contextual (covariate) information. In each round of an adaptive experiment, after observing contextual information, we choose a treatment arm using past observations and current context. Our goal is to identify the best treatment arm, which is a treatment arm with the maximal expected reward marginalized over the contextual distribution, with a minimal probability of misidentification. In this study, we consider a class of nonparametric bandit models that converge to location-shift models when the gaps go to zero. First, we derive lower bounds of the misidentification probability for a certain class of strategies and bandit models (probabilistic models of potential outcomes) under a small-gap regime. A small-gap regime is a situation where gaps of the expected rewards between the best and suboptimal treatment arms go to zero, which corresponds to one of the worst cases in identifying the best treatment arm. We then develop the ``Random Sampling (RS)-Augmented Inverse Probability weighting (AIPW) strategy,'' which is asymptotically optimal in the sense that the probability of misidentification under the strategy matches the lower bound when the budget goes to infinity in the small-gap regime. The RS-AIPW strategy consists of the RS rule tracking a target sample allocation ratio and the recommendation rule using the AIPW estimator.

cs.LG↗

arXiv2022

von Mises-Fisher distributions and their statistical divergence

The von Mises-Fisher family is a parametric family of distributions on the surface of the unit ball, summarised by a concentration parameter and a mean direction. As a quasi-Bayesian prior, the von Mises-Fisher distribution is a convenient and parsimonious choice when parameter spaces are isomorphic to the hypersphere (e.g., maximum score estimation in semi-parametric discrete choice, estimation of single-index treatment assignment rules via empirical welfare maximisation, under-identifying linear simultaneous equation models). Despite a long history of application, measures of statistical divergence have not been analytically characterised for von Mises-Fisher distributions. This paper provides analytical expressions for the $f$-divergence of a von Mises-Fisher distribution from another, distinct, von Mises-Fisher distribution in $\mathbb{R}^p$ and the uniform distribution over the hypersphere. This paper also collect several other results pertaining to the von Mises-Fisher family of distributions, and characterises the limiting behaviour of the measures of divergence that we consider.

econ.EM↗

arXiv2021

Paternalism, Autonomy, or Both? Experimental Evidence from Energy Saving Programs

Identifying who should be treated is a central question in economics. There are two competing approaches to targeting - paternalistic and autonomous. In the paternalistic approach, policymakers optimally target the policy given observable individual characteristics. In contrast, the autonomous approach acknowledges that individuals may possess key unobservable information on heterogeneous policy impacts, and allows them to self-select into treatment. In this paper, we propose a new approach that mixes paternalistic assignment and autonomous choice. Our approach uses individual characteristics and empirical welfare maximization to identify who should be treated, untreated, and decide whether to be treated themselves. We apply this method to design a targeting policy for an energy saving programs using data collected in a randomized field experiment. We show that optimally mixing paternalistic assignments and autonomous choice significantly improves the social welfare gain of the policy. Exploiting random variation generated by the field experiment, we develop a method to estimate average treatment effects for each subgroup of individuals who would make the same autonomous treatment choice. Our estimates confirm that the estimated assignment policy optimally allocates individuals to be treated, untreated, or choose themselves based on the relative merits of paternalistic assignments and autonomous choice for individuals types.

econ.GN↗

arXiv2021

Who Should Get Vaccinated? Individualized Allocation of Vaccines Over SIR Network

How to allocate vaccines over heterogeneous individuals is one of the important policy decisions in pandemic times. This paper develops a procedure to estimate an individualized vaccine allocation policy under limited supply, exploiting social network data containing individual demographic characteristics and health status. We model spillover effects of the vaccines based on a Heterogeneous-Interacted-SIR network model and estimate an individualized vaccine allocation policy by maximizing an estimated social welfare (public health) criterion incorporating the spillovers. While this optimization problem is generally an NP-hard integer optimization problem, we show that the SIR structure leads to a submodular objective function, and provide a computationally attractive greedy algorithm for approximating a solution that has theoretical performance guarantee. Moreover, we characterise a finite sample welfare regret bound and examine how its uniform convergence rate depends on the complexity and riskiness of social network. In the simulation, we illustrate the importance of considering spillovers by comparing our method with targeting without network information.

econ.EM↗

arXiv2021

Identification and Inference Under Narrative Restrictions

We consider structural vector autoregressions subject to 'narrative restrictions', which are inequality restrictions on functions of the structural shocks in specific periods. These restrictions raise novel problems related to identification and inference, and there is currently no frequentist procedure for conducting inference in these models. We propose a solution that is valid from both Bayesian and frequentist perspectives by: 1) formalizing the identification problem under narrative restrictions; 2) correcting a feature of the existing (single-prior) Bayesian approach that can distort inference; 3) proposing a robust (multiple-prior) Bayesian approach that is useful for assessing and eliminating the posterior sensitivity that arises in these models due to the likelihood having flat regions; and 4) showing that the robust Bayesian approach has asymptotic frequentist validity. We illustrate our methods by estimating the effects of US monetary policy under a variety of narrative restrictions.

econ.EM↗

arXiv2019

Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection

We consider two recent suggestions for how to perform an empirically motivated Monte Carlo study to help select a treatment effect estimator under unconfoundedness. We show theoretically that neither is likely to be informative except under restrictive conditions that are unlikely to be satisfied in many contexts. To test empirical relevance, we also apply the approaches to a real-world setting where estimator performance is known. Both approaches are worse than random at selecting estimators which minimise absolute bias. They are better when selecting estimators that minimise mean squared error. However, using a simple bootstrap is at least as good and often better. For now researchers would be best advised to use a range of estimators and compare estimates for robustness.

econ.EM↗

arXiv2014

Instrumental Variables Before and LATEr

The modern formulation of the instrumental variable methods initiated the valuable interactions between economics and statistics literatures of causal inference and fueled new innovations of the idea. It helped resolving the long-standing confusion that the statisticians used to have on the method, and encouraged the economists to rethink how to make use of instrumental variables in policy analysis. [arXiv:1410.0163]

stat.ME↗