SearcharxivSearch

arXiv subjects

Bittu Karmakar

Publications and source records attributed to Bittu Karmakar.

2 recordsLinked to original sources

Optimal Differentially Private Randomized Response Designs to Collect Sensitive Binary Data

Randomized response is a long-standing method for estimating the prevalence of sensitive attributes while protecting respondent privacy. It is increasingly used to generate synthetic binary data from real personal records, enabling data storage and sharing while protecting individual privacy. While surveys emphasize accurate estimation, synthetic data generation prioritizes privacy. Statisticians typically set sample sizes to achieve a target statistical power. However, we show that high power can increase the risk of privacy violations. We consider established randomized response designs with respect to statistical power and differential privacy, which quantifies the leakage of privacy. Our results reveal that common design strategies can yield either insufficient power or excessive privacy loss. We provide optimal parameter choices for randomized response models that jointly satisfy desired power and differential privacy constraints. We motivate and evaluate our approaches using a dataset from a randomized response survey conducted via Amazon Mechanical Turk on tax return misreporting, providing a policy-relevant testbed. Simulation studies evaluate the existence of optimal design parameters, identify designs that minimize the required sample size, and quantify sample size inflation relative to direct questioning. We provide a user-friendly web application (Shiny App) available at https://iitg.ac.in/pgapps/DP_RR/ for designing randomized response studies to facilitate adoption.

stat.ME

MDAS: A Diagnostic Approach to Assess the Quality of Data Splitting in Machine Learning

In the field of machine learning, model performance is usually assessed by randomly splitting data into training and test sets. Different random splits, however, can yield markedly different performance estimates, so a genuinely good model may be discarded or a poor one selected purely due to an unlucky partition. This motivates a principled way to diagnose the quality of a given data split. We propose a diagnostic framework based on a new discrepancy measure, the Mahalanobis Distribution Alignment Score (MDAS). MDAS is a symmetric dissimilarity measure between two multivariate samples, rather than a strict metric. MDAS captures both mean and covariance differences and is affine invariant. Building on this, we construct a Monte Carlo test that evaluates whether an observed split is statistically compatible with typical random splits, yielding an interpretable p-value for split quality. Using several real data sets, we study the relationship between MDAS and model robustness, including its association with the normalized Akaike information criterion. Finally, we apply MDAS to compare existing state-of-the-art deterministic data-splitting strategies with standard random splitting. The experimental results show that MDAS provides a simple, model-agnostic tool for auditing data splits and improving the reliability of empirical model evaluation.

stat.CO