Searcharxiv⌕ Search

arXiv subjects

Kaveh Salehzadeh Nobari

Publications and source records attributed to Kaveh Salehzadeh Nobari.

5 recordsLinked to original sources

Finite-Sample Coverage Audits for High-Recall Candidate Generation: Certification and Learning-Theoretic Design

An initial high-recall stage in an empirical pipeline decides which items pass to later review, labelling, or modelling, and relevant items it misses are lost to every subsequent stage. We study how many audit labels are needed to certify, with finite-sample validity, that this missed relevant mass is small, and our main results characterise the label complexity of this problem. We first show that no procedure using only labels from inside the candidate set can certify any non-trivial bound on the missed mass: the audit must sample the excluded pool, the only region where unrecovered relevant items can lie. We then prove a matching finite-corpus lower bound. Any valid audit that certifies fewer than $m$ missed relevant items with high probability when none are present, even if adaptive and permitted to label the entire included pool, must inspect on the order of $N_0/m$ excluded-pool labels. Excluded-pool auditing is therefore minimax rate-optimal, not merely convenient, for missed-mass certification in the zero-miss regime. Building on this characterisation, we develop an exact finite-sample toolkit, using binomial and hypergeometric inversion rather than asymptotic approximation, that certifies missed mass, converts it to recall through a two-pool design, certifies pre-specified families of nested candidate generators simultaneously, and produces stress-test certificates against declared perturbation mechanisms. These certificates can be paired with observable review burden to select the least burdensome pre-specified candidate generator meeting a missed-mass target. Every guarantee holds under one discipline: the candidate generator, or the pre-specified family from which it is selected, and the audit rule are fixed before the certification labels are examined.

cs.LG↗

Generalised Eigenvalue Geometry of Semantic Adversarial Attacks

Recent empirical work shows that semantically equivalent paraphrases can fool financial sentiment classifiers: although a paraphrase remains close to the original under a strong reference embedding, it may shift the target model's representation enough to change the predicted class. Existing robustness theory either assumes a single-model threat model or focuses mainly on empirical attack algorithms. We develop a continuous local model of semantic paraphrase perturbations that captures this two-model structure. We show that the worst-case local displacement of the target representation, subject to a proxy-model budget, is governed by the largest generalised eigenvalue of a matrix pencil $(A,B)$ constructed from the Jacobians of the two embedding maps. The resulting attackability index $λ^*(x)$ is intrinsic to the local paraphrase geometry and the chosen embedders, yields a closed-form prediction-flip condition for affine readouts, and supports conservative population and finite-sample attackability certificates. For uniform control over classes of affine readouts, we derive a distribution-free VC bound for binary attackability indicators and a scale-sensitive margin bound based on an attackability-adjusted margin that subtracts a local geometric penalty from the standard classifier margin. We also connect the continuous theory to discrete paraphrase search, identify an asymmetry between successful and unsuccessful finite searches, and give a covering condition under which the discrete and continuous settings agree. Finally, we propose an empirical verification framework using soft-token relaxations and generated paraphrase sets to assess the local eigenvalue geometry, prediction-flip condition, and finite-search approximation on a deployed financial-text classifier.

stat.ML↗

Sharp Hybrid Confidence Bands for Partially Identified Treatment Effects under Tail Uncertainty with an Application to Workforce Gender Diversity and Firm Performance

Manski's nonparametric bounds partially identify the average treatment effects (ATEs) under minimal assumptions, yielding an interval-valued estimand with endpoints that depend on the outcome support - typically treated as known or fixed. In many empirical settings, however, credible bounds on the outcome support are often unavailable and outcomes may be heavy-tailed, so common empirical implementations that rely on ad-hoc truncation or observed extrema can compromise finite-sample coverage. We develop concATE, a hybrid confidence band for interval-identified ATEs that explicitly accounts for tail uncertainty without imposing parametric assumptions. The inference method combines a distribution-free concentration bound for the outcome distribution based on the Dvoretzky-Kiefer-Wolfowitz inequality with the asymptotic delta-method inference for smooth mean components, and allocates size across bound endpoints using Bonferroni's inequality to guarantee joint coverage. We further extend concATE to a group-sequential procedure that controls the family-wise error rate using Pocock correction. Applying the method to panel data on 901 listed firms (2015Q2--2022Q1), we find that senior-level gender diversity has a statistically significant positive effect on firm value (Tobin's Q) only after crossing substantial representation thresholds: in Growth & Innovation sectors, significance emerges at approximately 55% female leadership, while in Defensive sectors it appears only beyond about 60%.

stat.ME↗

Disaggregating Time-Series with Many Indicators: An Overview of the DisaggregateTS Package

Low-frequency time-series (e.g., quarterly data) are often treated as benchmarks for interpolating to higher frequencies, since they generally exhibit greater precision and accuracy in contrast to their high-frequency counterparts (e.g., monthly data) reported by governmental bodies. An array of regression-based methods have been proposed in the literature which aim to estimate a target high-frequency series using higher frequency indicators. However, in the era of big data and with the prevalence of large volume of administrative data-sources there is a need to extend traditional methods to work in high-dimensional settings, i.e. where the number of indicators is similar or larger than the number of low-frequency samples. The package DisaggregateTS includes both classical regressions-based disaggregation methods alongside recent extensions to high-dimensional settings, c.f. Mosley et al. (2022). This paper provides guidance on how to implement these methods via the package in R, and demonstrates their use in an application to disaggregating CO2 emissions.

stat.ME↗

Pair copula constructions of point-optimal sign-based tests for predictive linear and nonlinear regressions

We propose pair copula constructed point-optimal sign tests in the context of linear and nonlinear predictive regressions with endogenous, persistent regressors, and disturbances exhibiting serial (nonlinear) dependence. The proposed approach entails considering the entire dependence structure of the signs to capture the serial dependence, and building feasible test statistics based on pair copula constructions of the sign process. The tests are exact and valid in the presence of heavy tailed and nonstandard errors, as well as heterogeneous and persistent volatility. Furthermore, they may be inverted to build confidence regions for the parameters of the regression function. Finally, we adopt an adaptive approach based on the split-sample technique to maximize the power of the test by finding an appropriate alternative hypothesis. In a Monte Carlo study, we compare the performance of the proposed "quasi"-point-optimal sign tests based on pair copula constructions by comparing its size and power to those of certain existing tests that are intended to be robust against heteroskedasticity. The simulation results maintain the superiority of our procedures to existing popular tests.

econ.EM↗