Searcharxiv⌕ Search

arXiv subjects

Airui Meng

Publications and source records attributed to Airui Meng.

2 recordsLinked to original sources

Weak-Instrument Inference and Model Diagnostics in Double Machine Learning for Linear Instrumental Variable Models

We study weak-instrument-robust inference in partially linear instrumental-variables models with learned nuisances. Building on an i.i.d. uniform-size baseline, we establish uniform asymptotic validity of clustered cross-fitted Anderson-Rubin inference and cross-fitted score inference under the stated sampling and nuisance-rate conditions. Extensions establish Anderson-Rubin validity for survey-weighted target laws and fold-nested generated instruments. A supporting population benchmark shows that prediction-optimal instrument residualization maximizes concentration when the treatment nuisance is correctly specified. A five-design diagnostic portfolio, a known-truth Monte Carlo, and an exploratory selector examine how nuisance specification and estimation affect realized strength and inference.

stat.ME↗

Distilling Black-Box Machine Learning into a Small, Self-Explaining Language Model for Learning Analytics

Learning analytics increasingly relies on flexible machine learning (ML), but the model opacity and the burden of deployment prevent these tools from reaching educational practice. We propose a two-stage fine-tuning pipeline that distills a fitted black-box estimator and its post hoc interpretation (the mentor) into a small, open-weight large language model (LLM; the mentee) that returns an individual-level estimate and explains in natural language. The design is estimator-agnostic and paired with a faithfulness-first evaluation framework that audits every narration against the attribution it claims to describe. We design a simulation study that separates distillation loss from estimator loss by comparing an oracle mentor with a realistic ML mentor. Given an oracle signal, distillation with a two-billion-parameter LLM model is nearly lossless in recovering the effect surface (r > .90), perfectly ranking the important variables, and citing no spurious covariate. Under a realistic estimator, almost all remaining error originates upstream. We find that fluency is no evidence of correctness since narration quality is independent of signal quality, and decision quality collapses toward the majority action in severely imbalanced settings. Applied to a nationally representative dataset, the pipeline recovers the finding that advanced mathematics coursework benefits students least likely to enroll in four-year college the most, with 98.8% of narrations passing the audit and no fabricated quantities. The result is a single fine-tuned LLM that predicts and explains offline on a commodity laptop, so student records never leave the machine.

cs.HC↗