SearcharxivSearch

arXiv subjects

Benjamin Wade

Publications and source records attributed to Benjamin Wade.

2 recordsLinked to original sources

Steering Under Compression: Dose-Response, Capability Cost, and Failure Asymmetry in Quantized LLMs

Inference-time activation steering enables behavioral control of large language models without parameter modification, while post-training quantization reduces memory and compute costs for deployment. Despite their growing convergence in practice, the interaction between these two techniques remains uncharacterized. We systematically study activation steering under weight-only quantization (INT8 and NF4) across four open-weight 7-9B models and two behavioral targets: judged sentiment and judge-free reasoning length. Using an iso-effect framework that compares capability costs at matched behavioral effect, we find that sentiment steering survives quantization intact. After correcting a GSM8K parser artifact with a uniform v2.3.1 rescore, the pooled INT8 contrast is -0.010 (90% CI [-0.026, +0.007]), descriptively Equivalent under the preregistered three-label rule, while NF4 remains Inconclusive at -0.017 ([-0.067, +0.033]). In contrast, reasoning length exhibits a surprising asymmetric dose-response: lengthening is graded but terminates in cap-runaway and collapse, while shortening is a step function with only 12-30% shortening (model-dependent) before discontinuous failure. We expose a methodological pitfall: the naive iso-effect ladder anchors on the collapse floor for floor-bounded targets, and we introduce a censored construction that restores interpretable crossings. We also quantify a substantial baseline capability shift for Mistral-NF4 (0.545 to 0.365 GSM8K at alpha=0), demonstrating that compression can dominate the steering intervention. Despite this, steering vectors remain highly collinear with their FP16 siblings (cosine similarity 0.989-0.998 for INT8, 0.945-0.990 for NF4), confirming that the behavioral direction survives quantization even when the cost structure does not. All code and data are released.

cs.LG

The RD50-MPW4: A Radiation Hard HV CMOS Sensor for Future Colliders

The former CERN RD50 collaboration develops monolithic active pixel high voltage (HV) CMOS sensors for future colliders with the aim of high radiation tolerance, good time resolution, and high granularity pixel detectors. The most recent prototype, the RD50-MPW4, was produced by LFoundry in December 2023 using a 150 nm CMOS process. It features a matrix of 64x64 pixels with a 62 $\mu$m pitch and employs a column-drain readout architecture. Compared to its predecessor, it now has separate analog and digital power domains and a new biasing scheme with a guard ring structure that supports bias voltages over 600 V. This contribution will discuss the design and latest results of the MPW4, where tests with unirradiated samples showed more than 99.9% efficiency, 16 $\mu$m spatial resolution and 10 ns timing resolution. Efficiencies of over 99% were achieved for samples irradiated to fluences of $1 \times 10^{15}$ 1 MeV n$_{\mathrm{eq}}/\mathrm{cm}^2$. A 3D map of the charge collection efficiency from a measurement with two-photon absorption laser is presented that nicely outlines the depletion depth of this radiation hard, high granularity monolithic active pixel sensor.

physics.ins-det