Searcharxiv⌕ Search

arXiv subjects

Olga Lavinda

Publications and source records attributed to Olga Lavinda.

2 recordsLinked to original sources

Known Good, Known Bad: A Ground-Truth Calibration Protocol for AI Judgment in Science

Scientific use of generative AI requires evaluation against cases with independently checkable answers. We present a ground truth calibration protocol that compares a verified reference case with reference deviant variants through neutral evaluation, an authority framed recheck, and a line by line audit. Human adjudication distinguishes deviation detection, premise accommodation, unsupported doubt, and correctness of the resulting calculation. An instructor generated organic chemistry demonstration comprises six conversations and 18 responses from an unidentified backend served through the free logged out ChatGPT interface in July 2026. Neutral evaluation detected three of five intended deviations. Both initial misses, involving oxidant stoichiometry and experimental scale, were detected at the authority framed second turn; all five detections persisted at the third turn audit. The fixed sequence supports a descriptive account of recovery across turns. In the scale case, the model initially produced a locally coherent peroxide limited yield. After recognizing the unit problem, it incorrectly retained that limiting reagent conclusion for the corrected scale. Detection and numerical repair therefore require separate assessment. The verified reference attracted speculative concerns while retaining its correct yield calculation. The protocol connects documentary verification of scientific claims and citations with empirical verification of laboratory interpretations. It supplies inspectable transcripts, reference calculations, behavior codes, and a reusable calibration architecture for AI literacy instruction. The pilot demonstrates the protocol's measures in one case family; replicated model evaluation and learner assessment are the next validation steps.

cs.CY↗

After the Award: The Authorization Gap in Academic Access to Frontier AI

Academic access programs distribute frontier artificial intelligence as research infrastructure, but awards and institutional authorization are distinct stages. We examine the handoff through structured coding of 15 publicly documented access pathways captured on 19 September 2026, of which ten met prespecified inclusion criteria, and a process trace at one US university. Two isolated model-assisted coding passes found explicit eligibility criteria in nine programs and three implied institutional prerequisites across the corpus. Downstream specification was weaker: access duration was unstated in six programs, seven reported no use or outcome metric, and liability assignment was unstated in five to seven. Public terms did not establish an unambiguous institution-independent path from award to intended use in eight to nine programs, a composite that includes possible and unclear cases. In the institutional trace, policy required review even for free tools. A bounded request generated a ticket but no substantive response or decision pathway during the observation window. We define the authorization gap as the distance between an access award and authorized research use. Tracking first use, clearance, time to first use, and persistence would help programs distinguish allocated resources from usable scientific infrastructure.

cs.CY↗