Searcharxiv⌕ Search

arXiv · 2610.30549

AI-Native Academia Should Build a Community Verification Layer

Abstract

This paper argues that AI-native academia should build a Community Verification Layer: interoperable, policy-governed infrastructure that converts researchers' routine reading and checking into persistent, claim- and version-linked evidence, while routing scarce deeper verification toward uncertain, consequential, and neglected research. AI is lowering the cost of producing plausible research artifacts faster than the cost of accountable evaluation, yet much of the evaluation researchers already perform while reading, citing, implementing, or extending work is never made reusable. We propose a tiered ladder from comprehension notes to claim checks, audits, artifact execution, reproduction, replication, and downstream validation. The layer would elicit judgments before revealing social signals, preserve multidimensional disagreement, privately verify contributors while allowing flexible public disclosure, allocate attention under expertise and coverage constraints, and make verification labor citable, with credit tied to the quality and depth of the evidence. We distinguish this design from prior open and post-publication review and outline governance requirements and potential counterarguments.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Haotian Zong, Luhao Zhang. 2026-10-22. AI-Native Academia Should Build a Community Verification Layer. https://arxiv.org/abs/2610.30549

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Artificial intelligence is creating a new global linguistic hierarchy

Artificial intelligence (AI) has the potential to transform healthcare, education, governance and socioeconomic equity, but its benefits remain concentrated in a small number of languages (Bender, 2019; Blasi et al., 2022; Joshi et al., 2020; Ranathunga and de Silva, 2022; Young, 2015). Language AI - the technologies that underpin widely-used conversational systems such as ChatGPT - could provide major benefits if available in people's native languages, yet most of the world's 7,000+ linguistic communities currently lack access and face persistent digital marginalization. Here we present a global longitudinal analysis of social, economic and infrastructural conditions across languages to assess systemic inequalities in language AI. We first analyze the existence of AI resources for 6003 languages. We find that despite efforts of the community to broaden the reach of language technologies (Bapna et al., 2022; Costa-Jussà et al., 2022), the dominance of a handful of languages is exacerbating disparities on an unprecedented scale, with divides widening exponentially rather than narrowing. Further, we contrast the longitudinal diffusion of AI with that of earlier IT technologies, revealing a distinctive hype-driven pattern of spread. To translate our findings into practical insights and guide prioritization efforts, we introduce the Language AI Readiness Index (EQUATE), which maps the state of technological, socio-economic, and infrastructural prerequisites for AI deployment across languages. The index highlights communities where capacity exists but remains underutilized, and provides a framework for accelerating more equitable diffusion of language AI. Our work contributes to setting the baseline for a transition towards more sustainable and equitable language technologies.

cs.CY↗

Modeling of Therapist-Client Dynamics in Psychotherapy Using LLM-Based Assessments: An Empirical Study

This study aimed to develop and validate a computational framework for modeling therapist--client interaction processes and to examine how therapist behaviors and relational qualities relate to client self-disclosure and emotional expression in psychotherapy sessions. We developed automated assessment pipelines using large language models (LLMs) to measure therapist behaviors (empathy, exploration), relational quality (rapport), and client outcomes (self-disclosure, self-directed negative emotion, outward-directed negative emotion). Model-generated scores were validated against human annotations. We then applied these measures to approximately 2,000 hours of psychotherapy transcripts from the Alexander Street corpus. This yielded an estimation sample of 119,233 client utterances from 1,573 sessions and 37 clients. Automated measures showed good to excellent agreement with human annotations (ICC = 0.60 - 0.81), with rapport (ICC = 0.81), self-disclosure (ICC = 0.78), empathy components (ICC = 0.60 - 0.75), and emotion measurements (ICC = 0.66 - 0.80). SEM analyses revealed that therapist empathy and exploration were each associated with increased client disclosure and increased expression of self-directed negative emotions. Both behaviors were also associated with reduced expressions of enjoyment. Surprisingly, rapport in the prior session showed no association with client self-disclosure or negative emotion expression. This study demonstrates that LLM-based measurement combined with structural modeling can capture core therapeutic processes at scale.

cs.CY↗

Empirically Grounded Behavioral Adaptivity for LLM-Based Virtual Patients in Psychotherapy Training

Simulated patients offer a scalable way to train psychotherapy micro-skills such as empathic responding and exploratory probing, but current systems either follow fixed scripts or rely on LLMs that drift unpredictably over long sessions. We present the Adaptive Virtual Patient (AVP), which adapts its disclosure behavior in response to trainee skill, from guarded, through moderate openness, to full disclosure. The AVP is informed by a structural equation model fit to nearly 2,000 hours of real-world psychotherapy transcripts, which quantifies how therapist empathy and exploration shift a patient's openness over time. An LLM generates the AVP's utterances conditioned on a disclosure level that the dynamics module updates each turn. In an evaluation with 20 clinicians and trainees over 80 sessions (1,033 turns), the AVP's disclosure rises in response to therapist empathy and exploration, while a prompt-only baseline stays flat; ablations confirm that the empirically motivated parameterization outperforms alternatives, with exploration carrying most of the adaptive signal.

cs.CY↗