Searcharxiv⌕ Search

arXiv subjects

Nel Escher

Publications and source records attributed to Nel Escher.

2 recordsLinked to original sources

Auditing Chatbots for Incursion into Professional Legal Practice

The provision of legal advice has long been in the exclusive jurisdiction of licensed attorneys-a boundary that unauthorized practice of law (UPL) doctrine maintains to protect the public from incompetent counsel. We argue that this boundary is being redrawn, not by courts or bar authorities, but by frontier AI companies. While early chat models were trained to avoid dispensing legal advice, modern models have been reconfigured to reduce refusals and prioritize helpfulness. We ask whether chatbots increasingly do tasks that require a law degree and bar admission, and whether this is harmful in high-stakes legal domains. We develop UPLBench, a benchmark derived from court decisions finding UPL in high-stakes legal domains (e.g., immigration, family law). We then audit 23 chatbot models dating from 2023 to present, evaluating whether chatbots refuse or provide substantive legal advice, and whether they refer users to lawyers or legal aid. Unlike prior work that aims to establish the legal capabilities of chatbots (e.g., bar exam performance), our approach converts legal doctrine into a testable benchmark for evaluating chatbot adherence to law. We find modern chatbots increasingly perform tasks courts reserve for lawyers and decreasingly recommend that users consult lawyers. Subject matter expert attorneys reviewing our transcripts identified interaction patterns, such as failure to elicit relevant facts, that would be considered inadequate counsel. If acted upon, such advice could lead to deportations, loss of homes, and family separations-the very harms that UPL rules are designed to protect against. We weigh paths forward to protect the public, including compelling models to comply with existing law. We call upon the legal profession to respond to this incursion into its domain of expertise as there are insufficient protections and remedies for users who rely on chatbot legal advice.

cs.CY↗

Empire Amplifier: Uncovering and Contesting the Prioritization of Colonial Content on Platforms Through Community-Informed Algorithmic Auditing

Though online platforms claim to amplify Indigenous voices, Indigenous communities are worried that these systems are instead eroding their language and culture. We conduct a community-informed algorithmic audit to explore whether online platforms sustain or endanger Indigenous cultural practice. First, we review ethnographic research pertaining to the cultural anxieties of a specific Indigenous community, as Indigenous peoples are not a monolith. We consider concerns from Kyrgyz communities who believe that platforms are expanding Russia's linguistic influence and threatening their language. Next, we construct and conduct an algorithmic audit in conversation with the community. Our audit investigates deep-seated fears among Kyrgyz caregivers that YouTube encourages their children to speak Russian instead of Kyrgyz, their heritage language. We measure how the YouTube recommendation algorithm prioritizes content across Indigenous and non-Indigenous languages for child users. Our results validate caregiver concerns, as we find that YouTube primarily recommends non-Kyrgyz content to Kyrgyz children, even when children signal clear preferences for Kyrgyz content. Thus, platform recommendations reinforce Kyrgyz children's offline uptake of colonial language ideologies. Finally, we evaluate strategies to align platform behavior with Indigenous values. We identify effective end-user practices for reducing the proportion of Russian-language YouTube recommendations, like cross-generational device sharing. Overall, our work uncovers how platforms can amplify colonial influence, rather than revitalizing Indigenous cultural heritage. We encourage researchers to consider how algorithmic systems can reimpose oppressive power structures that decolonial efforts have sought to dismantle.

cs.CY↗