SearcharxivSearch

arXiv subjects

Dennis Müller

Publications and source records attributed to Dennis Müller.

At least 19 recordsLinked to original sources

Reframing AI Loss of Control: What Control Is, How to Have It, How to Lose It

At present, loss of control risks have gained much prominence in public discussion, particularly in relation to AI, with extensive discourse present among academics, frontier labs, and even governments. However, in the existing literature, the concept seems to rest on surprisingly weak foundations, where even those that discuss loss of control extensively do not first establish what control is and what exactly is being lost. Our paper aims to address these gaps. We establish a working definition of control by anchoring it to the "setting and getting of goals". Then, we discuss various aspects of control, built on foundational concepts from related fields like cybernetics, management control, and control theory. This includes who (or what) can be in control, and the things they require to be in control, such as the ability to set goals, having a functional control loop, having requisite variety, and having sufficient goal alignment. Once a framework for control is established, we then discuss how control can be lost, how AIs can contribute to such loss of control, and offer relevant recommendations for how one can maintain control. One interesting consequence of our work is that humanity, as individuals and as groups, can lose varying degrees of control as a result of AI behaviour that is far below the level of superintelligence; the potential for loss of control scenarios (as we define them) already exist, and have existed for a long time.

cs.CY

"We are currently clean on OPSEC": Why JD Can't Encrypt

We analyse the 2025 Signalgate leak of sensitive US military information by the Trump administration, addressing why confidentiality was violated (messages leaked to the press) in spite of encryption (Signal), to deepen the socio-technical considerations when designing and deploying encryption. First, we use applied pi-calculus to formally model the boutique secure facility setup requested by the US Defence Secretary, to prove that a leak would not be prevented. We then examine how using a secure channel might still not give overall information security, as, in this case, power imbalances between personnel and officials led to the application of cryptography that compromised their operational security. We look at how cryptographic tools may have instilled a false sense of security, and led officials to "overshare". We then apply this analysis to the Trump administration's general desire to burn through political, legal, and now technical process, and demonstrate geopolitical harms that may arise from such ineffective use of cryptography in a brief use case. We conclude that, even with advancements in usability of cryptographic tools, genuine message security is still out of reach of the "average user".

cs.CR

The Problem of Algorithmic Collisions: Mitigating Unforeseen Risks in a Connected World

The increasing deployment of Artificial Intelligence (AI) and other autonomous algorithmic systems presents the world with new systemic risks. While focus often lies on the function of individual algorithms, a critical and underestimated danger arises from their interactions, particularly when algorithmic systems operate without awareness of each other, or when those deploying them are unaware of the full algorithmic ecosystem deployment is occurring in. These interactions can lead to unforeseen, rapidly escalating negative outcomes - from market crashes and energy supply disruptions to potential physical accidents and erosion of public trust - often exceeding the human capacity for effective monitoring and the legal capacities for proper intervention. Current governance frameworks are inadequate as they lack visibility into this complex ecosystem of interactions. This paper outlines the nature of this challenge and proposes some initial policy suggestions centered on increasing transparency and accountability through phased system registration, a licensing framework for deployment, and enhanced monitoring capabilities.

cs.CY

The Mathematisation of the World: Uncovering the Socio-Economic Tensions for Ethics in Mathematics Education

The mathematisation of the socio-economic sphere, where mathematics actively constructs social reality, presents a challenge for studies on ethics in mathematics and its education. While existing scholarship on ethics in mathematics offers insights, it often remains philosophically driven and disconnected from other relevant disciplines. This paper addresses this gap by asking how debates on ethics in mathematics and its education can be connected with economic sociology, and what socio-economic tensions become visible through this connection. Drawing from concepts such as imagined futures, varieties of capitalism, and variegated capitalism, we synthesise a new perspective. This analysis reveals six interconnected tensions: a socio-economic valuation gap regarding ethics education; the multifaceted implementation of mathematics across different capitalist systems; its material opaqueness; a growing gap between economic power and social unaccountability; the enclosure of imagination limiting sustainable futures; and the erosion of multilateralism, which challenges critical pedagogy. The paper's contribution is a first step towards a structural socio-economic framework that links the limited literature on ethics in mathematics with these broader sociological perspectives.

math.HO

The Ethical and Sustainable Concerns Triangle: A Framework for Navigating Discourses in Mathematics and Its Education

The literature on ethics and sustainability in mathematics and its education is increasingly complex and fragmented, potentially leading to communication breakdowns between different scholarly traditions. To address this, the paper introduces the "Ethical and Sustainable Concerns Triangle," a framework that maps discourses based on their relative concern for three areas (represented as three vertices in the triangle): "Mathematics", "Community", and "Society/Planet". By integrating a systems theoretic perspective, we analyse discourses as dynamic systemic reactions to external irritations. Our analysis reveals that the field's fragmentation can be explained by the "location effect": the phenomenon whereby a discourse's position within the triangle shapes its perception and acceptance of other scholarship. By mapping key discourses and educator archetypes, the framework functions as a meta-heuristic tool. Ultimately, it serves not only to facilitate critical reflection but also as a call for the epistemic humility and dialogue needed to advance the field.

math.HO

Ethical and sustainable mathematics is localised: why global paradigms fail and culturally-situated practices are essential

This paper identifies several different interconnected challenges preventing the move towards more ethical and sustainable mathematics education: the entrenched belief in mathematical neutrality, the difficulty of simultaneously reforming mathematics and its pedagogy, the gap between academic theory and classroom practice, and the need for epistemic decolonisation. In this context, we look at both bottom-up and top-down approaches, and argue that globalised frameworks such as the United Nations' Sustainable Development Goals are insufficient for this transformation, and that ethical and sustainable forms of mathematics ought not to be built using these as their (philosophical) foundation. These frameworks are often rooted in a Western-centric development paradigm that can perpetuate colonial hierarchies and fails to resolve inherent conflicts between economic growth and ecological integrity. As an alternative, this paper advocates for embracing localised, culturally-situated mathematical practices. Using the Ethics in Mathematics Project as a case study within a Western, Global North institution, this paper illustrates a critical-pragmatic, multi-level strategy for fostering ethical consciousness within a specific research community, and shows how this may be achieved in otherwise adversarial circumstances.

math.HO

Formalising Human-in-the-Loop: Computational Reductions, Failure Modes, and Legal-Moral Responsibility

We use the notion of oracle machines and reductions from computability theory to formalise different Human-in-the-loop (HITL) setups for AI systems, distinguishing between trivial human monitoring (i.e., total functions), single endpoint human action (i.e., many-one reductions), and highly involved human-AI interaction (i.e., Turing reductions). We then proceed to show that the legal status and safety of different setups vary greatly. We present a taxonomy to categorise HITL failure modes, highlighting the practical limitations of HITL setups. We then identify omissions in UK and EU legal frameworks, which focus on HITL setups that may not always achieve the desired ethical, legal, and sociotechnical outcomes. We suggest areas where the law should recognise the effectiveness of different HITL setups and assign responsibility in these contexts, avoiding human "scapegoating". Our work shows an unavoidable trade-off between attribution of legal responsibility, and technical explainability. Overall, we show how HITL setups involve many technical design decisions, and can be prone to failures out of the humans' control. Our formalisation and taxonomy opens up a new analytic perspective on the challenges in creating HITL setups, helping inform AI developers and lawmakers on designing HITL setups to better achieve their desired outcomes.

cs.CY

Towards a Critical Pragmatic Philosophy of Sustainable Mathematics Education

This paper proposes critical pragmatism as a philosophy of sustainable mathematics education to bridge the gap between critical theory and the existing patchwork implementations. Combining existential sustainability as a holistic concept with pragmatic frameworks from the ethics in mathematics education literature creates a foundation enabling critical reflection and pragmatic implementation. We outline how their synthesis naturally leads to a three-stage implementation strategy: cultivating an ethical classroom culture, engaging with ethnomathematics, and tackling complex sustainability problems. Our critical pragmatic approach attempts to build a new philosophical perspective to equip teachers and students with the mathematical competencies, critical perspectives, and ethical grounding necessary to navigate and contribute to a sustainable future and to provide new analytic pathways.

math.HO

The Ethical Turn in Mathematics Education

This article analyzes the emerging ethical turn in mathematics education, arguing that it is a nuanced extension of the sociopolitical turn. While sociopolitical studies of mathematics have highlighted systemic issues and group concerns (e.g., equity, diversity, exclusion), the newer scholarship on ethics in mathematics presents a sharpened focus on the individual responsibility of learners, teachers, and mathematicians by explicitly engaging with philosophical ethics. We analyze key themes of the discourse, including the tension between "doing good" and "preventing harm," and present various philosophical foundations from which scholars have engaged with ethics: Levinas, non-Western perspectives, and pragmatism. We show that the ethical turn holds significant implications for training teachers, including self-reflection, responsibility towards the Other, historical and philosophical awareness, the role of mathematics in society, individual flexibility, cultural sensitivity, and courage to navigate the complex reality of today's mathematics classrooms. The article is designed to also serve as an introduction to ethics in mathematics education.

math.HO

Teaching Resources for Embedding Ethics in Mathematics: Exercises, Projects, and Handouts

The resources compiled in this document provide an approach to embed and teach Ethics in Mathematics at the undergraduate level. We provide mathematical exercises and homework problems that teach students ethical awareness and transferable skills, for many of the standard courses in the first and second years of a university degree in mathematics or related courses with significant mathematical content (e.g., physics, engineering, computer science, economics, etc). In addition to the exercises, this document also contains a list of projects, essay topics, and handouts for use as final projects and in seminars. This is a living document, and additional contributions are welcome.

math.HO

Integrators at War: Mediating in AI-assisted Resort-to-Force Decisions

The integration of AI systems into the military domain is changing the way war-related decisions are made. It binds together three disparate groups of actors - developers, integrators, users - and creates a relationship between these groups and the machine, embedded in the (pre-)existing organisational and system structures. In this article, we focus on the important, but often neglected, group of integrators within such a sociotechnical system. In complex human-machine configurations, integrators carry responsibility for linking the disparate groups of developers and users in the political and military system. To act as the mediating group requires a deep understanding of the other groups' activities, perspectives and norms. We thus ask which challenges and shortcomings emerge from integrating AI systems into resort-to-force (RTF) decision-making processes, and how to address them. To answer this, we proceed in three steps. First, we conceptualise the relationship between different groups of actors and AI systems as a sociotechnical system. Second, we identify challenges within such systems for human-machine teaming in RTF decisions. We focus on challenges that arise a) from the technology itself, b) from the integrators' role in the sociotechnical system, c) from the human-machine interaction. Third, we provide policy recommendations to address these shortcomings when integrating AI systems into RTF decision-making structures.

cs.CY

Leveraging Large Language Models to Generate Course-specific Semantically Annotated Learning Objects

Background: Over the past few decades, the process and methodology of automated question generation (AQG) have undergone significant transformations. Recent progress in generative natural language models has opened up new potential in the generation of educational content. Objectives: This paper explores the potential of large language models (LLMs) for generating computer science questions that are sufficiently annotated for automatic learner model updates, are fully situated in the context of a particular course, and address the cognitive dimension understand. Methods: Unlike previous attempts that might use basic methods like ChatGPT, our approach involves more targeted strategies such as retrieval-augmented generation (RAG) to produce contextually relevant and pedagogically meaningful learning objects. Results and Conclusions: Our results show that generating structural, semantic annotations works well. However, this success was not reflected in the case of relational annotations. The quality of the generated questions often did not meet educational standards, highlighting that although LLMs can contribute to the pool of learning materials, their current level of performance requires significant human intervention to refine and validate the generated content.

cs.AI

A Field Guide to Ethics in Mathematics

Mathematics has become inescapable in modern, digitized societies: there is hardly any area of life left that isn't affected by it, and we as mathematicians play a central role in this. Our actions affect what others, in particular our students, decide to do with mathematics, and how mathematics affects the world, for better or worse. In return, the study of ethics in mathematics (EiM) has become increasingly important, even though it is still unknown to many. This exposition tries to change that, by motivating ethics in mathematics as an interesting, tractable, non-trivial, well-defined and good research area for mathematicians to consider.

math.HO

Mathematical Artifacts Have Politics: The Journey from Examples to Embedded Ethics

We extend Langdon Winner's idea that artifacts have politics into the realm of mathematics. To do so, we first provide a list of examples showing the existence of mathematical artifacts that have politics. In the second step, we provide an argument that shows that all mathematical artifacts have politics. We conclude by showing the implications for embedding ethics into mathematical curricula. We show how acknowledging that mathematical artifacts have politics can help mathematicians design better exercises for their mathematics students.

math.HO

Manifesto for the Responsible Development of Mathematical Works -- A Tool for Practitioners and for Management

This manifesto has been written as a practical tool and aid for anyone carrying out, managing or influencing mathematical work. It provides insight into how to undertake and develop mathematically-powered products and services in a safe and responsible way. Rather than give a framework of objectives to achieve, we instead introduce a process that can be integrated into the common ways in which mathematical products or services are created, from start to finish. This process helps address the various issues and problems that can arise for the product, the developers, the institution, and for wider society. To do this, we break down the typical procedure of mathematical development into 10 key stages; our "10 pillars for responsible development" which follow a somewhat chronological ordering of the steps, and associated challenges, that frequently occur in mathematical work. Together these 10 pillars cover issues of the entire lifecycle of a mathematical product or service, including the preparatory work required to responsibly start a project, central questions of good technical mathematics and data science, and issues of communication, deployment and follow-up maintenance specifically related to mathematical systems. This manifesto, and the pillars within it, are the culmination of 7 years of work done by us as part of the Cambridge University Ethics in Mathematics Project. These are all tried-and-tested ideas, that we have presented and used in both academic and industrial environments. In our work, we have directly seen that mathematics can be an incredible tool for good in society, but also that without careful consideration it can cause immense harm. We hope that following this manifesto will empower its readers to reduce the risk of undesirable and unwanted consequences of their mathematical work.

math.HO

Mathematicians and Ethical Engagement

Building on Chiodo and Bursill-Hall (2018), we outline that mathematicians can demonstrate what we term the "four levels of ethical engagement."

math.HO

Questions of Responsibility: Modelling in the Age of COVID-19

When conducting COVID-19-related research, mathematicians may find themselves in public service roles. They might engage in policy discussions, collaborate with politicians and other non-scientists, and use the predictive power of mathematics to shape substantial decisions. We aim to promote good practice for ethical mathematical modelling in these difficult times. We begin with some observations about mathematical modellers, then derive eight questions that all mathematicians should constantly ask themselves, in order to develop their mathematics responsibly and ethically.

math.HO

A useful ethics framework for mathematics teachers

An argument is presented that mathematics teachers would benefit from an ethics framework that allows them to reflect upon their position regarding the teaching of ethics within mathematics. We present such a framework, adapted from Chiodo and Bursill-Hall's (2018) levels of ethical engagement for mathematicians, with discussion of its applications and implications. Awareness of ethical and social responsibility amongst mathematicians and mathematics educators is a newly established field, and yet it is crucially important, if we are to use mathematics for good and the avoidance of harm - in other words to use mathematics for justice, belonging, peace, care, education, lawmaking, building, creativity, equity, connection, fairness, rulemaking and order. Here, we present a way to extend ideas from ethics in the field of mathematics for mathematicians to the field of mathematics education for mathematics teachers, aiming to contribute to this transdisciplinary work and to advance the field further. We also explore links to ideas of equity, and silence and voice, drawing on the consequences of a deeper examination of the entanglements of mathematical-ethical dilemmas for mathematics teachers both inside and outside the classroom.

math.HO