SearcharxivSearch

arXiv subjects

Michael Clemens

Publications and source records attributed to Michael Clemens.

6 recordsLinked to original sources

Proceedings of The Fourth International Workshop on eXplainable AI for the Arts (XAIxArts 4)

The fourth workshop on Explainable AI for the Arts (XAIxArts) continues to bring together and expand a community of researchers and creative practitioners in Human-Computer Interaction (HCI), Interaction Design, AI, eXplainable AI (XAI), and Digital Arts to explore the role of XAI for the Arts. XAI is a key concern of Responsible and Human-Centred AI, emphasising HCI techniques that make opaque AI models more understandable to people. XAIxArts offers a distinctive lens to examine explainability through creative and artistic domains. The previous workshops explored the landscape and the speculative futures of AI in creative processes. To respond to emerging challenges and contribute to creative and societal transformation more broadly, this workshop focuses on the operationalisation of XAI in the Arts. Specifically, we will: i) critically reflect on emerging practices that encourage diversity and inclusivity in XAI; ii) collectively ideate a library of missing projects to encourage future collaborations and speculations; iii) scope the development of a resource hub for open XAIxArts projects to archive tangible XAI interventions and facilitate future community building with the wider discourse on Human-Centred AI.

cs.HC

MixAssist: An Audio-Language Dataset for Co-Creative AI Assistance in Music Mixing

While AI presents significant potential for enhancing music mixing and mastering workflows, current research predominantly emphasizes end-to-end automation or generation, often overlooking the collaborative and instructional dimensions vital for co-creative processes. This gap leaves artists, particularly amateurs seeking to develop expertise, underserved. To bridge this, we introduce MixAssist, a novel audio-language dataset capturing the situated, multi-turn dialogue between expert and amateur music producers during collaborative mixing sessions. Comprising 431 audio-grounded conversational turns derived from 7 in-depth sessions involving 12 producers, MixAssist provides a unique resource for training and evaluating audio-language models that can comprehend and respond to the complexities of real-world music production dialogues. Our evaluations, including automated LLM-as-a-judge assessments and human expert comparisons, demonstrate that fine-tuning models such as Qwen-Audio on MixAssist can yield promising results, with Qwen significantly outperforming other tested models in generating helpful, contextually relevant mixing advice. By focusing on co-creative instruction grounded in audio context, MixAssist enables the development of intelligent AI assistants designed to support and augment the creative process in music mixing.

cs.SD

XAIxArts Manifesto: Explainable AI for the Arts

Explainable AI (XAI) is concerned with how to make AI models more understandable to people. To date these explanations have predominantly been technocentric - mechanistic or productivity oriented. This paper introduces the Explainable AI for the Arts (XAIxArts) manifesto to provoke new ways of thinking about explainability and AI beyond technocentric discourses. Manifestos offer a means to communicate ideas, amplify unheard voices, and foster reflection on practice. To supports the co-creation and revision of the XAIxArts manifesto we combine a World Caf\'e style discussion format with a living manifesto to question four core themes: 1) Empowerment, Inclusion, and Fairness; 2) Valuing Artistic Practice; 3) Hacking and Glitches; and 4) Openness. Through our interactive living manifesto experience we invite participants to actively engage in shaping this XIAxArts vision within the CHI community and beyond.

cs.HC

Explaining the Arts: Toward a Framework for Matching Creative Tasks with Appropriate Explanation Mediums

Although explainable computational creativity seeks to create and sustain computational models of creativity that foster a collaboratively creative process through explainability, there remains little to no work in supporting designers when exploring the explanation medium. While explainable artificial intelligence methods tend to support textual, visual, and numerical explanations, within the arts, interaction mediums such as auditorial, tactile, and olfactoral may offer more salient communication within the creative process itself. Through this research, I propose a framework to assist designers of explainable user interfaces in modeling the type of interaction they wish to create using explanations.

cs.HC