Searcharxiv⌕ Search

arXiv subjects

Paul Triana

Publications and source records attributed to Paul Triana.

2 recordsLinked to original sources

Small Data Generative AI for Culturally Specific Artistic Creation: A Case Study on the Sonic Space of sarir

Large-scale generative AI (GenAI) models have become increasingly integrated into contemporary creative practice, yet they often reproduce cultural biases and fail to meaningfully engage with non-Western artistic traditions. In response, this paper explores a small-data approach that foregrounds artist-curated and culturally informed dataset creation and model training. Through a case study on sarir (the distinctive sound produced by the reed pen in Persian calligraphy), we demonstrate how small-data GenAI can operate within a highly situated cultural context that lies beyond the representational reach of large-scale GenAI models. We construct a bespoke sarir audio dataset and train two models, RAVE and StyleGAN2, adapting each to the sonic domain through audio synthesis and spectrogram generation. The resulting models learn the fine-grained timbral and gestural nuances of sarir, enabling both real-time interaction and extended generative output. By comparing these results with state-of-the-art text-to-audio models, we clearly demonstrate the disparity in their performance and highlight the expressive possibilities unlocked through the small data approach. This focused case study demonstrates the feasibility of small-data GenAI for culturally specific artistic creation and underscores the value of further investigations that extend this approach to other cultural materials and artistic domains.

cs.SD↗

MIDI-GPT: A Controllable Generative Model for Computer-Assisted Multitrack Music Composition

We present and release MIDI-GPT, a generative system based on the Transformer architecture that is designed for computer-assisted music composition workflows. MIDI-GPT supports the infilling of musical material at the track and bar level, and can condition generation on attributes including: instrument type, musical style, note density, polyphony level, and note duration. In order to integrate these features, we employ an alternative representation for musical material, creating a time-ordered sequence of musical events for each track and concatenating several tracks into a single sequence, rather than using a single time-ordered sequence where the musical events corresponding to different tracks are interleaved. We also propose a variation of our representation allowing for expressiveness. We present experimental results that demonstrate that MIDI-GPT is able to consistently avoid duplicating the musical material it was trained on, generate music that is stylistically similar to the training dataset, and that attribute controls allow enforcing various constraints on the generated material. We also outline several real-world applications of MIDI-GPT, including collaborations with industry partners that explore the integration and evaluation of MIDI-GPT into commercial products, as well as several artistic works produced using it.

cs.SD↗