arXiv · 2611.14415
Exploring Post-Hoc Disentanglement of Audio Foundation Models for Music Similarity
Abstract
Audio foundation models like CLAP, MuQ, and MERT excel at capturing general musical similarity. On the other hand, their entangled latent spaces limit interpretability and fine-grained attribute control. Conditional Similarity Networks (CSN) address this by pairing a backbone representation model with learned masks that gate the embedding space into attribute-specific subspaces. However, existing methods train the backbone from scratch, rather than leveraging pretrained foundation models. We instead present a systematic study of post-hoc disentanglement, adapting CSN to gate frozen pretrained embeddings. We evaluate adding trainable parameters to adapt the embedding under different masking and pooling regimes across two datasets. Our findings show that minimal adaptation capacity is sufficient for post-hoc gating to improve both attribute-specific disentanglement and overall retrieval performance, while pooling, masking, and depth choices yield limited additional gains.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Lucas de Souza Brandão, Gabriel da Costa Merlin, Diego Furtado Silva. 2026-11-10. Exploring Post-Hoc Disentanglement of Audio Foundation Models for Music Similarity. https://searcharxiv.com/abs/2611.14415
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.