Paper on Generative AI 4 Sound Design accepted at CHI 2024
Our paper Sound Designer-Generative AI Interactions: Towards Designing Creative Support Tools for Professional Sound Designers has been accepted to CHI 2024! Congratulations to Purnima Kamath and the rest of the team (Suranga Nanayakkara, Priambudi Lintang Bagaskara, and Yize Wei).
The practice of sound design involves creating and manipulating environmental sounds for music, films, or games. Recently, an increasing number of studies have adopted generative AI to assist in sound design co-creation. Most of these studies focus on the needs of novices, and less on the pragmatic needs of sound design practitioners. In this paper, we aim to understand how generative AI models might support sound designers in their practice. We designed two interactive generative AI models as Creative Support Tools (CSTs) and invited nine professional sound design practitioners to apply the CSTs in their practice. We conducted semi-structured interviews and reflected on the challenges and opportunities of using generative AI in mixed-initiative interfaces for sound design. We provide insights into sound designers’ expectations of generative AI and highlight opportunities to situate generative AI-based tools within the design process. Finally, we discuss design considerations for human-AI interaction researchers working with audio.