By 2030, the World Health Organization estimates that over 2.5 billion people will need assistive technologies, yet nearly one billion will lack access, posing significant barriers to inclusion. While often considered non-essential, creative technologies, particularly in music, have demonstrated therapeutic value and support cognitive well-being. However, physical and cognitive barriers continue to restrict access to active music-making. This work addresses the challenge of democratizing musical creativity by designing Digital Musical Interfaces (DMIs) that are inclusive, adaptable, and capable of supporting both performative and therapeutic goals. We propose a comprehensive design framework centered on accessibility, usability, and creative freedom. A key case study illustrates this framework through the development of a gesture-based music system, enabling users to create music solely through hand movements. The framework emerged through a structured series of technological milestones, incorporating AI, IoT, Virtual (VR), and Augmented Reality (AR). Each stage introduced and evaluated specific innovation, such as deep reinforcement learning for gesture recognition, low-latency VR/AR environments, multiplayer interaction, and integration with a full-featured digital audio workstation—via experimental prototypes and iterative user testing. Results of a user evaluation involving educators, musicians, and users, indicate that this interdisciplinary and user-centered approach effectively supports motor-impaired users while remaining accessible and engaging for broader populations.
`Designing accessible Digital Musical Interfaces for democratizing the music creativity
R. Zaccagnino;D. Malandrino;G. Zaccagnino;N. Lettieri;
2025
Abstract
By 2030, the World Health Organization estimates that over 2.5 billion people will need assistive technologies, yet nearly one billion will lack access, posing significant barriers to inclusion. While often considered non-essential, creative technologies, particularly in music, have demonstrated therapeutic value and support cognitive well-being. However, physical and cognitive barriers continue to restrict access to active music-making. This work addresses the challenge of democratizing musical creativity by designing Digital Musical Interfaces (DMIs) that are inclusive, adaptable, and capable of supporting both performative and therapeutic goals. We propose a comprehensive design framework centered on accessibility, usability, and creative freedom. A key case study illustrates this framework through the development of a gesture-based music system, enabling users to create music solely through hand movements. The framework emerged through a structured series of technological milestones, incorporating AI, IoT, Virtual (VR), and Augmented Reality (AR). Each stage introduced and evaluated specific innovation, such as deep reinforcement learning for gesture recognition, low-latency VR/AR environments, multiplayer interaction, and integration with a full-featured digital audio workstation—via experimental prototypes and iterative user testing. Results of a user evaluation involving educators, musicians, and users, indicate that this interdisciplinary and user-centered approach effectively supports motor-impaired users while remaining accessible and engaging for broader populations.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
