The design of digital musical instruments is based on the perceptions, especially visual, that they can generate in users during their use. Given the multifaceted nature of musical expression, this aspect plays a crucial role in shaping their playability, requiring careful selection of the information to integrate into the instrument's interface. In this context, the music visualization techniques can offer substantial assistance, aiding in the pedagogical process of mastering these tools. In this work, we introduce Pulsate, an Android application engineered to enable real-time music composition by leveraging visual perceptions generated through the collision dynamics of geometric shapes resulting from the user's tactile interactions at specific points on the screen. The development of Pulsate involved the integration of various features: (i) provision for polytonality and different musical scales, (ii) internal playback modes which include percussive, harmonic, and melodic functionalities, (iii) incorporation of the MIDI protocol to facilitate control over external instruments. Through these features, Pulsate offers an intuitive platform for real-time music production. To realize this objective, we capitalized on graphics-oriented programming language processing capabilities. An evaluation study was conducted to assess the efficacy of how music can be produced expressively, involving a heterogeneous cohort of participants with varied musical backgrounds and degrees of proficiency in music theory. A further usability study was conducted to analyze the overall user satisfaction. The results of these studies provided us with positive feedback regarding the effectiveness of the concept, the aesthetic appeal of the graphical interface, and user satisfaction concerning the usability and utility of the provided tool.
Visual Music Perception for Stochastic Music Composition
Roberto De Prisco;Nicola Lettieri;Luigi Lomasto;Delfina Malandrino;Rocco Zaccagnino
2024-01-01
Abstract
The design of digital musical instruments is based on the perceptions, especially visual, that they can generate in users during their use. Given the multifaceted nature of musical expression, this aspect plays a crucial role in shaping their playability, requiring careful selection of the information to integrate into the instrument's interface. In this context, the music visualization techniques can offer substantial assistance, aiding in the pedagogical process of mastering these tools. In this work, we introduce Pulsate, an Android application engineered to enable real-time music composition by leveraging visual perceptions generated through the collision dynamics of geometric shapes resulting from the user's tactile interactions at specific points on the screen. The development of Pulsate involved the integration of various features: (i) provision for polytonality and different musical scales, (ii) internal playback modes which include percussive, harmonic, and melodic functionalities, (iii) incorporation of the MIDI protocol to facilitate control over external instruments. Through these features, Pulsate offers an intuitive platform for real-time music production. To realize this objective, we capitalized on graphics-oriented programming language processing capabilities. An evaluation study was conducted to assess the efficacy of how music can be produced expressively, involving a heterogeneous cohort of participants with varied musical backgrounds and degrees of proficiency in music theory. A further usability study was conducted to analyze the overall user satisfaction. The results of these studies provided us with positive feedback regarding the effectiveness of the concept, the aesthetic appeal of the graphical interface, and user satisfaction concerning the usability and utility of the provided tool.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
