In the context of immersive sonic interaction, Virtual Reality Musical Instruments have had the relative majority of attention thus far, fueled by the increasing availability of affordable technology. Recent advances in Mixed Reality (MR) experiences have provided the means for a new wave of research that goes beyond Virtual Reality. In this paper, we propose a new classification of Virtual Musical Instrument, known as a Mixed Reality Musical Instrument (MRMI). We define this system as an embodied interface for expressive musical performance, characterized by the relationships between the performer, the virtual, and the physical environment. We offer a dimensional framework to support the analysis and design of MRMIs, illustrate its use with application to existing works, and evaluate it through expert interviews. These interviews highlight both the importance of the framework in a nascent domain and suggest further consideration of musical practice. Finally, we present Wavelength, a novel MRMI based on the metaphor of wave terrain synthesis, which we evaluate using audience perception of an improvised performance, personal reflection, and our proposed framework. We are able to conclude with a demonstrable appeal for musical performance in MR—a promising future for MRMIs.

Creator

• Zellerbach, Karitta Christina

Contributors

• Smith, Gillian Margaret
• Roberts, Charles Davis

Degree

• MS

Unit

• Interactive Media & Game Development

Publisher

• Worcester Polytechnic Institute

Identifier

• etd-71896

Keyword

• Musical Expression
• Wave Terrain Synthesis
• Mixed Reality Musical Instruments
• Mixed Reality
• Virtual Musical Instrument

Advisor

• Roberts, Charles Davis

Defense date

• 2022-08-12

Year

• 2022

Sponsor

• Microsoft

Date created

• 2022-08-11

Resource type

• Thesis

Source

• etd-71896

Rights statement

• In Copyright

Last modified

• 2023-11-07