Lyons, Michael J., Haehnel, Michael, Tetsutani, Nobuji

2003

Designing, Playing, and Performing with a Vision-based Mouth Interface

In Proceedings of the 2003 International Conference on New Interfaces for Musical Expression (NIME-03). Montreal, Canada: 116-121.

URL: http://hct.ece.ubc.ca/nime/2003/onlineproceedings/Papers/NIME03_Lyons.pdf

Language(s): English

Keyword(s):

Electroacoustic Devices Electroacoustic Instruments

Abstract:

In this paper, the authors present the ’Mouthesizer’ a system that uses a headworn miniature camera and computer vision algorithm to extract shape parameters from the mouth opening and output these as MIDI control changes.