The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments - CRISTAL-MINT
Conference Papers Year : 2018

The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments

Abstract

Mobile devices have been a promising platform for musical performance thanks to the various sensors readily available on board. In particular, mobile cameras can provide rich input as they can capture a wide variety of user gestures or environment dynamics. However, this raw camera input only provides continuous parameters and requires expensive computation. In this paper, we propose combining camera based motion/gesture input with the touch input, in order to filter movement information both temporally and spatially , thus increasing expressiveness while reducing computation time. We present a design space which demonstrates the diversity of interactions that our technique enables. We also report the results of a user study in which we observe how musicians appropriate the interaction space with an example instrument.
Fichier principal
Vignette du fichier
Nime_18_PwF.pdf (2.02 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01809210 , version 1 (06-06-2018)

Identifiers

  • HAL Id : hal-01809210 , version 1

Cite

Cagan Arslan, Florent Berthaut, Jean Martinet, Ioan Marius Bilasco, Laurent Grisoni. The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments. NIME 2018 - 18th International Conference on New Interfaces for Musical Expression, Jun 2018, Blacksburg, VA, United States. ⟨hal-01809210⟩
407 View
353 Download

Share

More