Publication details
MUSE framework 2.0
| Authors | |
|---|---|
| Year of publication | 2015 |
| MU Faculty or unit | |
| Web | Domovská stránka projektu MUSE framework |
| Description | MUSE is a framework for developing cost-affordable interactive environments. It allows for rapid development of interactive systems based on tabletops and interactive tiled-display walls as well as for general interactive spaces. It could serve as a testing environment for a development of new interaction techniques for large-scale interactive systems. The framework provides different interaction possibilities of multimodal user interfaces which are made of multiple low-cost commodity devices (e.g., single- and multi-touch overlay panels and foils, web cameras, depth sensors). Main features of the framework: a) coupling of multiple low-cost commodity multi-touch sensors which are represented as a single seamless interface; b) functions for distinguishing and continuous association of users and touch operations they performed; c) hand-tracking for identification and distinguishing users' body parts (e.g., hands) used in association with touch input events; d) integration of gesture recognition algorithms Protractor, $1 and $N to provide experimental gesture recognition of touch events (libreco library) e) extended semantic description of input events enabling their personalisation (e.g., personalized gesture recognition); (libdtuio library) f) highly configurable toolkit and application base. Supported HW: majority of existing resistive and capacitive single- and multi-touch sensor overlay panels and devices, MS Kinect depth tracker in both versions, web cameras. Improvements in version 2.0: CLI tool for initial configuration of the framework, standalone internal communication protocol dTUIO, improved modules for building camera array (virtcam module) and MS Kinect v2 (mwkinectr2 module). Suppport for multi-Kinect/sensor orchestration. |
| Related projects: |