iotracker optical motion capture system, developed by Vienna UT, is used to track the amputee's arm and head movement to allow for 3D input and correct visualization of the virtual environment in a head mounted display. Along with the tracking data, electromyography is used to generate input for grasping control of the virtual prosthesis, creating a realistic simulation. Tracking data of iotracker and electromyography is fed into ARTiFICE, an Augmented Reality Framework for Distributed Collaboration. ARTiFICe maps the tracking data to the virtual objects, using Unity3D game engine for networking, real time rendering and object’s physical behaviour.
Hannes Kaufmann, Michael Bressler, Andrei Ninu, Christian Schönauer, Annette Mossel
Project Time: 2011 - today
Links: Project Homepage
Related Talks & Publications:
- 08 / 2012 "Virtual Reality Training for Upper Limb Prosthesis Patients" , Unite'12 (Serious Gaming Session), Amsterdam, Netherlands