FAAST: The flexible action and articulated skeleton toolkit

Evan A. Suma, Belinda Lange, Albert Rizzo, David M. Krum, Mark Bolas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

141 Scopus citations

Abstract

The Flexible Action and Articulated Skeleton Toolkit (FAAST) is middleware to facilitate integration of full-body control with virtual reality applications and video games using OpenNI-compliant depth sensors (currently the PrimeSensor and the Microsoft Kinect). FAAST incorporates a VRPN server for streaming the user's skeleton joints over a network, which provides a convenient interface for custom virtual reality applications and games. This body pose information can be used for goals such as realistically puppeting a virtual avatar or controlling an on-screen mouse cursor. Additionally, the toolkit also provides a configurable input emulator that detects human actions and binds them to virtual mouse and keyboard commands, which are sent to the actively selected window. Thus, FAAST can enable natural interaction for existing off-the-shelf video games that were not explicitly developed to support input from motion sensors. The actions and input bindings are configurable at run-time, allowing the user to customize the controls and sensitivity to adjust for individual body types and preferences. In the future, we plan to substantially expand FAAST's action lexicon, provide support for recording and training custom gestures, and incorporate real-time head tracking using computer vision techniques.

Original languageEnglish (US)
Title of host publicationVR 2011 - IEEE Virtual Reality 2011, Proceedings
Pages247-248
Number of pages2
DOIs
StatePublished - 2011
Externally publishedYes
Event18th IEEE Virtual Reality Conference, VR 2011 - Singapore, Singapore
Duration: Mar 19 2011Mar 23 2011

Publication series

NameProceedings - IEEE Virtual Reality

Other

Other18th IEEE Virtual Reality Conference, VR 2011
CountrySingapore
CitySingapore
Period3/19/113/23/11

Keywords

  • depth-sensing cameras
  • gestures
  • middleware
  • video games

Fingerprint Dive into the research topics of 'FAAST: The flexible action and articulated skeleton toolkit'. Together they form a unique fingerprint.

Cite this