ScienceDaily (Dec. 27, 2008) — A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. 

Manolya Kavakli of the Virtual and Interactive Simulations of Reality Research Group, at Macquarie University, Sydney, Australia, explains how standard input devices - keyboard and computer mouse, do not closely mimic natural hand motions such as drawing and sketching. Moreover, these devices have not been developed for ergonomic use nor for people with disabilities.

She and her colleagues have developed a computer system architecture that can carry out "gesture recognition". In this system, the person wears "datagloves" which have illuminated LEDs that are tracked by two pairs of computer webcams working to produce an all-round binocular view. This allows the computer to monitor the person's hand or shoulder movements. This input can then be fed to a program, a game, or simulator, or to control a character, an avatar, in a 3D virtual environment.

"We developed two gesture recognition systems: DESigning In virtual Reality (DesIRe) and DRiving for disabled (DRive). DesIRe allows any user to control dynamically in real-time simulators or other programs. DRive allows a quadriplegic person to control a car interface using input from just two LEDs on an over-shoulder garment. For more precise gestures, a DataGlove user can gesture using their fingers.

The system architecture include the following components: Vizard Virtual Reality Toolkit, an immersive projection system (VISOR), an optical tracking system (specifically the Precision Position Tracker (PPT) system) and a data input system, Kavakli explains. The DataGlove input is quite simplistic at the moment, but future work will lead to an increase in sensitivity to specific gestures, such as grasping, strumming, stroking, and other hand movements.

Journal reference:

1. Manolya Kavakli. Gesture recognition in virtual reality. Int. J. Arts and Technology, 2008, 1, 215-229

Related Stories

Eye-tracking Software Opens Online Worlds To People With Disabilities (July 1, 2009) — Technology that allows gamers to control game functions with only their eyes is helping to open virtual worlds such as Second Life and World of Warcraft to people with severe motor disabilities. For ...  > read more

'Audioclouds' That Will Help Us Compute More Safely On The Move (Apr. 16, 2005) — New research by UK scientists that enables people to interact safely with mobile computers while walking, running or driving, could help to prevent users from putting themselves in ...  > read more

Unemployment And Poverty Remain Dramatically High Among Workers With Disabilities (Nov. 21, 2007) — There is a dramatic employment and poverty gap between working-age people with disabilities and those without disabilities. Almost 38 percent of people with disabilities are employed, compared with ...  > read more

Second Life Data Offers Window Into How Trends Spread (July 3, 2009) — Do friends wear the same style of shoe or see the same movies because they have similar tastes, which is why they became friends in the first place? Or once a friendship is established, do ...  > read more

Search ScienceDaily

Hi-Tech Typing