Featured Research

from universities, journals, and other organizations

New computer vision system for the analysis of human behavior

Date:
January 16, 2010
Source:
Universitat Autonoma de Barcelona
Summary:
Scientists have developed a cognitive computational system consisting of video cameras and software able to recognize and predict human behavior, as well as describe it in natural language. The applications of this project, called the Hermes project, are numerous and can be used in the fields of intelligent surveillance, protection of accidents, marketing, psychology, etc.

A consortium of European researchers, coordinated by the Computer Vision Centre (CVC) of Universitat Autònoma de Barcelona (UAB), has developed HERMES, a cognitive computational system consisting of video cameras and software able to recognise and predict human behaviour, as well as describe it in natural language. The applications of the Hermes project are numerous and can be used in the fields of intelligent surveillance, protection of accidents, marketing, psychology, etc.

HERMES (Human Expressive Graphic Representation of Motion and their Evaluation in Sequences) analyses human behaviour based on video sequences captured at three different focus levels: the individual as a relatively distant object; the individual's body at medium length so as to be able to analyse body postures; and the individual's face, which allows a detailed study of facial expressions. The information obtained is processed by computer vision and artificial intelligence algorithms, which permits the system to learn and recognise movement patterns.

HERMES offers two important innovations in the field of computer vision. The first is the description of in natural language movement captured by the cameras, through simple and precise phrases which appear on the computer screen in real time, together with the frame number in which the action is taking place. The system uses an avatar to talk and describe this information in different languages. The second innovation is the possibility to analyse and discover potentially unusual behaviour -- based on the movements it recognises -- and give off warning signals. For example, HERMES sends a signal to the control centre of an underground station after capturing the image of someone trying to cross the tracks, or alerts a medical centre if an elderly person living alone falls.

Seven different sub-projects have been developed by researchers working on the HERMES project:

  1. Cameras system: static cameras were used to supply a full scene, and high resolution active cameras -- pan-tilt-zoom sensors (horizontal and vertical inclinations and zoom) -- were used for the automatic tracking and close-ups of individuals. To do this, optimisation techniques were applied to the information contained in the images.
  2. Movement analysis of objects and individuals in the images. The information obtained is used to guide the active cameras towards where the action is taking place. These tasks were carried out using different tracking techniques.
  3. Movement analysis of a person's body in order to extract information from different parts of the body, analyse these actions and describe or predict behaviours. In this case, techniques based on pattern and silhouette recognition were used.
  4. Analysis of facial movements to understand emotional states of an individual, attitudes and possible reactions. In this sub-project new techniques were created and used for the tracking and aligning of 2D and 3D faces.
  5. Integration of software and natural language with the aim of describing what is happening in the scenes recorded using a conceptual representation scheme.
  6. Full integration of system, software and hardware to work in real environments and in real time. The system was designed and put to use in real life situations to test its functioning.
  7. The generation of virtual sequences based on the description of behaviours in natural language and the interaction of real and virtual worlds in the same sequence, using increased reality techniques.

The application advantages of HERMES are obvious, mainly in the fields of intelligent surveillance and the prevention of accidents or crimes. However, researchers consider that there is much to be gained with the use of this tool in sectors such as marketing or psychology.


Story Source:

The above story is based on materials provided by Universitat Autonoma de Barcelona. Note: Materials may be edited for content and length.


Cite This Page:

Universitat Autonoma de Barcelona. "New computer vision system for the analysis of human behavior." ScienceDaily. ScienceDaily, 16 January 2010. <www.sciencedaily.com/releases/2010/01/100113104300.htm>.
Universitat Autonoma de Barcelona. (2010, January 16). New computer vision system for the analysis of human behavior. ScienceDaily. Retrieved July 24, 2014 from www.sciencedaily.com/releases/2010/01/100113104300.htm
Universitat Autonoma de Barcelona. "New computer vision system for the analysis of human behavior." ScienceDaily. www.sciencedaily.com/releases/2010/01/100113104300.htm (accessed July 24, 2014).

Share This




More Mind & Brain News

Thursday, July 24, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

New Painkiller Designed To Discourage Abuse: Will It Work?

New Painkiller Designed To Discourage Abuse: Will It Work?

Newsy (July 24, 2014) — The FDA approved Targiniq ER on Wednesday, a painkiller designed to keep users from abusing it. Like any new medication, however, it has doubters. Video provided by Newsy
Powered by NewsLook.com
China's Ageing Millions Look Forward to Bleak Future

China's Ageing Millions Look Forward to Bleak Future

AFP (July 24, 2014) — China's elderly population is expanding so quickly that children struggle to look after them, pushing them to do something unexpected in Chinese society- move their parents into a nursing home. Duration: 02:07 Video provided by AFP
Powered by NewsLook.com
Idaho Boy Helps Brother With Disabilities Complete Triathlon

Idaho Boy Helps Brother With Disabilities Complete Triathlon

Newsy (July 23, 2014) — An 8-year-old boy helped his younger brother, who has a rare genetic condition that's confined him to a wheelchair, finish a triathlon. Video provided by Newsy
Powered by NewsLook.com
Huge Schizophrenia Study Finds Dozens Of New Genetic Causes

Huge Schizophrenia Study Finds Dozens Of New Genetic Causes

Newsy (July 22, 2014) — The 83 new genetic markers could open dozens of new avenues for schizophrenia treatment research. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

    Health News

      Environment News

        Technology News



          Save/Print:
          Share:  

          Free Subscriptions


          Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

          Get Social & Mobile


          Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

          Have Feedback?


          Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
          Mobile iPhone Android Web
          Follow Facebook Twitter Google+
          Subscribe RSS Feeds Email Newsletters
          Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins