ScienceDaily (Apr. 22, 2008) — A computer system that can carry on a discussion with a human being by reacting to signals such as tone of voice and facial expression is being developed by an international team including Queen's University Belfast.

Known as SEMAINE, the project will build a Sensitive Artificial Listener (SAL) system, which will perceive a human user's facial expression, gaze, and voice and then engage with the user. When engaging with a human, the SAL will be able to adapt its own performance and pursue different actions, depending on the non-verbal behaviour of the user.

SEMAINE is led by DFKI, the German centre for research on Artificial Intelligence: the other partners are Imperial College, London, the University of Paris 8, the University of Twente in Holland, and the Technical University of Munich.

Professor Roddy Cowie, from the School of Psychology, leads the team at Queen's. He said: "A basic feature of human communication is that it is coloured by emotion. When we talk to another person, the words are carried on an undercurrent of signs that show them what attracts us, what bores us and so on. The fact that computers do not currently do this is one of the main reasons why communicating with them is so unlike interacting with a human. It is also one of the reasons we can find them so frustrating," said Professor Cowie.

"SEMAINE and projects like it will change the way people interact with technology. They mean that you will be talking to your computer in 20 years time. When you do, pause for a minute, and remember that the human sciences at Queen's helped to lay the groundwork.

"These new developments depend on connecting technology to the relevant understanding of people, and it is recognised worldwide that we have a distinctive strength in bringing psychology, linguistics and ethics to bear on the process of developing the new systems."

Professor Cowie added: "Today when we use technology we adopt a style of communication that suits the machine. Through projects like HUMAINE, SEMAINE, and others linked to them, we will develop technology that will eventually communicate in ways that suit human beings."

The European Commission awarded SEMAINE a grant of €2.75 million after it was ranked first out of 143 bids for medium-sized projects in the area of cognitive systems and robotics.

GRETA - an embodied conversational agent. Looking on are Prof Roddy Cowie of Queen's and Prof Maja Pantic from the University of Twente in Holland who is also a Reader in Imperial College London. (Credit: Image courtesy of Queen's University Belfast)

Related Stories

New Step Taken Towards A Machine Capable Of Face Recognition (Feb. 20, 2007) — A recent study shows that facial recognition through machine vision is technically possible. This raises interesting prospects for future machine vision ...  > read more

Say ChEES(e): Software Helps UF Researchers Compare Expressions In Men And Women (Feb. 19, 2001) — University of Florida researchers have turned to computer technology to quantify gender differences in one component of emotional expression -- how it is revealed by the face. They discovered that ...  > read more

Avatars As Communicators Of Emotions (July 10, 2008) — Current interactive systems enable users to communicate with computers in many ways, but not taking into account emotional communication. A Ph.D. thesis puts forward the use of avatars or virtual ...  > read more

UK Experts Develop Super-realistic Animation System (Apr. 4, 2005) — Computing experts at Cardiff University, UK, are developing a super-realistic animation system that simulates the movements of a face, based on ...  > read more

Search ScienceDaily

Movie Magic