topleft topright
THE ARCHITECTURE OF MULTIMODAL COMMUNICATION E-mail

 

Date: 23/01/09

Venue: MS020

Time: 3.00 pm

Speaker: Dr. Kristinn Thórisson

Affiliation: Reykjavík University, ICELAND

 

Seminar Title: The Architecture of multimodal communication

 



THE ARCHITECTURE OF MULTIMODAL COMMUNICATION
By

Dr. Kristinn Thórisson
http://www.ru.is/faculty/thorisson


Center for Analysis and Design of Intelligent Agents (CADIA)
Department of Computer Science
Reykjavík University, ICELAND



Abstract

Getting computers to respond in a human-like manner during real-time dialogue presents numerous challenges. One of the larger and often overlooked issues is the highly dynamic nature of such interaction. This includes how conversants decide, in fact negotiate, how to ``divide the work'' of talking, using various kinds of multimodal behaviors for orchestration. Over the past decade research into multimodal communication has brought some progress to this issue but significant questions remain. For a deeper understanding of dialogue -- and indeed general cognitive issues related to communication -- we need to consider what kinds of system architectures can support the complex integration of the many types of skills and behaviors exhibited by people in real-time, natural communication. I will describe my work on these topics spanning the last ten years, from Gandalf the Communicative Humanoid to the latest results at CADIA in communicative and architectural modeling.





Biography

Dr. Kristinn Thórisson is an Associate Professor in the Department of Computer Science at Reykjavík University, Iceland. He has been researching artificial intelligence for two decades, in academia and industry. At MIT he created one of the first virtual humanoids with integrated multi-modal perception and action; as Chief Wizard at LEGO Digital he directed the creation of a large virtual world inhabited by interactive creatures. In New York he directed the development of automated virtual sales assistants for Internet commerce. He is the co-founder of Radar Networks Inc., a San Francisco startup, and has consulted on technology and business for British Telecom, Kaupthing and NASA. He is currently at CADIA (http://cadia.ru.is) - Reykjavik University's AI lab -- where is he founding co-director. Kris holds a B.A. in Psychology (U. Iceland), an M.S. in Engineering Psychology (Florida Tech) and a Ph.D. in Media Arts and Sciences from the MIT Media Laboratory. http://www.ru.is/faculty/thorisson.