Joint Action for Multimodal Embodied Social Systems

Overview

JAMES robot As robots become more integrated into our daily lives, they must increasingly deal with situations in which socially appropriate interaction is vital. In such settings, it is not enough for a robot simply to plan its actions to perform particular tasks; instead, the robot must also be able to satisfy social goals and obligations that arise through interactions with people in real-world settings. As a result, a robot requires not only the necessary physical skills to perform tasks in the world, but also the appropriate social skills to understand and respond to the intentions and needs of the people it interacts with.

The goal of the JAMES project - Joint Action for Multimodal Embodied Social Systems, is to develop an artificial embodied agent that supports socially appropriate, multi-party, multimodal interaction. JAMES focuses on the qualitative aspects of task achievement in social situations, and how such tasks can be improved through multimodal communication, rather than the physical aspects of traditional robotics tasks. In particular, JAMES plans to develop the core cognitive capabilities that enable a robot to interact with humans in a socially-appropriate manner, and demonstrate this behaviour in a bartending scenario.