Joyce Chai recipient of the Faculty Early Career Development Program (CAREER) Award


Photo of Joyce ChaiMultimodal systems allow users to interact with computers through multiple modalities such as speech, gesture, and gaze. One challenge for multimodal systems is multimodal interpretation, which is the process of understanding what a user intends to communicate. Despite recent progress in multimodal interpretation, most systems still have problems handling unexpected or unreliable user inputs.

Click here to read the full NSF Award Abstract.

Award Description: 
CAREER: Learning and Optimization for Robust Multimodal Interpretation in Conversation Systems
Computer Science & Engineering