Human communication operates over a variety of modalities between humans and computers. When we communicate with other people and with information systems, we exchange or/and retrieve multimedia information. Over the ...Human communication operates over a variety of modalities between humans and computers. When we communicate with other people and with information systems, we exchange or/and retrieve multimedia information. Over the last few years, the Interactive Systems Laboratory at Carnegie Mellon University has developed multimodal systems to empower all of us with increased access to information, and the ability to communicate through diverse media in increasingly varied environments. In this paper, we review our research activities in developing multimodal systems. We show that both verbal and non verbal cues can significantly enhance robustness, flexibility, naturalness and performance of human computer interaction. We demonstrate that multimodal systems can enhance human human communication and cooperation by efficient manipulation of multimedia information.展开更多
文摘Human communication operates over a variety of modalities between humans and computers. When we communicate with other people and with information systems, we exchange or/and retrieve multimedia information. Over the last few years, the Interactive Systems Laboratory at Carnegie Mellon University has developed multimodal systems to empower all of us with increased access to information, and the ability to communicate through diverse media in increasingly varied environments. In this paper, we review our research activities in developing multimodal systems. We show that both verbal and non verbal cues can significantly enhance robustness, flexibility, naturalness and performance of human computer interaction. We demonstrate that multimodal systems can enhance human human communication and cooperation by efficient manipulation of multimedia information.
