This Article Full Text (OnlineFirst PDF) Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Scopus Google Scholar Articles by Buss, M Articles by Sarkis, M Social Bookmarking                         What's this?

Development of a Multi-modal Multi-user Telepresence and Teleaction System

Technische Universität München, Munich, Germany

^* To whom correspondence should be addressed. E-mail: Angelika.Peer{at}tum.de.

	Abstract

The presented multi-user telepresence and teleaction system enables two teleoperators, which are independently controlled by two human operators, to perform collaborative actions in a remote environment. The system provides the operators with visual, auditory, and haptic feedback and allows them to physically interact with objects in the remote environment. The interaction between the two human operators is enhanced by augmenting visual and auditory feedback. The paper is focused on the amalgamation of the individual subsystems, which handle the different modalities, into one tightly integrated system, which creates a common workspace for two operators. The overall system architecture and the appropriate design of the auditory, visual, and haptic subsystems are discussed. The audio system makes use of a novel high-fidelity interpolation technique to render three-dimensional sound scenes for both human operators, which enhances their interaction. The design of the video system allows modeling and rendering of the remote environment in real time while regarding changes in the scene by perpetually updating the model. The haptic system is based on admittance-type devices, which are best fitted for applications involving large workspaces and high interaction forces. In addition, the implementation of locomotion techniques for telepresence in large-scale environments are presented. Finally, an application example shows that the system can be successfully employed in a remote maintenance task, which consists of exploring a large-scale environment, moving to the target area, and finally repairing a broken pipe by attaching a sealing clamp. The example demonstrates the necessity of multi-user telepresence and teleaction systems and supports the benefits of consistent multi-modal feedback.

First published on October 28, 2009
The International Journal of Robotics Research 2009, doi:10.1177/0278364909351756


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?