Pauly, Mark2013-09-272013-09-272013-09-27201310.1145/2522628.2541252https://infoscience.epfl.ch/handle/20.500.14299/95008This paper discusses how realtime face tracking and performance-based animation can facilitate new ways of interaction for computer gaming and other online applications. We identify a number of requirements for realtime face capture and animation systems, and show how recent progress in tracking algorithms advances towards satisfying these requirements. Performance-based animation has the potential to significantly enrich the emotional experience of in-game communication through live avatars that are controlled directly by the facial expressions of a recorded user. We briefly outline other potential use scenarios of realtime face tracking systems and conclude with a discussion of future research challenges.performance-based animationavatarsrealtime face trackingimmersive gameplaytext::conference output::conference proceedings::conference paper