Realtime Performance-Based Facial Avatars for Immersive Gameplay
This paper discusses how realtime face tracking and performance-based animation can facilitate new ways of interaction for computer gaming and other online applications. We identify a number of requirements for realtime face capture and animation systems, and show how recent progress in tracking algorithms advances towards satisfying these requirements. Performance-based animation has the potential to significantly enrich the emotional experience of in-game communication through live avatars that are controlled directly by the facial expressions of a recorded user. We briefly outline other potential use scenarios of realtime face tracking systems and conclude with a discussion of future research challenges.
thumbnail.png
preprint
openaccess
copyright
1001.97 KB
PNG
146a09d7cefb0e6fa641ef572cf6d415
Screenshot 2022-11-01 at 18.19.22.png
Thumbnail
openaccess
copyright
1003.26 KB
PNG
fc92459613dabfb9e8a2fcd5af3b0302