TY - CPAPER TI - Real-Time Conversational Gaze Synthesis for Avatars AU - Canales, Ryan AU - Jain, Eakta AU - Jörg, Sophie PY - 2023 T2 - MIG '23 : Proceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games IS - 17 SP - 1-7 PB - Association for Computing Machinery CY - New York SN - 979-8-4007-0393-5 DO - 10.1145/3623264.3624446 UR - https://fis.uni-bamberg.de/handle/uniba/106268 LA - eng AB - Eye movement plays an important role in face-to-face communication. In this work, we present a deep learning approach for synthesizing the eye movements of avatars for two-party conversations and evaluate viewer perception of different types of eye motions. We aim to synthesize believable gaze behavior based on head motions and audio features as they would typically be available in virtual reality applications. To this end, we captured the head motion, eye motion, and audio of several two-party conversations and trained an RNN-based model to predict where an avatar looks in a two-person conversational scenario. We evaluated our approach with a user study on the perceived quality of the eye animation and compared our method with other eye animation methods. While our model was not rated highest, our model and our user study lead to a series of insights on model features, viewer perception, and study design that we present. KW - Virtual reality KW - Perception KW - Animation ER -