Real-time Hand Motion Synthesis for Playing a Virtual Guitar
Canales, Ryan; Jörg, Sophie (2025): Real-time Hand Motion Synthesis for Playing a Virtual Guitar, in: Robert W. Sumner, Fabio Zünd, Sophie Jörg, u. a. (Hrsg.), Proceedings of the 2025 18th ACM SIGGRAPH Conference on Motion, Interaction, and Games, New York: ACM, S. 1–11, doi: 10.1145/3769047.3769060.
Details
- Fakultät/Lehrstuhl
- Autorin(nen)/Autor(en)
- Canales, Ryan
- Titel des Sammelwerks
- Proceedings of the 2025 18th ACM SIGGRAPH Conference on Motion, Interaction, and Games
- Herausgeberin(nen)/Herausgeber des Sammelwerks
- Sumner, Robert W.Zünd, FabioPelechano, NuriaCharalambous, Panayiotis
- Konferenz
- MIG '25: The 18th ACM SIGGRAPH Conference on Motion, Interaction, and Games, December 3 - 5, 2025, Zurich, Switzerland
- Verlagsangabe
- ACM : New York
- Erscheinungsjahr
- 2025
- Heft
- 12
- ISBN
- 979-8-4007-2236-3
- Sprache(n)
- Englisch
- DOI
- Abstract
Concerts and performances in virtual reality are becoming increasingly popular. Accurately visualizing the detailed hand motions of musicians playing instruments is challenging. In this work, we present a real-time motion synthesis method that generates the detailed fretting hand motion for playing guitar. Our approach first involves capturing and post-processing hand motion data from guitar performances to create a data set for training. The post-processing ensures that the fingertip positions are placed as accurately as possible regarding distance from the fretboard and location between the frets. We then train a neural network that learns to predict hand and finger poses based on guitar tabs and previous poses. We found that our method produces reasonably stable motion and evaluate our results using accuracy measures and visual evaluation.
- Freie Schlagwort(e)
- character animationmotion synthesisvirtual humanshand motions
- Dokumenttyp
- Konferenzveröffentlichung
- URI
- Datum der Freischaltung
- 30.01.2026
- Projekt(e)