File Download
There are no files associated with this item.
Supplementary
-
Citations:
- Appears in Collections:
Conference Paper: Learning Neural Character Controllers from Videos and Motion Capture Data
Title | Learning Neural Character Controllers from Videos and Motion Capture Data |
---|---|
Authors | |
Issue Date | 2021 |
Citation | The 15th Conference on Quality Control by Artificial Vision (QCAV2021), Virtual Conference, Tokushima, Japan, 12-14 May 2021 How to Cite? |
Abstract | Computer games and Virtual Reality (VR) are not only entertainment, but becoming a novel way of communication, especially in the post-Covid world where reduced physical communication may remain as a new-normal. Character motion is one of the important factors in increasing the immersion of the users into the virtual world. Using neural networks for character controllers can significantly increase the scalability of the system - the controller can be trained with a large amount of motion capture data while the run-time memory can be kept low. The main challenge is in designing an architecture that can produce movements in production-quality and also manage a wide variation of motion classes and styles. In this talk, I will cover our recent development of neural network based character controllers that can be trained from both videos and motion capture data. By training our neural controller from both videos and motion capture data, the system can learn motion styles of a wider population, increasing its capabilities to produce various motion types and styles for real-time animation purposes. Using our system, a wide variation of movements such as walking, running, side stepping and backward walking can be synthesized for a wide variation of characters in real time. In the end of the talk, I will discuss the open problems and future directions of character animation. |
Description | Plenary Talk 2 - no. PT-2 |
Persistent Identifier | http://hdl.handle.net/10722/312113 |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Komura, T | en_HK |
dc.date.accessioned | 2022-04-14T08:16:15Z | - |
dc.date.available | 2022-04-14T08:16:15Z | - |
dc.date.issued | 2021 | - |
dc.identifier.citation | The 15th Conference on Quality Control by Artificial Vision (QCAV2021), Virtual Conference, Tokushima, Japan, 12-14 May 2021 | en_HK |
dc.identifier.uri | http://hdl.handle.net/10722/312113 | - |
dc.description | Plenary Talk 2 - no. PT-2 | en_HK |
dc.description.abstract | Computer games and Virtual Reality (VR) are not only entertainment, but becoming a novel way of communication, especially in the post-Covid world where reduced physical communication may remain as a new-normal. Character motion is one of the important factors in increasing the immersion of the users into the virtual world. Using neural networks for character controllers can significantly increase the scalability of the system - the controller can be trained with a large amount of motion capture data while the run-time memory can be kept low. The main challenge is in designing an architecture that can produce movements in production-quality and also manage a wide variation of motion classes and styles. In this talk, I will cover our recent development of neural network based character controllers that can be trained from both videos and motion capture data. By training our neural controller from both videos and motion capture data, the system can learn motion styles of a wider population, increasing its capabilities to produce various motion types and styles for real-time animation purposes. Using our system, a wide variation of movements such as walking, running, side stepping and backward walking can be synthesized for a wide variation of characters in real time. In the end of the talk, I will discuss the open problems and future directions of character animation. | en_HK |
dc.language | eng | - |
dc.relation.ispartof | The 15th Conference on Quality Control by Artificial Vision (QCAV2021) | - |
dc.title | Learning Neural Character Controllers from Videos and Motion Capture Data | en_HK |
dc.type | Conference_Paper | en_HK |
dc.identifier.email | Komura, T: taku@cs.hku.hk | - |
dc.identifier.authority | Komura, T=rp02741 | - |
dc.identifier.hkuros | 329020 | - |