Inspired by the success of WaveNet in multi-subject speech synthesis,we propose a novel neural network based on causal convolutions for multi-subject motion modeling and generation.The network can capture the intrinsi...Inspired by the success of WaveNet in multi-subject speech synthesis,we propose a novel neural network based on causal convolutions for multi-subject motion modeling and generation.The network can capture the intrinsic characteristics of the motion of different subjects,such as the influence of skeleton scale variation on motion style.Moreover,after fine-tuning the network using a small motion dataset for a novel skeleton that is not included in the training dataset,it is able to synthesize high-quality motions with a personalized style for the novel skeleton.The experimental results demonstrate that our network can model the intrinsic characteristics of motions well and can be applied to various motion modeling and synthesis tasks.展开更多
基金We thank the anonymous reviewers for their constructive comments.Weiwei Xu is partially supported by the National Natural Science Foundation of China(No.61732016).
文摘Inspired by the success of WaveNet in multi-subject speech synthesis,we propose a novel neural network based on causal convolutions for multi-subject motion modeling and generation.The network can capture the intrinsic characteristics of the motion of different subjects,such as the influence of skeleton scale variation on motion style.Moreover,after fine-tuning the network using a small motion dataset for a novel skeleton that is not included in the training dataset,it is able to synthesize high-quality motions with a personalized style for the novel skeleton.The experimental results demonstrate that our network can model the intrinsic characteristics of motions well and can be applied to various motion modeling and synthesis tasks.