We present our framework that efficiently synchronizes dancing motion of a virtual character according to music input. Two modules have been developed to achieve this. A music server analyzes audio input on the fly and extracts information on music such as tempo, time signature, and beat time. A motion client chooses and displays motion clips according to the music information, by time-warping and synchronizing the start time of motion clips with the music beat time. As a preprocessing step, we construct a database of motion clips using captured dancing motion of a dancer. A PCA-based method is presented to easily identify transiting parts from each motion clip.
Citation:
Gunwoo Kim, Yan Wang, Hyewon Seo, "Motion Control of a Dancing Character with Music," icis, pp.930-936, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007), 2007