Conversion of continuous speech sound to articulation animation as an application of visual coarticulation modeling

Abstract

A voice to facial animation conversion system is presented in this paper. In particular the temporal structure of the multimodal speech is discussed. Mutual information and neural network training is used to estimate the optimal temporal scope for audio to video conversion.