A 3D talking head for mobile devices based on unofficial iOS WebGL support

In this paper we present the implementation of a WebGL Talking Head for iOS mobile devices (Apple iPhone and iPad). It works on standard MPEG-4 Facial Animation Parameters (FAPs) and speaks with the Italian version of FESTIVAL TTS. It is totally based on true real human data. The 3D kinematics information are used to create lips articulatory model and to drive directly the talking face, generating human facial movements. In the last year we developed the WebGL version of the avatar. WebGL, which is 3D graphic for the web, is currently supported in the major web browsers for desktop computers. No official support has been given for mobile device main platforms yet, although the Firefox beta version enables it on android phones. Starting from iOS 5 WebGL is enabled only for the advertisement library class (which is intended for placing ad-banners in applications). We have been able to use this feature to visualize and animate our WebGL talking head.

Publication type: 
Contributo in atti di convegno
Author or Creator: 
Alberto Benin
G. Riccardo Leone
Piero Cosi
Publisher: 
ACM, Association for computing machinery, New York, USA
Source: 
Web3D '12 Proceedings of the 17th International Conference on 3D Web Technology, pp. 117–120, Los Angeles, CA - USA, August 04-05, 2012
Date: 
2012
Resource Identifier: 
http://www.cnr.it/prodotto/i/210419
https://dx.doi.org/10.1145/2338714.2338734
info:doi:10.1145/2338714.2338734
http://dl.acm.org/citation.cfm?id=2338734
urn:isbn:978-1-4503-1432-9
Language: 
Eng
ISTC Author: 
Alberto Benin's picture
Real name: 
Piero Cosi's picture
Real name: