research-article

Lip synchronization by acoustic inversion

Authors:

Gregor Hofer,

Korin Richmond,

Michael BergerAuthors Info & Claims

SIGGRAPH '10: ACM SIGGRAPH 2010 Posters

Article No.: 11, Page 1

https://doi.org/10.1145/1836845.1836857

Published: 26 July 2010 Publication History

Get Access

Abstract

Talking computer animated characters are a common sight in video games and movies. Although doing the mouth animation by hand gives the best results it is not always feasible because of cost or time constraints. Therefore producing lip animation automatically is highly desirable. The problem can therefore be phrased as mapping from speech to lip animation or in other words as an acoustic inversion. In our work we propose a solution that takes a sequence of input frames of speech and maps it directly to an output sequence of animation frames. The key point is that there is no need for phonemes or visemes which cuts one step in the usual lip synchronization process.

Reference

[1]

Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., and Kitamura, T. 2000. Speech parameter generation algorithms for HMM-based speech synthesis. In Proc. ICASSP, 1315--1318.

Google Scholar

Index Terms

Lip synchronization by acoustic inversion

Recommendations

JALI: an animator-centric viseme model for expressive lip synchronization

The rich signals we extract from facial expressions imposes high expectations for the science and art of facial animation. While the advent of high-resolution performance capture has greatly improved realism, the utility of procedural animation warrants ...
Real-time language independent lip synchronization method using a genetic algorithm
Special section: Multimodal human-computer interfaces

Lip synchronization is a method for the determination of the mouth and tongue motion during a speech. It is widely used in multimedia productions, and real time implementation is opening application possibilities in multimodal interfaces. We present an ...
Lip synchronization from Thai speech
VRCAI '11: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

Lip synchronization in character animation is generally done in animation films and games, consuming workload and cost during the animation development process. In this paper, we focus on reducing the cost and workload in this process, and apply this ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SIGGRAPH '10: ACM SIGGRAPH 2010 Posters

July 2010

156 pages

ISBN:9781450303934

DOI:10.1145/1836845

Conference Chair:
Cindy Grimm
Washington University in St. Louis

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGGRAPH '10

Sponsor:

SIGGRAPH

SIGGRAPH '10: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 26 - 30, 2010

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
138
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Index Terms

Recommendations

JALI: an animator-centric viseme model for expressive lip synchronization

Real-time language independent lip synchronization method using a genetic algorithm

Lip synchronization from Thai speech