David Goodman from IonGFX Studio explains the use of the iSpeech Phoneme Generator in the Unity 3D engine and how to dial in individual phonemes. iSpeech is a standalone Unity3d plugin from IonGFX Studio that works in conjuction with their sister product, iDirect which is a staging system for blocking your characters’ movements, actions at markers, interactions with other characters and speech. With iDirect+iSpeech all you have to do is point/click and assign a conversation script to have one or more characters move and interact with each other intelligently. iSpeech lipsync system for Unity3d is robust and fast with easy setup in a clean, easy to use custom editor within the Unity3d Inspector.
iSpeech recognizes 40 phonemes from the AnnoSoft standard and allows for 18 unique visemes via 2-frame FBX files that you simple plug into the corresponding slot with the Unity3d Inspector. With iSpeech, you can have Chat Mapper XML or your own XML files drive the conversation or multiple conversations. When combined with iDirect, you can control the movement of the character on the stage as well as each animation along the way to include blended animations at any point.
