youtube | website | unity discussions | documentation | email
SALSA LipSync Suite v2 provides more flexibility, a much higher degree of perceived accuracy, and more advanced animation technologies for your character models with minimal processor usage. Mix and match blendshapes, transforms, sprites, textures, Animator parameters, C# events, etc. to create unlimited viseme and emote expressions. The Suite includes three product modules to simplify 2D/3D lipsync, eye/head movement, and emote expression projects:
SALSA LipSync
Simple Automated Lip Sync Approximation (SALSA) provides high quality, language-agnostic, lip sync approximation for your 2D and 3D characters. Audio dialog files are processed in real-time with our new look-ahead technology to reduce/eliminate timing lag. Audio processing works equally well with 2D or 3D audio configurations. You will get amazing results without labor-intensive phoneme-mapping or baking.
EmoteR
The emote randomization engine works alone or along-side SALSA and Eyes to drive random, lipsync-emphasis-timed, repeating, or manual expression animations. Link with SALSA to add emphasis emotes with audio-based timing. Emotes are fired with priority over other expressions and seamlessly blend in and out using our new QueueProcesser to manage animation and overriding priority.
Eyes
This module focuses on eye, eyelid, and head animation (and tracking). Allow your character model to randomly look around or configure her to focus on a target object with advanced micro-movements to eliminate static, robot-stare. Take control over vertical and horizontal saccade movements for more realism. And, if your model supports it, enable the new eyelid tracking option for the ultimate animation nuance.
Custom component inspectors enable code-free configuration options, while our API enables run-time configuration and control.
Check out the documentation for more detailed information.
Supports the latest OFFICIAL RELEASE versions of Unity (v2019.LTS - v6.0).
NOTE: Some add-ons/integrations may require newer Unity versions.
Tested on Windows, Mac, Linux, Android, iOS, and WebGL. We have many customers using SALSA LipSync Suite in VR projects. NOTE: WebGL lipsync works out of the box with Unity 6.0. WebGL is only supported when combined with our Amplitude asset for Unity versions prior to Unity 6.0.
Works with:
•Autodesk (ACG) (OneClick setup available)
•DAZ3D (OneClick setup available)*
•Fuse (Legacy only) Character Creator (OneClick setup available)
•ReadyPlayer.me (OneClick setup available)
•Reallusion iClone/CC3/4 (OneClick setup available) (NOTE: Does not support ActorCore models due to naming inconsistencies. ActorCore can be used, but will likely require manual setup or creation of a Custom OneClick.)
•UMA DCS (OneClick setup available)
•Create your own OneClicks
•Any model or modeling system with sufficient facial animation controls (see requirements)
•Adventure Creator
•Amplitude for WebGL
•Cinema Director
•Cinematic Sequencer - SLATE
•Dialogue System for Unity
•Dissonance Voice Chat (multiplayer lipsync)
•Master Audio Playlists/Groups
•MorphMixer (BlendShape mixing)
•NodeCanvas
•Photon Voice (multiplayer lipsync)
•Playmaker
•Real-time microphone lip-sync
•RT-Voice (runtime text-to-speech)
•TextSync (text-to-lipsync)
•Unity Timeline
*DAZ3D OneClick setup supports Genesis (2, 3, 8, 8.1, 9).
** The Suite core packages are compiled. Add-ons include source code unless otherwise noted.