Audio Face Animator Lite - Lip Sync & Facial Animation
DevEloop Team
$0.0
(no ratings)
Jump AssetStore
Generate realistic lip sync and facial animation from audio on CPU using NVIDIA Audio2Face models. Works offline in Unity Editor and supports ARKit blendshapes and AnimationClip creation.YOUTUBE | DOCUMENTATION | SUPPORTAudio Face Animator Lite generates realistic lip sync and facial animation from audio using NVIDIA Audio2Face models. Generation runs locally on the CPU.The plugin produces synchronized, ARKit-compatible facial animation and lets you adapt it to characters with different blendshape and facial-bone setups.Lite generates animation in the Unity Editor for the first 5 seconds of each audio clip. You can save the result as a standard Unity AnimationClip and play that clip in a standalone build. The full version supports longer audio, generation in Windows builds, and an optional NVIDIA GPU backend.FeaturesGenerate synchronized facial animation directly from audio files, entirely offline.Drive ARKit-compatible blendshapes, including characters without a complete ARKit blendshape set.Add emotion sequences with adjustable intensity and crossfades.Generate audio-driven eye motion, with optional Look At blending.Add procedural blinking with adjustable timing and strength.Map each expression to multiple blendshapes or facial bones. Preview mappings in the Editor and reuse them across characters with presets.Fine-tune face strength, smoothing, masks, lip and eyelid offsets, and eye motion.Save blendshape, bone, eye, and blink animation as a Unity AnimationClip.IncludedThree ready-to-use sample characters, a sample scene, voice samples, and emotion presets.RequirementsUnity 6000.0 or newer.Windows 10 or 11, 64-bit, for generation in the Unity Editor.A character with suitable facial blendshapes or bones. A complete ARKit blendshape set is not required.Additional disk space for model synchronization (approximately 741 MiB), plus Unity’s project cache.The sample scene’s UI buttons require Unity Input System (com.unity.inputsystem; tested with 1.14.2). Generation through the Face Animator Inspector or API does not require it.Getting startedImport the package.Open Tools > AudioFaceAnimator > Sync StreamingAssets and select Copy All Files.Open Tools > AudioFaceAnimator > Preflight Check and select Checks > CPU.To use the sample scene’s buttons, install Unity Input System. Open the scene, enter Play Mode, then press Generate and Play.For your own character, add Face Animator, map its facial blendshapes or bones, and assign an AudioClip.When updating from an older Lite version, remove its obsolete GPU plugins before importing 2.0.0, then synchronize the model files again. Older scenes with NVIDIA GPU saved as their backend must be switched to CPU.Third-party licensing: This package uses NVIDIA Audio2Face models under the NVIDIA Open Model License. The Audio2Face SDK and ONNX Runtime are provided under MIT licenses. See NOTICE.txt and 3rd-party-attribution.txt in the package for the full notices. This product is not sponsored by or affiliated with NVIDIA Corporation.───────────────────────────────MORE FROM DEVELOOPAudio Face Animator — full versionAll DevEloop Unity tools and animation packsSupport: dev.eloop@outlook.comSupported Platform: Windows 10/11, 64-bit; generation in Unity Editor onlyUnity Version: 6000.0 or newerGeneration Backend: CPU only; no NVIDIA GPU, CUDA, or TensorRT requiredProcessing Mode: Local and offline; generates animation for the first 5 seconds of each clipAI Model: NVIDIA Audio2FaceFacial Rig: ARKit-compatible blendshapes and facial bones; a complete ARKit set is not requiredInput: WAV or Unity AudioClip, automatically converted to 16 kHz monoOutput: Facial animation for playback and export as a Unity AnimationClip; saved clips can play in standalone buildsAudio Face Animator uses Nvidia's Audio2Face model to generate facial animations from audio.




