Explore the Sample Lipsync Scene for Unity

End-of-Life Notice for Oculus Spatializer Plugin

The Oculus Spatializer Plugin has been replaced by the Meta XR Audio SDK and is now in end-of-life stage. It will not receive any further support beyond v47. We strongly discourage its use. Please navigate to the Meta XR Audio SDK documentation for your specific engine:
- Meta XR Audio SDK for Unity Native
- Meta XR Audio SDK for FMOD and Unity
- Meta XR Audio SDK for Wwise and Unity
- Meta XR Audio SDK for Unreal Native
- Meta XR Audio SDK for FMOD and Unreal
- Meta XR Audio SDK for Wwise and Unreal

This documentation is no longer being updated and is subject for removal.

To get started, we recommend opening the supplied demonstration scene LipSync_Demo, located under Assets/Oculus/LipSync/Scenes. This scene provides an introduction to Oculus Lipsync resources and examples of how the library works.

Using the LipSync_Demo scene

You can switch models between a geometry morph target and a texture flip target, and also switch between microphone and our provided sample audio clip using the following keys and controls:

Key	Control
1	Select Morph target, Mic input (default).
2	Select Texture Flip target, Mic input.
3	Select Morph target, Audio Clip.
4	Select Texture Flip target, Audio Clip.
5	Select Morph target, Precomputed Visemes.
6	Select Texture Flip target, Precomputed Visemes.
L	Toggle loopback on/off to hear your voice with the mic input. Use headphones to avoid feedback. (default is off).
D	Toggle debug display to show predicted visemes
Left arrow	Rotate scene object left
` (backtick)	Add 100% activation to “sil” viseme on geometry morph target
Tab through \ (QWERTY row of a US keyboard)	Add 100% activation to “PP” through “ou” visemes on geometry morph target
Right arrow	Rotate scene object right

And the sample shows the following actions and controls:

Action	Control
Swipe Down	Decrease microphone gain (1-15).
Swipe Up	Increase microphone gain (1-15).
Swipe Forward / Swipe Backward	Cycle forward/backward through targets:1. Morph target - mic input 2. Flipbook target - mic input 3. Morph target - audio clip input 4. Flipbook target - audio clip input 5. Morph target - pregenerated visemes 6. Flipbook target - pregenerated visemes Audio clip input plays automatically.
Single Tap	Toggle mic loopback on/off to hear your voice with the mic input.

To preview the scene in the Unity Editor Game View:

Import and launch LipSync_Demo as described above.

Play the LipSync_Demo scene in the Unity Editor Game View.

To preview the scene with a Rift:

Import and launch LipSync_Demo as described above.

In Build Settings, verify that the PC, Mac and Linux Standalone option is selected under Platform.

In Player Settings, select Virtual Reality Supported.

Preview the scene normally in the Unity Game View.

To preview the scene in Android:

Be sure you are able to build and run projects on your device (Debug Mode enabled, adb installed, etc.) See the Mobile SDK Setup Guide for more information.

Import and launch LipSync_Demo as described above.

In Build Settings:

Select Android under Platform.

Select Add Current Scenes in Build.

Set Texture Compression to ASTC (recommended).

In Player Settings:

Select Virtual Reality Supported.

Specify the Bundle Identifier.

Build and run your project.

Did you find this page helpful?