Compare Body Poses

• Complete Getting Started with Interaction SDK.
• Set up Link⁠ (requires a Windows computer). Later on, you’ll use Link to capture a pose while you’re running a scene. Building and running an APK won’t work.

1. Open the Unity scene where you completed Getting Started with Interaction SDK.
2. In the Project panel, search for OVRBody. The OVRBody prefab provides body tracking data from the headset. Ensure the search filter is set to either All or In Packages, since the default setting only searches your assets.
   
3. Drag the OVRBody prefab from the search results into the hierarchy onto OVRCameraRigInteraction > OVRCameraRig > OVRInteractionComprehensive.
   
   The location of the OVRBody prefab in the hierarchy.
4. Under Hierarchy, select OVRCameraRigInteraction > OVRCameraRig > OVRInteractionComprehensive > OVRBody > OVRBodyDataSource.
5. Under Inspector, in the From OVR Body Data Source component, set Camera Rig Ref to the OVRInteractionComprehensive GameObject.
6. (Optional) In the OVR Body component, set Provided Skeleton Type to Full Body if you want body tracking data for both the legs and upper body.
7. Under Inspector, add a Pose from Body component by clicking the Add Component button and searching for Pose From Body. This component converts the raw tracking data to a pose. A pose is an Interaction SDK data structure containing data about the skeleton’s joints.
   In the inspector, the OVRBodyDataSource GameObject should have these components.
   
8. In the Pose from Body component, set the Body field to the OVRBody GameObject.
   
9. Below the Body field, ensure Auto Update is selected. This means that every time your body moves, the body tracking data will also update, ensuring you always have the latest body tracking data.
10. Save your scene.

1. Open Interaction SDK’s body pose recorder by going to Meta > Interaction > Body Pose Recorder.
   
   The Body Pose Recorder window opens and says it only works in Play mode.
   
2. In the Unity editor, click the Play button.
3. While in Play mode, in the Unity editor, click the Capture Body Pose button, then quickly perform the pose you want to record. Perform the pose until you hear the sound play on your computer, which indicates the pose was recorded. If you need more time to make the pose, you can increase the Capture Delay setting.
   
4. Exit Play mode.
5. To make sure your pose was recorded, check the BodyPoses folder under Assets > BodyPoses. You should see a file that starts with the name BodyPose- and the time of recording (ex. BodyPose-20240419-122429).
   
   An example of a recorded pose in the BodyPoses folder. Unlike the folder in the screenshot, your folder will contain only one pose.

1. Under Hierarchy, create a new empty GameObject named BodyPoseComparer. This GameObject will display the pose you must match.
2. As a child of BodyPoseComparer, create a new empty GameObject named SkeletonVisuals. This GameObject will contain the visual components.
3. As another child of BodyPoseComparer, add a second empty GameObject and name it SwitchedPose. This GameObject will contain the logic components.
   Your hierarchy should look like this.
   
4. Under Hierarchy, select the BodyPoseComparer GameObject.
5. Under Inspector, add these components.
   • Body Pose Comparer Active State
   • Locked Body Pose
   • Active State Unity Event Wrapper
   • Audio Source (optional). This tutorial uses the Audio Source component to play a sound whenever the current pose matches the recorded pose, but you could do something different.
   The inspector should look like this.
   
6. In the Transform component, set the Position field values as follows.
   • X: -0.05
   • Y: 0.2
   • Z: 2
7. In the Rotation field, set the Y value to 180.
   The Transform component should look like this.
   
8. Under Hierarchy, select the SkeletonVisuals GameObject.
9. Under Inspector, add these components. Together, both of them will display the captured pose.
   • Body Pose Debug Gizmos
   • Body Pose Comparer Active State Debug Visual
   The inspector should look like this.
   
10. Under Hierarchy, select the SwitchedPose GameObject.
11. Under Inspector, add a Body Pose Switcher component.
    The inspector should look like this.
    

1. In a new instance of Unity, open the DebugBodyPoseComparer sample scene. To save time, you’ll copy a component from this scene to your scene.
2. Under Hierarchy, select the BodyPoseComparer GameObject.
3. Under Inspector, in the Body Pose Comparer Active State component, select the three dots and click Copy Component.
   
4. Return to your original scene.
5. Under Hierarchy, select the BodyPoseComparer GameObject.
6. Under Inspector, in the Body Pose Comparer Active State component, select the three dots and click Paste Component Values.
   
   A list of configs is added to the component. Each element in the list is a body joint that will be checked for alignment. Usually, you have to add each element manually.
   
   The list of pasted configs.
7. Still in the Body Pose Comparer Active State component, set the fields as follows.
   • Pose A: OVRBodyDataSource GameObject. If prompted to pick a component, select the Pose From Body component.
   • Pose B: SwitchedPose GameObject. If prompted to pick a component, select the Body Pose Switcher component.
   
8. In the Locked Body Pose component, set Pose to the SwitchedPose GameObject. If prompted to pick a component, select the Body Pose Switcher component.
   
9. In the Active State Unity Event Wrapper component, set Active State to the BodyPoseComparer GameObject.
   
10. (Optional) In the When Activated() field, add an element to the list.
11. (Optional) Drag the Audio Source component onto the None (Object) field.
12. (Optional) Click the No Function dropdown and select AudioSource > PlayOneShot (AudioClip).
13. (Optional) Set the None (Audio Clip) field to an audio clip that should play when you match the recorded pose.
14. Under Hierarchy, select the SkeletonVisuals GameObject.
15. Under Inspector, in the Body Pose Debug Gizmos component, set the fields as follows.
    • Visibility: Joints, Bones
    • Body Pose: BodyPoseComparer GameObject
    
16. In the Body Pose Comparer Active State Debug Visual component, set the fields as follows.
    • Body Pose Comparer:BodyPoseComparer GameObject
    • Body Pose: BodyPoseComparer GameObject
    • Root: SkeletonVisuals GameObject
    
17. Under Hierarchy, select the SwitchedPose GameObject.
18. Under Inspector, in the Body Pose Switcher component, set the fields as follows.
    • Pose A: The ScriptableAsset of the pose you recorded. It’s in the BodyPoses folder under Assets > BodyPoses.
    • Pose B: The OVRBodyDataSource GameObject.
    • Source: Pose A.
    

1. Prepare to launch your scene by going to File > Build Settings and clicking the Add Open Scenes button. Your scene is now ready to build.
2. Select File > Build And Run, or if you have a Link connected, click Play. The scene loads. The world is empty except for a skeleton showing your recorded pose. Whenever you match the recorded pose, the Body Pose Comparer Active State becomes true, triggering the audio clip (if you added one), or whatever you specified in your Active State Unity Event Wrapper.
   Video: User interactions with the BodyPoseComparer object.

   Whenever the user’s body aligns with the required pose, all of the debug orbs turn green and a sound plays.

• To learn how to detect a custom hand pose, see Build a Custom Hand Pose.
• To learn about the components that enable the SDK’s body pose detection, see Body Pose Detection.

• Designing safety and user empowerment in social immersive apps: Empower users, to confidently manage their participation in social virtual spaces.
• Designing for privacy: Help users feel safe and build trust with privacy design.
• Localization: Learn about localization and translation.
• Accessibility: Learn about accessibility and how to make your app accessible.
• Comfort: Learn about how to make your app comfortable for your users.