Selfie Expression
[Reason: You can contribute by expanding and proofreading this article, in accordance with the Manual of Style.]
Selfie Expression is a feature that allows users to use a camera for upper-body tracking on an avatar. This feature is available to all users on mobile Android, but VRC+ subscribers have access to the feature on desktop mode.
It can track a user's facial expressions, head, and eye movement; in addition to arms, hands, and finger tracking on desktop. This system uses your camera, built-in visemes, allowing it to work with nearly all avatars that are configured with eye-look and visemes.
How to enable Selfie Expression
Selfie Expression requires the use of a camera and can be enabled in the Main Menu Settings, under Tracking & IK. Click "Enable Selfie Expression" to turn it on.
Requirements
PC
- An active VRC+ subscription
- Any webcam with support for a 4:3 ratio.
- Most built-in laptop cameras are supported.
Android Mobile
- User's front camera on their device
- App permissions for "Camera" must be allowed first, before using the feature
Selfie Expression settings
| Setting | Tooltip | Variables |
|---|---|---|
| Enable Selfie Expression | Selfie Expression uses your camera to animate your avatar! No one will see your real face. Image data is processed locally on your device, only used for animation, and never saved. | Toggle |
| Auto-Adjust Selfie Expression Quality | Automatically adjust Selfie Expression quality depending on current frame rate | Toggle |
| Selfie Expression Quality Level | Change Selfie Expression Quality level
|
Off, Performance, Balanced, High Quality, Best Quality |
| Selfie Expression Also Moves Hands | While Selfie Expression is enabled, and the Quality Setting is set to 'Balanced' or above, allow moving hands via your webcam. | Toggle |
| Auto Recentering Speed | Adjusts how quickly your avatar will automatically recenter rotation (to compensate for camera offset) | 0-100, Recenter, Reset |
| Current Webcam Device | Change your current webcam device. Make sure your webcam is not being used by other software | Change Webcam Device |
This below chart, compares camera resolutions and frame rates for the "Selfie Expression Quality Level" setting.
| Quality level | Resolution | Frames |
|---|---|---|
| Performance | 177x144px | 5 |
| Balanced | 320x240px | 15 |
| High Quality | 640x480px | 20 |
| Best Quality | 800x600px | 30 |
Privacy and performance
All camera data is processed locally, and image or tracking data is never sent to other users, or to VRChat's servers. Due to using camera resources, it may be heavy on some systems and devices. You can reduce lag from this feature, by adjusting the quality of Selfie Expression to Balanced, or Performance modes for a better result.
Troubleshooting
- If an avatar's eyes are not tracking, it could likely be the 'eye-look' settings have not been properly set-up for the avatar in the VRChat SDK.
- On desktop, if hand tracking is not working, you may either need to enable it using the Selfie Expression Also Moves Hands setting, and turn the camera quality setting to Balanced, High Quality, or Best Quality.
- If your microphone's quality is unusual, your microphone may accidentally be set to your webcam. You can change your webcam in the Audio tab in the Quick Menu.
