Face Tracking: Difference between revisions
From VRChat Wiki
mNo edit summary |
m seperate vrcft into community page |
||
| Line 1: | Line 1: | ||
{{Noticebox/Stub}} | |||
'''[[Face Tracking|Face tracking]] for VRChat''' refers to using hardware and software to capture a user's real-life facial expressions and map them onto their [[Avatars]] in real time. This makes avatars more expressive and lifelike, enhancing immersion and social interaction in VRChat. | '''[[Face Tracking|Face tracking]] for VRChat''' refers to using hardware and software to capture a user's real-life facial expressions and map them onto their [[Avatars]] in real time. This makes avatars more expressive and lifelike, enhancing immersion and social interaction in VRChat. | ||
== How Face Tracking works == | == How Face Tracking works == | ||
| Line 13: | Line 12: | ||
* '''Send Data to VRChat''' | * '''Send Data to VRChat''' | ||
The facial data is converted into blendshape values (facial expression controls) and sent to VRChat using [[Open Sound Control|OSC]] or avatar-specific animations. Most commonly used OSC tool is [ | The facial data is converted into blendshape values (facial expression controls) and sent to VRChat using [[Open Sound Control|OSC]] or avatar-specific animations. Most commonly used OSC tool is [[Community:VRCFT|VRCFT]]. | ||
* '''Drive your Avatar''' The avatar must be set up with: | * '''Drive your Avatar''' The avatar must be set up with: | ||
| Line 19: | Line 18: | ||
** '''Expression blendshapes''' (for emotions like happy, sad, surprised) | ** '''Expression blendshapes''' (for emotions like happy, sad, surprised) | ||
** '''Eye and head tracking''' support | ** '''Eye and head tracking''' support | ||
== High-End VR Headsets with Built-in or Add-on Face Tracking == | == High-End VR Headsets with Built-in or Add-on Face Tracking == | ||
| Line 66: | Line 63: | ||
|No internal face/eye tracking hardware | |No internal face/eye tracking hardware | ||
|} | |} | ||
== See Also == | == See Also == | ||
Revision as of 06:05, 17 June 2025
You can help the VRChat Wiki by improving it.
[Reason: You can contribute by expanding and proofreading this article, in accordance with the Manual of Style.]
[Reason: You can contribute by expanding and proofreading this article, in accordance with the Manual of Style.]
Face tracking for VRChat refers to using hardware and software to capture a user's real-life facial expressions and map them onto their Avatars in real time. This makes avatars more expressive and lifelike, enhancing immersion and social interaction in VRChat.
How Face Tracking works
Face Tracking works with the combination of Eye Tracking and Mouth Tracking (some headsets aren't supporting both) :
- Capture your Eyes and Mouth : Your facial movements—like eye blinks, eyebrow raises, and mouth movements—are captured using:
- Webcams (e.g., using Selfie Expression since 2025.1.3. Previously, users would use iFacialMocap on iPhone, VSeeFace on PC)
- Depth cameras (e.g., Intel RealSense or iPhone Face ID sensors data)
- Dedicated trackers (e.g., Apple ARKit, HTC Vive Facial Tracker or Full Face Tracker for XR Elite, Quest Pro, Varjo XR4, Pimax Crystal Mod, BigScreen Beyond 2)
- Send Data to VRChat
The facial data is converted into blendshape values (facial expression controls) and sent to VRChat using OSC or avatar-specific animations. Most commonly used OSC tool is VRCFT.
- Drive your Avatar The avatar must be set up with:
- Visemes (for lip syncing)
- Expression blendshapes (for emotions like happy, sad, surprised)
- Eye and head tracking support
High-End VR Headsets with Built-in or Add-on Face Tracking
| Headset | Face Tracking Support | Notes |
|---|---|---|
| Meta Quest Pro | ✅ Built-in | Tracks facial expressions + eye movement with inward-facing sensors |
| Meta Quest 3 | 🚫 Not built-in
⚙️ Experimental (via phone/Webcam + OSC) |
No native face tracking; requires external tools or mods |
| Apple Vision Pro | ✅ Built-in (ARKit-based) | Full face + eye tracking, but not officially compatible with VRChat |
| HTC Vive Pro 2 + Facial Tracker | ✅ Via add-on | Uses HTC Vive Facial Tracker (tracks lower face, jaw, lips) |
| HTC Vive XR Elite | ⚙️ Add-on face tracking planned | Eye tracking built-in; face tracking requires future accessory |
| Pimax Crystal | ⚙️ Optional | Eye tracking included, face tracking module sold separately |
| Varjo XR-4 | ✅ Professional-grade | Includes face + eye tracking; enterprise-focused (not ideal for consumer VRChat) |
| Valve Index | 🚫 No built-in face tracking
⚙️ Third-party mods possible |
Some DIY users use SlimeVR or OSC with webcams |
| Bigscreen Beyond | 🚫 No face tracking | No internal face/eye tracking hardware |
