Visemes - Revision history

Usr 8ee44c1a-f905-4e08-bb61-e1cd34e09fc0: Noted deprecation for OSP

2025-11-05T22:51:49Z

Noted deprecation for OSP

← Older revision		Revision as of 22:51, 5 November 2025
Line 143:		Line 143:
	== Resources ==		== Resources ==
	* [https://creators.vrchat.com/avatars/animator-parameters/#viseme-values Animation Parameters] on VRChat's Creator Documentation		* [https://creators.vrchat.com/avatars/animator-parameters/#viseme-values Animation Parameters] on VRChat's Creator Documentation
	* <s>[https://developers.meta.com/horizon/documentation/unity/audio-ovrlipsync-viseme-reference Viseme Reference] on Meta Developers' Documentation</s>		* [https://lackofbindings.github.io/Viseme-Reference/ Viseme Reference] by ''lackofbindings'' on github.io
	* [~~https://lackofbindings.github.io/Viseme-Reference/ Viseme Reference~~] ~~on github.io~~		* <s>[https://developers.meta.com/horizon/documentation/unity/audio-ovrlipsync-viseme-reference Viseme Reference] on Meta Developers' Documentation for Oculus Spatializer Plugin</s> [Deprecated]

	== See also ==		== See also ==

Usr 034f590b-9002-4221-80f8-fab6c7740c0f: /* Resources */ Replaced defunct Meta Developer viseme reference (images removed) with archived mirror from lackofbindings.github.io/Viseme-Reference to preserve original research content.

2025-11-05T21:36:32Z

Resources: Replaced defunct Meta Developer viseme reference (images removed) with archived mirror from lackofbindings.github.io/Viseme-Reference to preserve original research content.

← Older revision		Revision as of 21:36, 5 November 2025
Line 143:		Line 143:
	== Resources ==		== Resources ==
	* [https://creators.vrchat.com/avatars/animator-parameters/#viseme-values Animation Parameters] on VRChat's Creator Documentation		* [https://creators.vrchat.com/avatars/animator-parameters/#viseme-values Animation Parameters] on VRChat's Creator Documentation
	* [https://developers.meta.com/horizon/documentation/unity/audio-ovrlipsync-viseme-reference Viseme Reference] on Meta Developers' Documentation		* <s>[https://developers.meta.com/horizon/documentation/unity/audio-ovrlipsync-viseme-reference Viseme Reference] on Meta Developers' Documentation</s>
			* [https://lackofbindings.github.io/Viseme-Reference/ Viseme Reference] on github.io

	== See also ==		== See also ==

Usr 8ee44c1a-f905-4e08-bb61-e1cd34e09fc0: Light proofread.

2025-08-25T22:58:22Z

Light proofread.

← Older revision		Revision as of 22:58, 25 August 2025
Line 1:		Line 1:
	'''In ~~VRChat~~, ~~“visemes”~~ are ~~the~~ 15 mouth‑shape targets that ~~the Oculus LipSync library drives~~ while you speak.'''		{{Noticebox/Community}}{{Noticebox/Stub}}
			'''Visemes''' (pormanteau for ''visual phonemes'') are an [[Avatars\|avatar]] feature that mimics lip and mouth movement, when synchronized with human speech.

			Within Unity, visemes are a type of, or set of shapekey(s) that can be programmed onto an avatar. In the Oculus LipSync Library, there are 15 mouth‑shape targets that can be used while you speak.

			VRChat converts your live microphone audio through that library, converts the sound into a single integer (<code>0‑14</code>) every video frame, and writes it into the built‑in Animator parameter '''<code>Viseme</code> (often shown in the docs as "VisemeOculus")'''. Your avatar's FX layer (or the [[VRChat SDK\|VRChat SDK's]] default layer) turns that number into blend‑shape or bone animation so the mouth appears to pronounce your words in real time.

	VRChat pipes your live microphone audio through that library, converts the sound into a single integer (<code>0‑14</code>) every video frame, and writes it into the built‑in Animator parameter '''<code>Viseme</code> (often shown in the docs as “VisemeOculus”)'''. Your avatar’s FX layer (or the SDK’s default layer) turns that number into blend‑shape or bone animation so the mouth appears to pronounce your words in real time. See [https://creators.vrchat.com/avatars/creating-your-first-avatar/#viseme-blend-shape-recommended VRChat Creators Wiki]
	~~{{Noticebox/Stub}}{{Noticebox/Community}}~~
	~~----~~
	=== Viseme Slots ===		=== Viseme Slots ===
	{\| class="wikitable"		{\| class="wikitable"
Line 102:		Line 104:
	\|Lips rounded, slightly forward		\|Lips rounded, slightly forward
	\|}		\|}
	[https://developers.meta.com/horizon/blog/tech-note-enhancing-oculus-lipsync-with-deep-learning/?utm_source=chatgpt.com Oculus ~~docs~~] use the longer spellings ''ih/oh/ou''; [https://creators.vrchat.com/avatars/animator-parameters/#viseme-values ~~VRChat’s~~ parameter list] trims them to ''i/o/u''.		[https://developers.meta.com/horizon/blog/tech-note-enhancing-oculus-lipsync-with-deep-learning/?utm_source=chatgpt.com Oculus Docs] use the longer spellings ''ih/oh/ou''; [https://creators.vrchat.com/avatars/animator-parameters/#viseme-values VRChat's parameter list] trims them to ''i/o/u''.
	~~----~~

	=== Wiring Avatar ===		=== Wiring Avatar ===
Line 114:		Line 115:
	#* Branch to custom mouth animations (e.g., a “big scream” version of <code>aa</code>) when volume is high by also reading the <code>Voice</code> float (0‑1).		#* Branch to custom mouth animations (e.g., a “big scream” version of <code>aa</code>) when volume is high by also reading the <code>Voice</code> float (0‑1).
	# '''Performance tip:''' keep viseme blend‑shapes on a separate head mesh; the GPU only has to update the vertices it actually changes.		# '''Performance tip:''' keep viseme blend‑shapes on a separate head mesh; the GPU only has to update the vertices it actually changes.

	~~----~~

	=== Troubleshooting quick‑hits ===		=== Troubleshooting quick‑hits ===
Line 139:		Line 138:
	\|In Build tab, mark head mesh for both PC & Android		\|In Build tab, mark head mesh for both PC & Android
	\|}		\|}
	~~----~~

	==== Take‑away ====		==== Take‑away ====
	''Visemes are simply numbered mouth cues.'' Name 15 blend‑shapes (or equivalent bone poses) to match the Oculus set, point your Avatar Descriptor at them, and VRChat’s built‑in <code>Viseme</code> parameter will make your character lip‑sync automatically—no extra scripts required.		''Visemes are simply numbered mouth cues.'' Name 15 blend‑shapes (or equivalent bone poses) to match the Oculus set, point your Avatar Descriptor at them, and VRChat’s built‑in <code>Viseme</code> parameter will make your character lip‑sync automatically—no extra scripts required.

	== ~~See Also~~ ==		== Resources ==
			* [https://creators.vrchat.com/avatars/animator-parameters/#viseme-values Animation Parameters] on VRChat's Creator Documentation
			* [https://developers.meta.com/horizon/documentation/unity/audio-ovrlipsync-viseme-reference Viseme Reference] on Meta Developers' Documentation

			== See also ==

			* [[Avatars]]
	* [[Blendshapes]]		* [[Blendshapes]]
	* [[VRChat Creator Companion]]		* [[VRChat Creator Companion]]
	* [[~~Avatars~~]]		* [[VRChat SDK]]

Usr e74229dd-6843-478e-be25-654453129010 at 02:09, 23 August 2025

2025-08-23T02:09:50Z

← Older revision		Revision as of 02:09, 23 August 2025
Line 74:		Line 74:
	\|10		\|10
	\|'''aa'''		\|'''aa'''
	\|a, aw		\|ah, aw
	\|fast, father		\|fast, father
	\|Jaw open, oval mouth		\|Jaw open, oval mouth

Usr e74229dd-6843-478e-be25-654453129010: minor tweaks to previous edit

2025-08-23T02:07:09Z

minor tweaks to previous edit

← Older revision		Revision as of 02:07, 23 August 2025
Line 74:		Line 74:
	\|10		\|10
	\|'''aa'''		\|'''aa'''
	\|a		\|a, aw
	\|father		\|fast, father
	\|Jaw open, oval mouth		\|Jaw open, oval mouth
	\|-		\|-
Line 86:		Line 86:
	\|12		\|12
	\|'''i'''		\|'''i'''
	\|ih		\|ih, ee
	\|tip		\|tip, tea
	\|Lips stretched, jaw higher		\|Lips stretched, jaw higher
	\|-		\|-

Usr e74229dd-6843-478e-be25-654453129010: slightly improved the viseme table. separated examples into their own row and fixed the examples for "i, o, u" as they were previously incorrect.

2025-08-23T02:03:20Z

slightly improved the viseme table. separated examples into their own row and fixed the examples for "i, o, u" as they were previously incorrect.

← Older revision		Revision as of 02:03, 23 August 2025
Line 7:		Line 7:
	{\| class="wikitable"		{\| class="wikitable"
	!Index		!Index
	!~~Short code~~		!Name
	!~~Typical phonemes~~		!Phonemes
	!~~What the mouth does~~		!Examples
			!Mouth description
	\|-		\|-
	\|0		\|0
	\|'''sil'''		\|'''sil'''
	\|silence ~~/ pause~~		\|(silence)
			\|
	\|Neutral, lips relaxed		\|Neutral, lips relaxed
	\|-		\|-
Line 19:		Line 21:
	\|'''pp'''		\|'''pp'''
	\|p, b, m		\|p, b, m
			\|put, bat, mat
	\|Lips fully closed, slight pout		\|Lips fully closed, slight pout
	\|-		\|-
Line 24:		Line 27:
	\|'''ff'''		\|'''ff'''
	\|f, v		\|f, v
			\|fat, vat
	\|Lower lip touches upper teeth		\|Lower lip touches upper teeth
	\|-		\|-
Line 29:		Line 33:
	\|'''th'''		\|'''th'''
	\|th		\|th
			\|that
	\|Tongue between teeth		\|Tongue between teeth
	\|-		\|-
Line 34:		Line 39:
	\|'''dd'''		\|'''dd'''
	\|t, d		\|t, d
			\|tip, dip
	\|Tip of tongue touches ridge		\|Tip of tongue touches ridge
	\|-		\|-
Line 39:		Line 45:
	\|'''kk'''		\|'''kk'''
	\|k, g		\|k, g
			\|call, gas
	\|Back of tongue touches palate		\|Back of tongue touches palate
	\|-		\|-
	\|6		\|6
	\|'''ch'''		\|'''ch'''
	\|ch, j		\|ch, sh, ts, dz, j
			\|chair, she, its, join
	\|Lips rounded, jaw slightly down		\|Lips rounded, jaw slightly down
	\|-		\|-
	\|7		\|7
	\|'''ss'''		\|'''ss'''
	\|s, z, sh		\|s, z
			\|sit, zoom
	\|Teeth almost together, lips wide		\|Teeth almost together, lips wide
	\|-		\|-
	\|8		\|8
	\|'''nn'''		\|'''nn'''
	\|n		\|n, l
			\|lot, not
	\|Tongue presses ridge, lips apart		\|Tongue presses ridge, lips apart
	\|-		\|-
Line 59:		Line 69:
	\|'''rr'''		\|'''rr'''
	\|r		\|r
			\|red
	\|Lips slightly rounded, cheeks firm		\|Lips slightly rounded, cheeks firm
	\|-		\|-
	\|10		\|10
	\|'''aa'''		\|'''aa'''
	\|a ~~as in “father”~~		\|a
			\|father
	\|Jaw open, oval mouth		\|Jaw open, oval mouth
	\|-		\|-
	\|11		\|11
	\|'''e'''		\|'''e'''
	\|eh ~~as in “men”~~		\|eh
			\|men
	\|Mouth wider, mid‑open		\|Mouth wider, mid‑open
	\|-		\|-
	\|12		\|12
	\|'''~~i / ih~~'''		\|'''i'''
	\|~~ee as in “meet”~~		\|ih
			\|tip
	\|Lips stretched, jaw higher		\|Lips stretched, jaw higher
	\|-		\|-
	\|13		\|13
	\|'''~~o / oh~~'''		\|'''o'''
	\|~~aw as in “bought”~~		\|oh
			\|toe
	\|Lips rounded, jaw mid‑open		\|Lips rounded, jaw mid‑open
	\|-		\|-
	\|14		\|14
	\|'''u ~~/ ou~~'''		\|'''u '''
	\|~~oo as in “boot”~~		\|ou
			\|boot
	\|Lips rounded, slightly forward		\|Lips rounded, slightly forward
	\|}		\|}

Usr 6b439aab-5d80-46cb-876a-5a0cd023ac39: /* The 15 VRChat viseme slots */

2025-06-16T23:23:44Z

The 15 VRChat viseme slots

← Older revision		Revision as of 23:23, 16 June 2025
Line 4:		Line 4:
	{{Noticebox/Stub}}{{Noticebox/Community}}		{{Noticebox/Stub}}{{Noticebox/Community}}
	----		----
	=== ~~The 15 VRChat viseme slots~~ ===		=== Viseme Slots ===
	{\| class="wikitable"		{\| class="wikitable"
	!Index		!Index
Line 89:		Line 89:
	----		----

	=== ~~How to wire them up on an avatar~~ ===		=== Wiring Avatar ===

	# '''Add blend‑shapes (shape keys) or a jaw bone.''' Each shapekey should be named exactly like the codes above (case‑sensitive in Unity). Keep the ''sil'' key—even if it only moves one vertex—to stop Unity deleting it on import.		# '''Add blend‑shapes (shape keys) or a jaw bone.''' Each shapekey should be named exactly like the codes above (case‑sensitive in Unity). Keep the ''sil'' key—even if it only moves one vertex—to stop Unity deleting it on import.

Usr 6b439aab-5d80-46cb-876a-5a0cd023ac39 at 23:22, 16 June 2025

2025-06-16T23:22:13Z

← Older revision		Revision as of 23:22, 16 June 2025
Line 1:		Line 1:
	'''In VRChat, “visemes” are the 15 mouth‑shape targets that the Oculus LipSync library drives while you speak.'''		'''In VRChat, “visemes” are the 15 mouth‑shape targets that the Oculus LipSync library drives while you speak.'''

	VRChat pipes your live microphone audio through that library, converts the sound into a single integer (<code>0‑14</code>) every video frame, and writes it into the built‑in Animator parameter '''<code>Viseme</code> (often shown in the docs as “VisemeOculus”)'''. Your avatar’s FX layer (or the SDK’s default layer) turns that number into blend‑shape or bone animation so the mouth appears to pronounce your words in real time. See [https://creators.vrchat.com/avatars/creating-your-first-avatar/#viseme-blend-shape-recommended VRChat Creators Wiki]{{Noticebox/Community}}		VRChat pipes your live microphone audio through that library, converts the sound into a single integer (<code>0‑14</code>) every video frame, and writes it into the built‑in Animator parameter '''<code>Viseme</code> (often shown in the docs as “VisemeOculus”)'''. Your avatar’s FX layer (or the SDK’s default layer) turns that number into blend‑shape or bone animation so the mouth appears to pronounce your words in real time. See [https://creators.vrchat.com/avatars/creating-your-first-avatar/#viseme-blend-shape-recommended VRChat Creators Wiki]
			{{Noticebox/Stub}}{{Noticebox/Community}}
	----		----
	=== The 15 VRChat viseme slots ===		=== The 15 VRChat viseme slots ===

Usr 6b439aab-5d80-46cb-876a-5a0cd023ac39 at 23:19, 16 June 2025

2025-06-16T23:19:55Z

← Older revision		Revision as of 23:19, 16 June 2025
Line 1:		Line 1:
	'''In VRChat, “visemes” are the 15 mouth‑shape targets that the Oculus LipSync library drives while you speak.'''		'''In VRChat, “visemes” are the 15 mouth‑shape targets that the Oculus LipSync library drives while you speak.'''

	VRChat pipes your live microphone audio through that library, converts the sound into a single integer (<code>0‑14</code>) every video frame, and writes it into the built‑in Animator parameter '''<code>Viseme</code> (often shown in the docs as “VisemeOculus”)'''. Your avatar’s FX layer (or the SDK’s default layer) turns that number into blend‑shape or bone animation so the mouth appears to pronounce your words in real time. See [https://creators.vrchat.com/avatars/creating-your-first-avatar/#viseme-blend-shape-recommended VRChat Creators Wiki]		VRChat pipes your live microphone audio through that library, converts the sound into a single integer (<code>0‑14</code>) every video frame, and writes it into the built‑in Animator parameter '''<code>Viseme</code> (often shown in the docs as “VisemeOculus”)'''. Your avatar’s FX layer (or the SDK’s default layer) turns that number into blend‑shape or bone animation so the mouth appears to pronounce your words in real time. See [https://creators.vrchat.com/avatars/creating-your-first-avatar/#viseme-blend-shape-recommended VRChat Creators Wiki]{{Noticebox/Community}}
	~~----~~{{Noticebox/Community}}		----

	=== The 15 VRChat viseme slots ===		=== The 15 VRChat viseme slots ===
	{\| class="wikitable"		{\| class="wikitable"

Usr 6b439aab-5d80-46cb-876a-5a0cd023ac39 at 23:19, 16 June 2025

2025-06-16T23:19:35Z

← Older revision		Revision as of 23:19, 16 June 2025
Line 2:		Line 2:

	VRChat pipes your live microphone audio through that library, converts the sound into a single integer (<code>0‑14</code>) every video frame, and writes it into the built‑in Animator parameter '''<code>Viseme</code> (often shown in the docs as “VisemeOculus”)'''. Your avatar’s FX layer (or the SDK’s default layer) turns that number into blend‑shape or bone animation so the mouth appears to pronounce your words in real time. See [https://creators.vrchat.com/avatars/creating-your-first-avatar/#viseme-blend-shape-recommended VRChat Creators Wiki]		VRChat pipes your live microphone audio through that library, converts the sound into a single integer (<code>0‑14</code>) every video frame, and writes it into the built‑in Animator parameter '''<code>Viseme</code> (often shown in the docs as “VisemeOculus”)'''. Your avatar’s FX layer (or the SDK’s default layer) turns that number into blend‑shape or bone animation so the mouth appears to pronounce your words in real time. See [https://creators.vrchat.com/avatars/creating-your-first-avatar/#viseme-blend-shape-recommended VRChat Creators Wiki]
	----		----{{Noticebox/Community}}

	=== The 15 VRChat viseme slots ===		=== The 15 VRChat viseme slots ===