VRM Lip Sync MVP#
Minimal TypeScript web app that loads a VRM avatar and drives its mouth from uploaded audio using the Web Audio API.
The project now includes a default sample avatar at public/default-avatar.vrm, so you can run it immediately without finding your own model first.
Run#
- Install dependencies: bun install
- Start dev server: bun run dev
- Open the local Vite URL.
Usage#
- Load a
.vrmfile. - Load an audio file.
- Press Play.
The avatar uses amplitude-based mouth opening, not phoneme-level viseme detection.
Next upgrades#
- Add phoneme/viseme inference instead of pure amplitude
- Add microphone input mode
- Add drag-and-drop and avatar presets
- Add eye blink / idle animation