Fréchet Gesture Distance
Released AESKConv_240_100 features over 32-frame-aligned SMPL-X rotations with the official covariance regularization.
Speech-to-Gesture · BEAT2
Audio-conditioned co-speech motion generation on the fixed BEAT2 English speaker-2 protocol. Every ranked row is generated and evaluated inside Motius; paper-reported values are shown only as parity targets.
Task: Speech-to-Gesture
Dataset: BEAT2 English v2.0.0
15 test clips
16 kHz audio · 30 fps motion
GT excluded from ranking
Current Public SnapshotLoading results
Ranked methods
0
Motius-verified rows only
Evaluation cases
15
All cases available in 3D
Source representation
Full SMPL-X
Shared Three.js SMPL preview
Evaluation split
Speaker 2
Speaker-dependent BEATv2 population
Interactive Three.js Motion Comparison
High-resolution, camera-controllable GT, Language of Motion, EMAGE, and DiffuseStyleGesture+ previews across all 15 clips. Full native SMPL-X predictions remain downloadable as NPZ.
Results
Lower is better for FGD and paired errors; higher is better for BC and Diversity.
| Method | Status | Official BEAT2 metrics | Joint-only uTMR | Paired diagnostics | |||||
|---|---|---|---|---|---|---|---|---|---|
| FGD ↓ | BC ↑ | Diversity ↑ | FID ↓ | Paired Dist. ↓ | Rotation ↓ | Expression ↓ | Translation ↓ | ||
FGD and BC use the paper display scale (raw evaluator value ×10). uTMR consumes only canonical SMPL-22 joints: FID uses L2-normalized embeddings, while paired distance uses native embeddings. The metric FK sets SMPL-X translation to zero.
Evaluation Contract
One immutable population, official metric assets, and explicit checkpoint provenance.
Beat Correlation
Audio onsets against upper-body velocity minima, excluding the official 60-frame margin at each end.
L1 Diversity
Mean absolute deviation of generated 55-joint positions after the official SMPL-X metric forward kinematics.
Joint-only uTMR
Universal SMPL-H joints66 motion embeddings over balanced ≤20-second windows. FID uses per-sample L2 normalization; paired distance and diversity use native embeddings.
Paper Parity
Paper-reported values are audit targets and never participate in ranking.
| Row | FGD ↓ | BC ↑ | Diversity ↑ |
|---|
Loading paper-parity audit.