Description
Making a humanoid robot do a backflip or dance by hand-authoring motions takes ages. video2robot is an end-to-end pipeline that converts generative videos from Veo or Sora into humanoid robot motions, even starting from a prompt.
The flow is video or prompt to human pose extraction to robot motion, with backflip and dance demos.
End to end:Video to robot motion.
From prompts:Generate then convert.
Pose extraction:Human motion captured.
Retargeting:Fit to the robot.
The flow is video or prompt to human pose extraction to robot motion, with backflip and dance demos.
Features
End to end:Video to robot motion.
From prompts:Generate then convert.
Pose extraction:Human motion captured.
Retargeting:Fit to the robot.
