Task
A real SO-101 arm in an enclosed cell. Eight orange 25 mm cubes are placed at random, without overlapping.
- Cell interior: 729.4 × 582.4 × 555 mm.
- Play area, inside the 40 mm perimeter barriers: 649.4 × 502.4 mm.
Fair use
- One run queued per account at any time.
- Each run lasts two minutes. Then the arm returns home and the cell resets.
- One account per person or team. No extra accounts to jump the queue.
- Submit policies as public Hugging Face model repos. They may only use the observations we provide.
- No policies designed to damage the arm, the cell or the cameras. We stop any run that looks unsafe.
- Scores are final once the evaluation report is published. Appeals within 7 days.
- We may record runs and publish recordings and scores on the leaderboard.
- We may disqualify any run or account that breaks these rules.
Scoring
Your score is the height of the tallest stable stack at the end of the run, in cubes. Ties go to whoever placed their final cube first. An overhead depth camera measures it automatically once the arm is at rest, counting stacks up to 6 cubes.
Policy interface
Your policy exposes predict(observation) and returns the action. It is called once per new wrist camera frame (30 fps). There is no fixed control rate.
state: 18 values. 6 joint positions, 6 previous joint targets, 6 joint velocities.image: the wrist camera, 1280 × 720 RGB, uncropped. The only camera the policy sees.- Action: 6 absolute joint position targets.
Joint order: shoulder_pan, shoulder_lift, elbow_flex, wrist_flex, wrist_roll, gripper. Joints 1–5 are in degrees, the gripper in % of its range (0–100). Velocities are in degrees per second (gripper: percentage points per second). Actions use the same order and units.
Runtime
Policies run on the robot's Jetson in an isolated sandbox: CPU only, no network access. Bundle all dependencies with your submission.
Submission
A link to a public Hugging Face model repo, like https://huggingface.co/owner/model. One active submission per account. The package format (required files and manifest) is still being finalised.
Simulation
MuJoCo 3.3.7, Python 3.12. The arm model is the SO-101 from MuJoCo Menagerie (robotstudio_so101, Apache-2.0). Our CubeStack scene and task environment are not yet published.
Legal
See the Terms, Privacy policy and Cookie policy. Runs on public cells may be recorded and published. Your policy weights stay yours. Box and the competition are provided as-is during the beta.