MolmoAct 2 Evaluation gallery
IN PROGRESS · PROVISIONAL Only fully completed, validated task shards are shown. Campaign coverage and aggregate rates can change.
Supplemental Task 010 Validated task

put the black bowl on top of the cabinet

Completed task success rate
74.0%
37 of 50
Control horizon
400
Maximum steps
Camera videos
100
Two per rollout
Evaluation time
7m 27s
Task process wall time

Canonical catalog

Task definition

Model instruction
put the black bowl on top of the cabinet
BDDL language
put the black bowl on top of the cabinet
Problem
libero_kitchen_tabletop_manipulation
Objects
akita_black_bowl_1, plate_1
Fixtures
kitchen_table, wooden_cabinet_1
Initial-state predicates
3
Fixed init states
50
Exact initial-state predicates 
(on akita_black_bowl_1 kitchen_table_akita_black_bowl_init_region)
(on plate_1 kitchen_table_plate_init_region)
(on wooden_cabinet_1 kitchen_table_wooden_cabinet_init_region)

Open exact BDDL definition

Simulator truth

Completion criteria

LIBERO checks these BDDL goal predicates after every action. All conditions must be true simultaneously in the same simulator step for the rollout to succeed.

  1. akita black bowl 1 is on wooden cabinet 1 top side

    (on akita_black_bowl_1 wooden_cabinet_1_top_side)
Exact parsed BDDL goal state 
(on akita_black_bowl_1 wooden_cabinet_1_top_side)

Selected rollout

LIBERO-90 · Task 010 · Episode 1

Failure
Agent view observation.images.image
Eye in hand observation.images.image2
Videos are not loaded yet.

Rollout record

Episode metadata

Link to episode
Episode
1
Seed
1000
Init state
0
Control steps
400
Wall time
15s
Outcome
Failure

Evidence browser

All rollouts

Select one episode to mount only its two camera streams in the player.

Episode Outcome Seed Init state Steps Video
1 Failure 1000 0 400 269 KB
2 Success 1001 1 172 155 KB
3 Success 1002 3 167 152 KB
4 Success 1003 5 118 129 KB
5 Failure 1004 7 400 265 KB
6 Failure 1005 8 400 261 KB
7 Success 1006 9 107 105 KB
8 Failure 1007 11 400 248 KB
9 Success 1008 12 110 99 KB
10 Success 1009 14 102 113 KB
11 Failure 1010 16 400 286 KB
12 Success 1011 17 105 104 KB
13 Failure 1012 19 400 246 KB
14 Success 1013 20 103 101 KB
15 Success 1014 22 180 189 KB
16 Success 1015 24 176 208 KB
17 Success 1016 26 107 109 KB
18 Failure 1017 28 400 249 KB
19 Success 1018 29 107 106 KB
20 Success 1019 31 194 183 KB
21 Success 1020 33 98 108 KB
22 Success 1021 35 96 98 KB
23 Success 1022 37 102 110 KB
24 Success 1023 39 118 121 KB
25 Success 1024 41 105 103 KB
26 Success 1025 43 255 241 KB
27 Success 1026 45 132 121 KB
28 Success 1027 47 138 182 KB
29 Success 1028 49 116 121 KB
30 Success 1029 1 117 118 KB
31 Success 1030 3 214 187 KB
32 Success 1031 5 105 110 KB
33 Success 1032 7 231 230 KB
34 Success 1033 9 99 98 KB
35 Failure 1034 11 400 266 KB
36 Success 1035 12 174 207 KB
37 Success 1036 14 145 197 KB
38 Failure 1037 16 400 284 KB
39 Success 1038 17 105 105 KB
40 Failure 1039 19 400 201 KB
41 Success 1040 20 98 104 KB
42 Success 1041 22 280 284 KB
43 Success 1042 24 224 297 KB
44 Success 1043 26 107 108 KB
45 Failure 1044 28 400 284 KB
46 Success 1045 29 105 107 KB
47 Failure 1046 31 400 248 KB
48 Failure 1047 32 400 263 KB
49 Success 1048 33 99 112 KB
50 Success 1049 35 104 110 KB

Integrity

Task attestation

Status
complete
Completed
Aug 16, 2026, 6:31 AM UTC
Manifest SHA-256
8352c64487…1382d894
Aggregate SHA-256
223ffeb375…699486cf
Episode index SHA-256
bab1fc9240…6c3c79d6
Validation SHA-256
be9729b96f…a6c02d4b
Artifact inventory SHA-256
413c8cf947…c3404265