MolmoAct 2 Evaluation gallery
IN PROGRESS · PROVISIONAL Only fully completed, validated task shards are shown. Campaign coverage and aggregate rates can change.
Supplemental Task 032 Validated task

put the ketchup in the top drawer of the cabinet

Completed task success rate
0.0%
0 of 50
Control horizon
400
Maximum steps
Camera videos
100
Two per rollout
Evaluation time
11m 55s
Task process wall time

Canonical catalog

Task definition

Model instruction
put the ketchup in the top drawer of the cabinet
BDDL language
put the ketchup in the top drawer of the cabinet
Problem
libero_kitchen_tabletop_manipulation
Objects
akita_black_bowl_1, ketchup_1, plate_1
Fixtures
kitchen_table, white_cabinet_1
Initial-state predicates
5
Fixed init states
50
Exact initial-state predicates 
(on akita_black_bowl_1 kitchen_table_akita_black_bowl_init_region)
(on plate_1 kitchen_table_plate_init_region)
(on white_cabinet_1 kitchen_table_white_cabinet_init_region)
(on ketchup_1 kitchen_table_ketchup_init_region)
(open white_cabinet_1_top_region)

Open exact BDDL definition

Simulator truth

Completion criteria

LIBERO checks these BDDL goal predicates after every action. All conditions must be true simultaneously in the same simulator step for the rollout to succeed.

  1. ketchup 1 is in white cabinet 1 top region

    (in ketchup_1 white_cabinet_1_top_region)
Exact parsed BDDL goal state 
(in ketchup_1 white_cabinet_1_top_region)

Selected rollout

LIBERO-90 · Task 032 · Episode 1

Failure
Agent view observation.images.image
Eye in hand observation.images.image2
Videos are not loaded yet.

Rollout record

Episode metadata

Link to episode
Episode
1
Seed
1000
Init state
0
Control steps
400
Wall time
15s
Outcome
Failure

Evidence browser

All rollouts

Select one episode to mount only its two camera streams in the player.

Episode Outcome Seed Init state Steps Video
1 Failure 1000 0 400 221 KB
2 Failure 1001 1 400 247 KB
3 Failure 1002 2 400 241 KB
4 Failure 1003 3 400 288 KB
5 Failure 1004 4 400 223 KB
6 Failure 1005 5 400 218 KB
7 Failure 1006 6 400 268 KB
8 Failure 1007 7 400 247 KB
9 Failure 1008 8 400 191 KB
10 Failure 1009 9 400 322 KB
11 Failure 1010 10 400 224 KB
12 Failure 1011 11 400 190 KB
13 Failure 1012 12 400 292 KB
14 Failure 1013 13 400 236 KB
15 Failure 1014 14 400 252 KB
16 Failure 1015 15 400 269 KB
17 Failure 1016 16 400 311 KB
18 Failure 1017 17 400 247 KB
19 Failure 1018 18 400 253 KB
20 Failure 1019 19 400 231 KB
21 Failure 1020 20 400 241 KB
22 Failure 1021 21 400 254 KB
23 Failure 1022 22 400 279 KB
24 Failure 1023 23 400 281 KB
25 Failure 1024 24 400 258 KB
26 Failure 1025 25 400 285 KB
27 Failure 1026 26 400 256 KB
28 Failure 1027 27 400 211 KB
29 Failure 1028 28 400 254 KB
30 Failure 1029 29 400 269 KB
31 Failure 1030 30 400 317 KB
32 Failure 1031 31 400 221 KB
33 Failure 1032 32 400 212 KB
34 Failure 1033 33 400 279 KB
35 Failure 1034 34 400 241 KB
36 Failure 1035 35 400 223 KB
37 Failure 1036 36 400 314 KB
38 Failure 1037 37 400 251 KB
39 Failure 1038 38 400 231 KB
40 Failure 1039 39 400 337 KB
41 Failure 1040 40 400 266 KB
42 Failure 1041 41 400 279 KB
43 Failure 1042 42 400 277 KB
44 Failure 1043 43 400 234 KB
45 Failure 1044 44 400 208 KB
46 Failure 1045 45 400 275 KB
47 Failure 1046 46 400 223 KB
48 Failure 1047 47 400 232 KB
49 Failure 1048 48 400 233 KB
50 Failure 1049 49 400 291 KB

Integrity

Task attestation

Status
complete
Completed
Aug 16, 2026, 10:50 AM UTC
Manifest SHA-256
25e8b8ee2f…575387d9
Aggregate SHA-256
d60480b69e…8573f13b
Episode index SHA-256
f2c3675fcb…1de21938
Validation SHA-256
7d9ec6bdd7…77630218
Artifact inventory SHA-256
bc3d93acb0…d054d941