MolmoAct 2 Evaluation gallery
IN PROGRESS · PROVISIONAL Only fully completed, validated task shards are shown. Campaign coverage and aggregate rates can change.
Supplemental Task 041 Validated task

put the frying pan on top of the cabinet

Completed task success rate
4.0%
2 of 50
Control horizon
400
Maximum steps
Camera videos
100
Two per rollout
Evaluation time
10m 59s
Task process wall time

Canonical catalog

Task definition

Model instruction
put the frying pan on top of the cabinet
BDDL language
put the frying pan on top of the cabinet
Problem
libero_kitchen_tabletop_manipulation
Objects
chefmate_8_frypan_1, white_bowl_1
Fixtures
flat_stove_1, kitchen_table, wooden_two_layer_shelf_1
Initial-state predicates
4
Fixed init states
50
Exact initial-state predicates 
(on flat_stove_1 kitchen_table_flat_stove_init_region)
(on chefmate_8_frypan_1 kitchen_table_frypan_init_region)
(on white_bowl_1 kitchen_table_white_bowl_init_region)
(on wooden_two_layer_shelf_1 kitchen_table_wooden_two_layer_shelf_init_region)

Open exact BDDL definition

Simulator truth

Completion criteria

LIBERO checks these BDDL goal predicates after every action. All conditions must be true simultaneously in the same simulator step for the rollout to succeed.

  1. chefmate 8 frypan 1 is on wooden two layer shelf 1 top side

    (on chefmate_8_frypan_1 wooden_two_layer_shelf_1_top_side)
Exact parsed BDDL goal state 
(on chefmate_8_frypan_1 wooden_two_layer_shelf_1_top_side)

Selected rollout

LIBERO-90 · Task 041 · Episode 1

Failure
Agent view observation.images.image
Eye in hand observation.images.image2
Videos are not loaded yet.

Rollout record

Episode metadata

Link to episode
Episode
1
Seed
1000
Init state
0
Control steps
400
Wall time
14s
Outcome
Failure

Evidence browser

All rollouts

Select one episode to mount only its two camera streams in the player.

Episode Outcome Seed Init state Steps Video
1 Failure 1000 0 400 270 KB
2 Failure 1001 1 400 202 KB
3 Failure 1002 2 400 270 KB
4 Failure 1003 3 400 284 KB
5 Failure 1004 4 400 301 KB
6 Failure 1005 5 400 276 KB
7 Failure 1006 6 400 225 KB
8 Failure 1007 7 400 281 KB
9 Failure 1008 8 400 282 KB
10 Success 1009 9 99 80 KB
11 Failure 1010 11 400 238 KB
12 Failure 1011 12 400 264 KB
13 Failure 1012 13 400 281 KB
14 Failure 1013 14 400 230 KB
15 Failure 1014 15 400 217 KB
16 Failure 1015 16 400 274 KB
17 Failure 1016 17 400 269 KB
18 Failure 1017 18 400 266 KB
19 Failure 1018 19 400 227 KB
20 Failure 1019 20 400 262 KB
21 Failure 1020 21 400 216 KB
22 Failure 1021 22 400 275 KB
23 Failure 1022 23 400 284 KB
24 Failure 1023 24 400 280 KB
25 Failure 1024 25 400 275 KB
26 Failure 1025 26 400 264 KB
27 Failure 1026 27 400 282 KB
28 Failure 1027 28 400 295 KB
29 Failure 1028 29 400 247 KB
30 Failure 1029 30 400 242 KB
31 Failure 1030 31 400 286 KB
32 Success 1031 32 102 83 KB
33 Failure 1032 34 400 267 KB
34 Failure 1033 35 400 282 KB
35 Failure 1034 36 400 283 KB
36 Failure 1035 37 400 276 KB
37 Failure 1036 38 400 218 KB
38 Failure 1037 39 400 246 KB
39 Failure 1038 40 400 286 KB
40 Failure 1039 41 400 224 KB
41 Failure 1040 42 400 236 KB
42 Failure 1041 43 400 276 KB
43 Failure 1042 44 400 274 KB
44 Failure 1043 45 400 265 KB
45 Failure 1044 46 400 275 KB
46 Failure 1045 47 400 213 KB
47 Failure 1046 48 400 201 KB
48 Failure 1047 49 400 268 KB
49 Failure 1048 0 400 270 KB
50 Failure 1049 1 400 201 KB

Integrity

Task attestation

Status
complete
Completed
Aug 16, 2026, 12:29 PM UTC
Manifest SHA-256
9bb81facd7…55d9a5fc
Aggregate SHA-256
9bc885923b…387734a2
Episode index SHA-256
3746cd7854…58e75ee4
Validation SHA-256
9a83feb232…6d0d96ad
Artifact inventory SHA-256
a53db9d048…80385f27