MolmoAct 2 Evaluation gallery
IN PROGRESS · PROVISIONAL Only fully completed, validated task shards are shown. Campaign coverage and aggregate rates can change.
Supplemental Task 021 Validated task

turn on the stove and put the frying pan on it

Completed task success rate
0.0%
0 of 50
Control horizon
400
Maximum steps
Camera videos
100
Two per rollout
Evaluation time
11m 20s
Task process wall time

Canonical catalog

Task definition

Model instruction
turn on the stove and put the frying pan on it
BDDL language
turn on the stove and put the frying pan on it
Problem
libero_kitchen_tabletop_manipulation
Objects
chefmate_8_frypan_1, moka_pot_1
Fixtures
flat_stove_1, kitchen_table
Initial-state predicates
3
Fixed init states
50
Exact initial-state predicates 
(on flat_stove_1 kitchen_table_flat_stove_init_region)
(on chefmate_8_frypan_1 kitchen_table_frypan_init_region)
(on moka_pot_1 kitchen_table_moka_pot_init_region)

Open exact BDDL definition

Simulator truth

Completion criteria

LIBERO checks these BDDL goal predicates after every action. All conditions must be true simultaneously in the same simulator step for the rollout to succeed.

  1. flat stove 1 is turned on

    (turnon flat_stove_1)

  2. chefmate 8 frypan 1 is on flat stove 1 cook region

    (on chefmate_8_frypan_1 flat_stove_1_cook_region)
Exact parsed BDDL goal state 
(turnon flat_stove_1)
(on chefmate_8_frypan_1 flat_stove_1_cook_region)

Selected rollout

LIBERO-90 · Task 021 · Episode 1

Failure
Agent view observation.images.image
Eye in hand observation.images.image2
Videos are not loaded yet.

Rollout record

Episode metadata

Link to episode
Episode
1
Seed
1000
Init state
0
Control steps
400
Wall time
14s
Outcome
Failure

Evidence browser

All rollouts

Select one episode to mount only its two camera streams in the player.

Episode Outcome Seed Init state Steps Video
1 Failure 1000 0 400 325 KB
2 Failure 1001 1 400 304 KB
3 Failure 1002 2 400 300 KB
4 Failure 1003 3 400 298 KB
5 Failure 1004 4 400 324 KB
6 Failure 1005 5 400 311 KB
7 Failure 1006 6 400 307 KB
8 Failure 1007 7 400 273 KB
9 Failure 1008 8 400 314 KB
10 Failure 1009 9 400 254 KB
11 Failure 1010 10 400 301 KB
12 Failure 1011 11 400 302 KB
13 Failure 1012 12 400 299 KB
14 Failure 1013 13 400 304 KB
15 Failure 1014 14 400 288 KB
16 Failure 1015 15 400 278 KB
17 Failure 1016 16 400 327 KB
18 Failure 1017 17 400 337 KB
19 Failure 1018 18 400 300 KB
20 Failure 1019 19 400 317 KB
21 Failure 1020 20 400 267 KB
22 Failure 1021 21 400 276 KB
23 Failure 1022 22 400 320 KB
24 Failure 1023 23 400 317 KB
25 Failure 1024 24 400 272 KB
26 Failure 1025 25 400 270 KB
27 Failure 1026 26 400 299 KB
28 Failure 1027 27 400 307 KB
29 Failure 1028 28 400 306 KB
30 Failure 1029 29 400 322 KB
31 Failure 1030 30 400 270 KB
32 Failure 1031 31 400 315 KB
33 Failure 1032 32 400 295 KB
34 Failure 1033 33 400 281 KB
35 Failure 1034 34 400 301 KB
36 Failure 1035 35 400 296 KB
37 Failure 1036 36 400 297 KB
38 Failure 1037 37 400 283 KB
39 Failure 1038 38 400 308 KB
40 Failure 1039 39 400 293 KB
41 Failure 1040 40 400 309 KB
42 Failure 1041 41 400 305 KB
43 Failure 1042 42 400 283 KB
44 Failure 1043 43 400 315 KB
45 Failure 1044 44 400 273 KB
46 Failure 1045 45 400 298 KB
47 Failure 1046 46 400 295 KB
48 Failure 1047 47 400 300 KB
49 Failure 1048 48 400 319 KB
50 Failure 1049 49 400 280 KB

Integrity

Task attestation

Status
complete
Completed
Aug 16, 2026, 8:44 AM UTC
Manifest SHA-256
1a387e850f…c4bbf067
Aggregate SHA-256
243cef599e…7cecf72f
Episode index SHA-256
8adf80cd09…5f06bb90
Validation SHA-256
1a3fe001a7…2ef44029
Artifact inventory SHA-256
bae6faf512…1e40a3a9