MolmoAct 2 Evaluation gallery
IN PROGRESS · PROVISIONAL Only fully completed, validated task shards are shown. Campaign coverage and aggregate rates can change.
Supplemental Task 059 Validated task

pick up the tomato sauce and put it in the tray

Completed task success rate
66.0%
33 of 50
Control horizon
400
Maximum steps
Camera videos
100
Two per rollout
Evaluation time
8m 16s
Task process wall time

Canonical catalog

Task definition

Model instruction
pick up the tomato sauce and put it in the tray
BDDL language
pick up the tomato sauce and put it in the tray
Problem
libero_living_room_tabletop_manipulation
Objects
alphabet_soup_1, butter_1, cream_cheese_1, ketchup_1, tomato_sauce_1, wooden_tray_1
Fixtures
living_room_table
Initial-state predicates
6
Fixed init states
50
Exact initial-state predicates 
(on alphabet_soup_1 living_room_table_alphabet_soup_init_region)
(on cream_cheese_1 living_room_table_cream_cheese_init_region)
(on tomato_sauce_1 living_room_table_tomato_sauce_init_region)
(on ketchup_1 living_room_table_ketchup_init_region)
(on butter_1 living_room_table_butter_init_region)
(on wooden_tray_1 living_room_table_wooden_tray_init_region)

Open exact BDDL definition

Simulator truth

Completion criteria

LIBERO checks these BDDL goal predicates after every action. All conditions must be true simultaneously in the same simulator step for the rollout to succeed.

  1. tomato sauce 1 is in wooden tray 1 contain region

    (in tomato_sauce_1 wooden_tray_1_contain_region)
Exact parsed BDDL goal state 
(in tomato_sauce_1 wooden_tray_1_contain_region)

Selected rollout

LIBERO-90 · Task 059 · Episode 1

Failure
Agent view observation.images.image
Eye in hand observation.images.image2
Videos are not loaded yet.

Rollout record

Episode metadata

Link to episode
Episode
1
Seed
1000
Init state
0
Control steps
400
Wall time
15s
Outcome
Failure

Evidence browser

All rollouts

Select one episode to mount only its two camera streams in the player.

Episode Outcome Seed Init state Steps Video
1 Failure 1000 0 400 241 KB
2 Failure 1001 1 400 225 KB
3 Success 1002 2 92 71 KB
4 Failure 1003 4 400 245 KB
5 Success 1004 5 393 226 KB
6 Success 1005 7 102 76 KB
7 Failure 1006 9 400 224 KB
8 Success 1007 10 83 70 KB
9 Failure 1008 12 400 189 KB
10 Success 1009 13 288 197 KB
11 Success 1010 15 97 73 KB
12 Success 1011 17 306 221 KB
13 Success 1012 19 348 236 KB
14 Success 1013 21 286 202 KB
15 Failure 1014 23 400 246 KB
16 Success 1015 24 93 71 KB
17 Failure 1016 26 400 211 KB
18 Success 1017 27 239 170 KB
19 Failure 1018 29 400 225 KB
20 Success 1019 30 273 187 KB
21 Success 1020 32 110 80 KB
22 Failure 1021 34 400 248 KB
23 Success 1022 35 87 72 KB
24 Success 1023 37 91 72 KB
25 Success 1024 39 102 76 KB
26 Success 1025 41 102 76 KB
27 Success 1026 43 150 101 KB
28 Success 1027 45 96 74 KB
29 Success 1028 47 93 70 KB
30 Failure 1029 49 400 259 KB
31 Success 1030 0 269 201 KB
32 Success 1031 2 93 71 KB
33 Failure 1032 4 400 227 KB
34 Failure 1033 5 400 218 KB
35 Success 1034 6 93 70 KB
36 Success 1035 8 94 69 KB
37 Success 1036 10 83 69 KB
38 Success 1037 12 143 96 KB
39 Success 1038 14 95 72 KB
40 Success 1039 16 139 98 KB
41 Failure 1040 18 400 242 KB
42 Success 1041 19 230 169 KB
43 Failure 1042 21 400 174 KB
44 Failure 1043 22 400 234 KB
45 Success 1044 23 134 97 KB
46 Success 1045 25 147 104 KB
47 Success 1046 27 231 165 KB
48 Failure 1047 29 400 237 KB
49 Failure 1048 30 400 227 KB
50 Success 1049 31 264 193 KB

Integrity

Task attestation

Status
complete
Completed
Aug 16, 2026, 3:19 PM UTC
Manifest SHA-256
d9a07d7adb…6d1194ab
Aggregate SHA-256
31ec74b5a5…116ae720
Episode index SHA-256
98f5f46cdb…16db1af8
Validation SHA-256
ba131d1fdf…7c9f7e3b
Artifact inventory SHA-256
e7671176c8…5f9124b6