The forty source-paired tasks: ten in each of LIBERO-Spatial, -Object, -Goal and -10. Each runs in its base suite (libero_<family>) and in LIBERO-Pro's four core perturbation suites (libero_<family>_task, _swap, _lan, _object, reported as Task, Pos, Sem and Obj), each task on 50 official initial states. A base cell instructs with LIBERO's official instruction (the task's BDDL file name as text); a core cell instructs with its own BDDL (:language ...) field, and launch preflight compares that field with the BDDL it loads. Success is decided only by LIBERO's own termination; ORA gives no completion contract for these tasks. Generated from ora/environment/benchmarks/libero_pro_language.py (TASK_ROWS).
| Family | Base suite | Tasks |
|---|---|---|
| LIBERO-Spatial | libero_spatial |
10 |
| LIBERO-Object | libero_object |
10 |
| LIBERO-Goal | libero_goal |
10 |
| LIBERO-10 | libero_10 |
10 |
LIBERO-Spatial
Base suite libero_spatial; core suites libero_spatial_task, libero_spatial_swap, libero_spatial_lan and libero_spatial_object. The position (_swap) variant moves objects and keeps the base BDDL wording.
| Task | Official instruction (base) | Task (_task) |
Position (_swap) |
Language (_lan) |
Object (_object) |
|---|---|---|---|---|---|
| 0 | pick up the black bowl between the plate and the ramekin and place it on the plate | Pick the akita black bowl not between the plate and the ramekin and place it on the plate | Pick the akita black bowl between the plate and the ramekin and place it on the plate | lift the black bowl between the plate and ramekin and set it on the plate | Pick the akita black bowl between the plate and the ramekin and place it on the plate |
| 1 | pick up the black bowl next to the ramekin and place it on the plate | Pick the akita black bowl next to the cookie box and place it on the plate | Pick the akita black bowl next to the ramekin and place it on the plate | take black bowl next to ramekin and place on plate | Pick the akita black bowl next to the ramekin and place it on the plate |
| 2 | pick up the black bowl from table center and place it on the plate | Pick the akita black bowl next to the plate and place it on the plate | Pick the akita black bowl from table center and place it on the plate | lift the black bowl from the table center and put it on the plate | Pick the akita black bowl from table center and place it on the plate |
| 3 | pick up the black bowl on the cookie box and place it on the plate | Pick the akita black bowl on the top of the cabinet and place it on the plate | Pick the akita black bowl on the cookies box and place it on the plate | lift black bowl from cookie box and put it on plate | Pick the akita black bowl on the cookies box and place it on the plate |
| 4 | pick up the black bowl in the top drawer of the wooden cabinet and place it on the plate | Pick the akita black bowl on the top of the wooden cabinet and place it on the plate | Pick the akita black bowl in the top layer of the wooden cabinet and place it on the plate | take the black bowl from the top drawer and put it on plate | Pick the akita black bowl in the top layer of the wooden cabinet and place it on the plate |
| 5 | pick up the black bowl on the ramekin and place it on the plate | Pick the akita black bowl on the cookie box and place it on the plate | Pick the akita black bowl on the ramekin and place it on the plate | grab black bowl on ramekin and set it on plate | Pick the akita black bowl on the ramekin and place it on the plate |
| 6 | pick up the black bowl next to the cookie box and place it on the plate | Pick the akita black bowl on the stove and place it on the plate | Pick the akita black bowl next to the cookies box and place it on the plate | grab the black bowl beside the cookie box and set it on plate | Pick the akita black bowl next to the cookies box and place it on the plate |
| 7 | pick up the black bowl on the stove and place it on the plate | Pick the akita black bowl on the top of the cabinet and place it on the plate | Pick the akita black bowl on the stove and place it on the plate | lift bowl from stove and set on plate | Pick the akita black bowl on the stove and place it on the plate |
| 8 | pick up the black bowl next to the plate and place it on the plate | Pick the akita black bowl next to the ramekin and place it on the plate | Pick the akita black bowl next to the plate and place it on the plate | pick the bowl beside the plate and put it on plate | Pick the akita black bowl next to the plate and place it on the plate |
| 9 | pick up the black bowl on the wooden cabinet and place it on the plate | Pick the akita black bowl on the stove and place it on the plate | Pick the akita black bowl on the wooden cabinet and place it on the plate | lift bowl from cabinet and put on plate | Pick the akita black bowl on the wooden cabinet and place it on the plate |
LIBERO-Object
Base suite libero_object; core suites libero_object_task, libero_object_swap, libero_object_lan and libero_object_object. The position (_swap) variant moves objects and keeps the base BDDL wording.
| Task | Official instruction (base) | Task (_task) |
Position (_swap) |
Language (_lan) |
Object (_object) |
|---|---|---|---|---|---|
| 0 | pick up the alphabet soup and place it in the basket | Pick the cream cheese and place it in the basket | Pick the alphabet soup and place it in the basket | grab alphabet soup and put it into basket | Pick the alphabet soup and place it in the basket |
| 1 | pick up the cream cheese and place it in the basket | Pick the alphabet soup and place it in the basket | Pick the cream cheese and place it in the basket | grab cream cheese and put into basket | Pick the cream cheese and place it in the basket |
| 2 | pick up the salad dressing and place it in the basket | Pick the tomato sauce and place it in the basket | Pick the salad dressing and place it in the basket | grab salad dressing and put into basket | Pick the salad dressing and place it in the basket |
| 3 | pick up the bbq sauce and place it in the basket | Pick the ketchup and place it in the basket | Pick the bbq sauce and place it in the basket | pick up bbq sauce and put it into basket | Pick the bbq sauce and place it in the basket |
| 4 | pick up the ketchup and place it in the basket | Pick the milk and place it in the basket | Pick the ketchup and place it in the basket | lift ketchup and put it in basket | Pick the ketchup and place it in the basket |
| 5 | pick up the tomato sauce and place it in the basket | Pick the bbq sauce and place it in the basket | Pick the tomato sauce and place it in the basket | pick tomato sauce and put it in basket | Pick the tomato sauce and place it in the basket |
| 6 | pick up the butter and place it in the basket | Pick the orange juice and place it in the basket | Pick the butter and place it in the basket | grab butter and put it into basket | Pick the butter and place it in the basket |
| 7 | pick up the milk and place it in the basket | Pick the butter and place it in the basket | Pick the milk and place it in the basket | grab milk and put into basket | Pick the milk and place it in the basket |
| 8 | pick up the chocolate pudding and place it in the basket | Pick the salad dressing and place it in the basket | Pick the chocolate pudding and place it in the basket | lift chocolate pudding and put it in basket | Pick the chocolate pudding and place it in the basket |
| 9 | pick up the orange juice and place it in the basket | Pick the chocolate pudding and place it in the basket | Pick the orange juice and place it in the basket | pick orange juice and put into basket | Pick the orange juice and place it in the basket |
LIBERO-Goal
Base suite libero_goal; core suites libero_goal_task, libero_goal_swap, libero_goal_lan and libero_goal_object. The position (_swap) variant moves objects and keeps the base BDDL wording.
| Task | Official instruction (base) | Task (_task) |
Position (_swap) |
Language (_lan) |
Object (_object) |
|---|---|---|---|---|---|
| 0 | open the middle drawer of the cabinet | open the bottom drawer of the cabinet | Open the middle layer of the drawer | open the cabinet’s middle drawer | Open the middle layer of the drawer |
| 1 | put the bowl on the stove | Put the plate on the stove | Put the bowl on the stove | place the bowl on the stove | Put the bowl on the stove |
| 2 | put the wine bottle on top of the cabinet | put the wine bottle in the bowl | Put the wine bottle on the top of the drawer | place the wine bottle on top of the cabinet | Put the wine bottle on the top of the drawer |
| 3 | open the top drawer and put the bowl inside | Open the top layer of the drawer and put the cream cheese inside | Open the top layer of the drawer and put the bowl inside | slide open the top drawer and place the bowl in it | Open the top layer of the drawer and put the bowl inside |
| 4 | put the bowl on top of the cabinet | Put the plate on the top of the drawer | Put the bowl on the top of the drawer | place the bowl on top of the cabinet | Put the bowl on the top of the drawer |
| 5 | push the plate to the front of the stove | Push the cream cheese to the front of the stove | Push the plate to the front of the stove | move the plate to the stove’s front | Push the plate to the front of the stove |
| 6 | put the cream cheese in the bowl | put the wine bottle in the bowl | Put the cream cheese on the bowl | place the cream cheese inside the bowl | Put the cream cheese on the bowl |
| 7 | turn on the stove | Turn off the stove | Turn on the stove | switch on the stove | Turn on the stove |
| 8 | put the bowl on the plate | Put the wine bottle on the plate | Put the bowl on the plate | place the bowl on top of the plate | Put the bowl on the plate |
| 9 | put the wine bottle on the rack | Put the cream cheese on the rack | Put the wine bottle on the rack | place the wine bottle on the rack | Put the wine bottle on the rack |
LIBERO-10
Base suite libero_10; core suites libero_10_task, libero_10_swap, libero_10_lan and libero_10_object. The position (_swap) variant moves objects and keeps the base BDDL wording.
| Task | Official instruction (base) | Task (_task) |
Position (_swap) |
Language (_lan) |
Object (_object) |
|---|---|---|---|---|---|
| 0 | put both the alphabet soup and the tomato sauce in the basket | put both the cream cheese and the tomato sauce in the basket | put both the alphabet soup and the tomato sauce in the basket | place alphabet soup and tomato sauce into basket | put both the alphabet soup and the tomato sauce in the basket |
| 1 | put both the cream cheese box and the butter in the basket | put both the alphabet soup and the butter in the basket | put both the cream cheese box and the butter in the basket | place cream cheese box and butter into basket | put both the cream cheese box and the butter in the basket |
| 2 | turn on the stove and put the moka pot on it | turn on the stove and put the pan on it | turn on the stove and put the moka pot on it | switch stove on and put moka pot on it | turn on the stove and put the moka pot on it |
| 3 | put the black bowl in the bottom drawer of the cabinet and close it | put the bottle in the bottom drawer of the cabinet and close it | put the black bowl in the bottom drawer of the cabinet and close it | put black bowl inside bottom drawer and close it | put the black bowl in the bottom drawer of the cabinet and close it |
| 4 | put the white mug on the left plate and put the yellow and white mug on the right plate | put the yellow and white mug on the left plate and put the white mug on the right plate | put the white mug on the left plate and put the yellow and white mug on the right plate | place white mug on left plate and yellow-white mug on right plate | put the white mug on the left plate and put the yellow and white mug on the right plate |
| 5 | pick up the book and place it in the back compartment of the caddy | pick up the cup and place it in the back compartment of the caddy | pick up the book and place it in the back compartment of the caddy | pick up the book and place in back compartment | pick up the book and place it in the back compartment of the caddy |
| 6 | put the white mug on the plate and put the chocolate pudding to the right of the plate | put the red mug on the plate and put the chocolate pudding to the right of the plate | put the white mug on the plate and put the chocolate pudding to the right of the plate | place white mug on plate and chocolate pudding to right | put the white mug on the plate and put the chocolate pudding to the right of the plate |
| 7 | put both the alphabet soup and the cream cheese box in the basket | put both the ketchup and the cream cheese box in the basket | put both the alphabet soup and the cream cheese box in the basket | put alphabet soup and cream cheese box in basket | put both the alphabet soup and the cream cheese box in the basket |
| 8 | put both moka pots on the stove | put the left moka pot on the stove | put both moka pots on the stove | place both moka pots on stove | put both moka pots on the stove |
| 9 | put the yellow and white mug in the microwave and close it | put the white mug in the microwave and close it | put the yellow and white mug in the microwave and close it | place yellow and white mug in microwave and close door | put the yellow and white mug in the microwave and close it |