120 admitted RoboLab tasks on the DROID Franka with a Robotiq 2F-85 gripper. For each: the upstream default instruction, the native-action limit (the upstream episode length at 15 Hz) and the public completion contract ORA gives the model. Success is decided only by RoboLab's own success termination; the contract restates it and never replaces it. Generated from ora/environment/benchmarks/robolab.py (TASKS) and ora/policy/environments/robolab/task-contracts/registry-v1.json.
| Task | Instruction | Native action limit | Contract |
|---|---|---|---|
AnimalsInBinTask |
Put the lizards in the bin | 1350 | reviewed |
AppleAndYogurtInBowlTask |
Put the apple and yogurt in the bowl | 1800 | reviewed |
BBQSauceInBinTask |
Put the red BBQ sauce bottles in the grey bin | 1350 | reviewed |
BagelsOnPlateTask |
Put the bagels on the plate | 900 | reviewed |
BananaInBowlTask |
Pick up the banana and place it in the bowl | 750 | reviewed |
BananaOnPlateTask |
Pick up the banana and put it on the plate | 600 | reviewed |
BananaThenRubiksCubeTask |
put the banana then the cube in the bowl | 900 | reviewed |
BananasInBinOneMoreTask |
Put one (1) more bananas in the grey bin. | 900 | reviewed |
BananasInBinThreeTotalTask |
Make sure there are 3 (three) bananas in the grey bin. | 900 | reviewed |
BananasInCrateTask |
Put 2 bananas in the crate | 900 | reviewed |
BananasOutOfBinTask |
Take the bananas out | 1350 | reviewed |
BigPumpkinInBinTask |
Put the bigger pumpkin in the bin | 900 | reviewed |
BlackItemsInBinTask |
Put the black items in the grey bin | 1800 | reviewed |
BlockStackingOrderAgnosticTask |
Stack the blocks into a tower | 1350 | reviewed |
BlockStackingSpecifiedOrderTask |
Stack the blocks in the order from bottom to top: red, blue, green, yellow | 1350 | reviewed |
BlocksInBinTask |
Sort all colored blocks into the bin | 2250 | reviewed |
BowlInBinTask |
put the bowl in the grey bin | 900 | reviewed |
BowlStackingLeftOnRightTask |
Stack the left bowl on the right bowl | 300 | reviewed |
BowlStackingRightOnLeftTask |
Stack the right bowl on the left bowl | 300 | reviewed |
ButterAboveRaisinTask |
Pick up the butter box and place it on top of the raisin box | 600 | reviewed |
CannedFoodInBinTask |
Put the canned food in the grey bin | 900 | reviewed |
ClampInRightBinTask |
Put the spring clamp in the right bin | 900 | reviewed |
CleanUpToysTask |
Clean up all the smaller toys and leave the birdhouse on the table | 4500 | reviewed |
ClearOrganicObjectsTask |
Clear away the organic objects | 3600 | reviewed |
ClutterPlasticTask |
Put all plastic bottles away in the bin | 2700 | reviewed |
ClutterPumpkinTask |
Put all the pumpkins away in the bin | 1350 | reviewed |
CoffeePotInBinTask |
Put the coffee pot in the grey bin | 900 | reviewed |
CondimentsInBinTask |
Sort the sauce condiments into the grey bin | 2700 | reviewed |
CookingClearPlateTask |
Put the two measuring cups outside of the plate | 2700 | reviewed |
CookingPickPastaToolTask |
Move the pink tool from this utensil container to the other utensil holder | 900 | reviewed |
CubesAndBlocksInBinTask |
Put all the cubes and blocks in the bin | 3600 | reviewed |
DishesInBinTask |
Put the dishware in the grey bin | 2700 | reviewed |
ElectronicsInBinTask |
Put the electronic devices in the grey bin | 2700 | reviewed |
FoodPacking1BoxesTask |
Pack boxed foods into the bin | 900 | reviewed |
FoodPacking1CansTask |
Pack canned foods into the bin | 900 | reviewed |
FoodPacking2BoxesTask |
Pack boxed foods into the bin | 2700 | reviewed |
FoodPacking2CansTask |
Pack canned foods into the bin | 2700 | reviewed |
FoodPacking3BoxesTask |
Pack boxed foods into the bin | 3600 | reviewed |
FoodPacking3CansTask |
Pack canned foods into the bin | 3600 | reviewed |
FoodPackingByColorTask |
Pack yellow objects in right container and blue object in the left container | 1800 | reviewed |
FruitsGreenLimesOnPlateTask |
Put all the green fruit on the plate | 1350 | reviewed |
FruitsMovingOrangeOrLimeTask |
Move an orange or a lime to the wood bowl | 900 | reviewed |
FruitsMovingTask |
Move an orange to the white bowl | 900 | reviewed |
FruitsOnPlate3Task |
Put three (3) fruits on the plate | 3000 | reviewed |
FruitsOnPlateTask |
Put all the fruits on the plate | 4500 | reviewed |
FruitsOnionTask |
Put the onion in the wood bowl | 900 | reviewed |
FruitsOnionToPlateTask |
Put the onion on the plate | 900 | reviewed |
FruitsOrangesOnPlateTask |
Put all the oranges on the plate | 1350 | reviewed |
GrabABagelTask |
Grab a bagel | 450 | reviewed |
GrabAFruitTask |
Pick up a fruit | 450 | reviewed |
GreenSpoonsInPotTask |
Put the green spoons in the pot | 2700 | reviewed |
HammersInLeftBinTask |
Put the red hammer and black hammer in the left bin | 2700 | reviewed |
JugsOnShelfTask |
Put all the jugs on the shelf | 1800 | reviewed |
KeyboardOutOfBinTask |
Take the keyboard out of the bin and put it on the table | 900 | reviewed |
LargerObjectRaisinBoxInBinTask |
Place the larger object in the grey bin. | 450 | reviewed |
MarkerInMugTask |
Put the whiteboard marker in the mug | 600 | reviewed |
MouseOnKeyboardTask |
Put the computer mouse on the keyboard | 900 | reviewed |
MoveBananaToBagelPlateTask |
Move the bananas to the bagel plate | 1350 | reviewed |
MustardAboveRaisinTask |
Place the mustard on the raisin box. | 600 | reviewed |
MustardInLeftBinTask |
Put the mustard in the left bin | 450 | reviewed |
MustardInRightBinTask |
Put the mustard in the right bin | 450 | reviewed |
NonHammerToolsInRightBinTask |
Put the non-hammer tools in the right bin | 2700 | reviewed |
OneBottleInSquarePailTask |
Put any white plastic bottle in the square pail | 900 | reviewed |
OneBottleOnShelfTask |
Put any white plastic bottle on the shelf | 900 | reviewed |
PhoneOrRemoteInBinTask |
Put the phone or the remote in the grey bin | 900 | reviewed |
PickDrillTask |
Pick up the cordless drill. | 600 | reviewed |
PickGlassesTask |
Pick up the eye glasses | 450 | reviewed |
PickOrangeObjectTask |
Pick up the orange measuring cup | 900 | reviewed |
PickUpBluePitcherTask |
Pick up the large blue pitcher | 450 | reviewed |
PickUpGreenObjectTask |
Pick up the green vegetable block | 450 | reviewed |
PinkSpoonInPotTask |
Put the pink spaghetti spoon in the pot | 900 | reviewed |
PlasticBottlesInSquarePailTask |
Put all the small plastic bottles in the square pail | 2700 | reviewed |
PutBowlOnShelfTopTask |
Put the serving bowl anywhere on the shelf in front of you | 900 | reviewed |
PutMugsOnShelfTask |
Put the two mugs on the shelf | 2700 | reviewed |
PutTwoMugsOnShelfTask |
Put two (2) mugs on the wire shelf | 2700 | reviewed |
RecycleCartonTask |
Put the recyclable cartons in the grey bin | 1350 | reviewed |
RecycleCartonsOnBoxTask |
Put the cartons that can be recycled on the box | 1350 | reviewed |
RecycleCartonsVerticalCrateTask |
Put the cartons that can be recycled in the vertical crate | 1350 | reviewed |
RedDishesInBinTask |
Put the red dishware in the grey bin | 900 | reviewed |
RedItemsInBinTask |
Put all the red things in the grey bin | 900 | reviewed |
ReorientAllMugsTask |
Reorient all the mugs upright so that the opening is facing upwards. | 1350 | reviewed |
ReorientJugTask |
Stand the jug upright | 900 | reviewed |
ReorientRedMugTask |
Put the red mug upright so that the opening is facing upwards. | 900 | reviewed |
ReorientWhiteMugsTask |
Make sure all the white mugs are upright so that the opening is facing upwards. | 900 | reviewed |
RubiksCubeAndBananaTask |
Put the cube and the banana in the bowl | 900 | reviewed |
RubiksCubeBehindBowlTask |
Put the rubiks cube behind the bowl | 450 | reviewed |
RubiksCubeInFrontOfBowlTask |
Put the rubiks cube in front of the bowl | 450 | reviewed |
RubiksCubeLeftOfBowlTask |
Put the rubiks cube to the left of the bowl | 450 | reviewed |
RubiksCubeOrBananaTask |
Put the cube or the banana in the bowl | 450 | reviewed |
RubiksCubeRightOfBowlTask |
Put the rubiks cube to the right of the bowl | 450 | reviewed |
RubiksCubeTask |
Put the cube in the bowl | 600 | reviewed |
RubiksCubeThenBananaTask |
Put the cube then the banana in the bowl | 900 | reviewed |
RubiksCubesInBinTask |
Sort all rubiks cubes into the bin | 1800 | reviewed |
SauceBottlesCrateTask |
Put the red bbq sauce bottle in the crate | 600 | reviewed |
SmallPumpkinInBinTask |
Put the small pumpkin in the bin | 900 | reviewed |
SmallerObjectButterInBinTask |
Place the smaller object in the grey bin. | 450 | reviewed |
SmartphoneInBinTask |
Put the smartphone in the grey bin | 900 | reviewed |
SpoonInMugTask |
Put the metal spoon that's in the wooden bowl in the mug | 900 | reviewed |
SpoonsInPotTask |
Put all of the serving spoons with no holes in the pot | 2700 | reviewed |
Stack3RubiksCubeTask |
Stack the rubiks cubes in a tower | 900 | reviewed |
StackWhiteMugsTask |
Stack the white mugs on top of each other. | 900 | reviewed |
StackYellowOnRedTask |
Stack the yellow block on the red block | 900 | reviewed |
TakeMeasuringSpoonOutTask |
Take the white colored measuring spoon out of the red bowl and put it on the table. | 600 | reviewed |
TakeMugsOffOfShelfTask |
Take the mugs off the shelf | 2700 | reviewed |
TakeSpatulaOffShelfTask |
Take the spatula off the shelf and put it on the table | 900 | reviewed |
ThrowAwayAppleTask |
Throw away the apple | 900 | reviewed |
ThrowAwaySnacksTask |
Put away the snacks in the bin | 1800 | reviewed |
ToolOrganizationBothTask |
Put hammers in the right bin and do not touch anything else | 2700 | reviewed |
ToolOrganizationTask |
Put the red hammer and black hammer in the left bin | 2700 | reviewed |
ToolsPickingAllHammersTask |
Take out all the hammers and put them on the table | 3600 | reviewed |
ToolsPickingDrillTask |
Select the cordless drill and put it on the table | 900 | reviewed |
ToolsPickingHammerTask |
Select the blue hammer and put it on the table | 900 | reviewed |
ToyInBinTask |
Put the lizard away in the bin | 900 | reviewed |
UnstackRubiksCubeTask |
Unstack the rubiks cube tower | 1350 | reviewed |
UtensilsInMugTask |
Put the fork and spoon in the ceramicmug | 1350 | reviewed |
WhiteMugInCenterOfTableTask |
Put the white mug in the center of the table. | 450 | reviewed |
WhiteMugsInBinTask |
Clean up the white mugs | 900 | reviewed |
WoodSpatulaToBowlTask |
Put the wooden spatula in the bowl | 900 | reviewed |
YellowAndWhiteObjectsInBinTask |
Put all white objects and yellow objects in the grey bin | 900 | reviewed |
YogurtInBowlTask |
Put the small red yogurt in the red bowl | 600 | reviewed |
AnimalsInBinTask
Instruction. Put the lizards in the bin
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- Both lizard figurines must end up inside the grey bin.
- Let go of each of them: the task is not complete while the gripper still touches either one.
AppleAndYogurtInBowlTask
Instruction. Put the apple and yogurt in the bowl
Native action limit. 1800 (120 s at 15 Hz).
Completion contract.
- Both the apple and the yogurt cup must end up inside the wooden bowl.
- Let go of each of them: the task is not complete while the gripper still touches either one.
BBQSauceInBinTask
Instruction. Put the red BBQ sauce bottles in the grey bin
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- The red BBQ sauce bottles must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
BagelsOnPlateTask
Instruction. Put the bagels on the plate
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- Both bagels must end up resting on the plate, each supported by the plate itself with its center over it.
- Let go of each of them: the task is not complete while the gripper still touches either one.
BananaInBowlTask
Instruction. Pick up the banana and place it in the bowl
Native action limit. 750 (50 s at 15 Hz).
Completion contract.
- The banana must end up inside the bowl and touching it.
- Let go of the banana there: the task is not complete while any part of the gripper still touches it.
BananaOnPlateTask
Instruction. Pick up the banana and put it on the plate
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The banana must end up resting on the plate, supported by the plate itself with its center over it.
- Let go of the banana there: the task is not complete while any part of the gripper still touches it.
BananaThenRubiksCubeTask
Instruction. put the banana then the cube in the bowl
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- Both the banana and the cube must end up inside the bowl, each touching it.
- The banana must come to rest in the bowl before the cube does: the order is fixed the first time each of them rests there, released, and taking one out again does not undo it.
- Let go of each of them: the task is not complete while the gripper still touches either one.
BananasInBinOneMoreTask
Instruction. Put one (1) more bananas in the grey bin.
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- Of the bananas that start on the table, exactly one must end up inside the grey bin; a second one inside the bin as well does not complete the task.
- Let go of it there: a banana the gripper still touches does not count.
- Leave the bananas that are already in the bin there.
BananasInBinThreeTotalTask
Instruction. Make sure there are 3 (three) bananas in the grey bin.
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- Of the bananas that start on the table, exactly one must end up inside the grey bin, so that three are in it; a second one from the table does not complete the task.
- Let go of it there: a banana the gripper still touches does not count.
- Leave the bananas that are already in the bin there.
BananasInCrateTask
Instruction. Put 2 bananas in the crate
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- Exactly two bananas must be inside the purple crate at the end, counting the one that starts there; a third banana inside does not complete the task.
- Let go of them there: a banana the gripper still touches does not count.
BananasOutOfBinTask
Instruction. Take the bananas out
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- Both bananas that start in the grey bin must end up out of it.
- Let go of each of them: the task is not complete while the gripper still touches either one.
BigPumpkinInBinTask
Instruction. Put the bigger pumpkin in the bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The bigger pumpkin must end up inside the bin.
- Let go of it there: the task is not complete while any part of the gripper still touches it.
BlackItemsInBinTask
Instruction. Put the black items in the grey bin
Native action limit. 1800 (120 s at 15 Hz).
Completion contract.
- The black items must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
BlockStackingOrderAgnosticTask
Instruction. Stack the blocks into a tower
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- The red block, the blue block, the green block and the yellow block must form a single tower, each one on top of another and touching it, in any order.
BlockStackingSpecifiedOrderTask
Instruction. Stack the blocks in the order from bottom to top: red, blue, green, yellow
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- The blocks must form one tower in this order from bottom to top: the red block, the blue block, the green block, then the yellow block; each one must sit on top of the one below it, touching it.
BlocksInBinTask
Instruction. Sort all colored blocks into the bin
Native action limit. 2250 (150 s at 15 Hz).
Completion contract.
- All the colored blocks must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
BowlInBinTask
Instruction. put the bowl in the grey bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The bowl must end up inside the grey bin.
- Let go of the bowl there: the task is not complete while any part of the gripper still touches it.
BowlStackingLeftOnRightTask
Instruction. Stack the left bowl on the right bowl
Native action limit. 300 (20 s at 15 Hz).
Completion contract.
- The left bowl must end up inside the right bowl and touching it.
- Let go of the left bowl there: the task is not complete while any part of the gripper still touches it.
BowlStackingRightOnLeftTask
Instruction. Stack the right bowl on the left bowl
Native action limit. 300 (20 s at 15 Hz).
Completion contract.
- The right bowl must end up inside the left bowl and touching it.
- Let go of the right bowl there: the task is not complete while any part of the gripper still touches it.
ButterAboveRaisinTask
Instruction. Pick up the butter box and place it on top of the raisin box
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The butter box must end up resting on the raisin box, supported by the raisin box itself with its center over it.
- Let go of the butter box there: the task is not complete while any part of the gripper still touches it.
CannedFoodInBinTask
Instruction. Put the canned food in the grey bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The canned food must end up inside the grey bin.
- Let go of it there: the task is not complete while any part of the gripper still touches it.
ClampInRightBinTask
Instruction. Put the spring clamp in the right bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The spring clamp must end up inside the right bin.
- Let go of the spring clamp there: the task is not complete while any part of the gripper still touches it.
CleanUpToysTask
Instruction. Clean up all the smaller toys and leave the birdhouse on the table
Native action limit. 4500 (300 s at 15 Hz).
Completion contract.
- All the smaller toys must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
- Leave the birdhouse on the table.
ClearOrganicObjectsTask
Instruction. Clear away the organic objects
Native action limit. 3600 (240 s at 15 Hz).
Completion contract.
- The organic objects must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
ClutterPlasticTask
Instruction. Put all plastic bottles away in the bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- All the plastic bottles must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
ClutterPumpkinTask
Instruction. Put all the pumpkins away in the bin
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- Both the large pumpkin and the small pumpkin must end up inside the bin.
- Let go of each of them: the task is not complete while the gripper still touches either one.
CoffeePotInBinTask
Instruction. Put the coffee pot in the grey bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The coffee pot must end up inside the grey bin.
- Let go of the coffee pot there: the task is not complete while any part of the gripper still touches it.
CondimentsInBinTask
Instruction. Sort the sauce condiments into the grey bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- The sauce condiments must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
CookingClearPlateTask
Instruction. Put the two measuring cups outside of the plate
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- Both the teal measuring spoons and the orange measuring cups must end up off the clay plate.
- Let go of each of them: the task is not complete while the gripper still touches either one.
CookingPickPastaToolTask
Instruction. Move the pink tool from this utensil container to the other utensil holder
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The pink tool must end up inside the other utensil holder (not the one it starts in) and touching it.
- Let go of it there: the task is not complete while any part of the gripper still touches it.
CubesAndBlocksInBinTask
Instruction. Put all the cubes and blocks in the bin
Native action limit. 3600 (240 s at 15 Hz).
Completion contract.
- Every one of these must end up inside the grey bin: all three Rubik's cubes, the yellow block, the red block, the green block and the blue block.
- Let go of each of them: the task is not complete while the gripper still touches any of them.
DishesInBinTask
Instruction. Put the dishware in the grey bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- The dishware must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
ElectronicsInBinTask
Instruction. Put the electronic devices in the grey bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- The electronic devices must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FoodPacking1BoxesTask
Instruction. Pack boxed foods into the bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The boxed foods must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FoodPacking1CansTask
Instruction. Pack canned foods into the bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The canned foods must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FoodPacking2BoxesTask
Instruction. Pack boxed foods into the bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- The boxed foods must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FoodPacking2CansTask
Instruction. Pack canned foods into the bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- The canned foods must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FoodPacking3BoxesTask
Instruction. Pack boxed foods into the bin
Native action limit. 3600 (240 s at 15 Hz).
Completion contract.
- The boxed foods must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FoodPacking3CansTask
Instruction. Pack canned foods into the bin
Native action limit. 3600 (240 s at 15 Hz).
Completion contract.
- The canned foods must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FoodPackingByColorTask
Instruction. Pack yellow objects in right container and blue object in the left container
Native action limit. 1800 (120 s at 15 Hz).
Completion contract.
- The blue object must end up inside the bin on the left, and the yellow objects inside the bin on the right.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FruitsGreenLimesOnPlateTask
Instruction. Put all the green fruit on the plate
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- All the green fruit must end up resting on the clay plate, each supported by the clay plate itself with its center over it.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FruitsMovingOrangeOrLimeTask
Instruction. Move an orange or a lime to the wood bowl
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- One of the oranges or limes must end up inside the wooden bowl, touching it; one of them is enough.
- Let go of it there: an object the gripper still touches does not count.
FruitsMovingTask
Instruction. Move an orange to the white bowl
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- One of the oranges must end up inside the white bowl, touching it; one of them is enough.
- Let go of it there: an object the gripper still touches does not count.
FruitsOnPlate3Task
Instruction. Put three (3) fruits on the plate
Native action limit. 3000 (200 s at 15 Hz).
Completion contract.
- Exactly three fruits must end up resting on the clay plate, each supported by the plate itself with its center over it, counting any fruit that starts there; a fourth fruit on the plate does not complete the task.
- Let go of them there: a fruit the gripper still touches does not count.
FruitsOnPlateTask
Instruction. Put all the fruits on the plate
Native action limit. 4500 (300 s at 15 Hz).
Completion contract.
- All the fruits must end up resting on the clay plate, each supported by the clay plate itself with its center over it.
- Let go of them there: the task is not complete while the gripper still touches any of them.
FruitsOnionTask
Instruction. Put the onion in the wood bowl
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The red onion must end up inside the wooden bowl and touching it.
- Let go of the red onion there: the task is not complete while any part of the gripper still touches it.
FruitsOnionToPlateTask
Instruction. Put the onion on the plate
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The red onion must end up resting on the clay plate, supported by the clay plate itself with its center over it.
- Let go of the red onion there: the task is not complete while any part of the gripper still touches it.
FruitsOrangesOnPlateTask
Instruction. Put all the oranges on the plate
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- Both oranges must end up resting on the clay plate, each supported by the clay plate itself with its center over it.
- Let go of each of them: the task is not complete while the gripper still touches either one.
GrabABagelTask
Instruction. Grab a bagel
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- One bagel must be held in the gripper and lifted so that all of it is clear above the table top, still over the table; any of the three bagels counts.
- The task completes while it is held: once set down or dropped, it does not count.
GrabAFruitTask
Instruction. Pick up a fruit
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- A fruit must be held in the gripper and lifted so that all of it is clear above the table top, still over the table; any one counts.
- The task completes while it is held: once set down or dropped, it does not count.
GreenSpoonsInPotTask
Instruction. Put the green spoons in the pot
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- The green spoons must end up inside the pot.
- Let go of them there: the task is not complete while the gripper still touches any of them.
HammersInLeftBinTask
Instruction. Put the red hammer and black hammer in the left bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- Both the red hammer and the black hammer must end up inside the left bin.
- Let go of each of them: the task is not complete while the gripper still touches either one.
JugsOnShelfTask
Instruction. Put all the jugs on the shelf
Native action limit. 1800 (120 s at 15 Hz).
Completion contract.
- Both plastic jugs must end up on the storage shelf, inside its frame.
- Let go of each of them: the task is not complete while the gripper still touches either one.
KeyboardOutOfBinTask
Instruction. Take the keyboard out of the bin and put it on the table
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The keyboard must end up out of the grey bin, resting directly on the table.
- Let go of the keyboard: the task is not complete while any part of the gripper still touches it.
LargerObjectRaisinBoxInBinTask
Instruction. Place the larger object in the grey bin.
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The larger object must end up inside the grey bin.
- Let go of it there: the task is not complete while any part of the gripper still touches it.
MarkerInMugTask
Instruction. Put the whiteboard marker in the mug
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The whiteboard marker must end up inside the mug.
- Let go of the whiteboard marker there: the task is not complete while any part of the gripper still touches it.
MouseOnKeyboardTask
Instruction. Put the computer mouse on the keyboard
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The computer mouse must end up resting on the keyboard, supported by the keyboard itself with its center over it.
- Let go of the computer mouse there: the task is not complete while any part of the gripper still touches it.
MoveBananaToBagelPlateTask
Instruction. Move the bananas to the bagel plate
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- Both bananas must end up resting on the bagel plate, each supported by the bagel plate itself with its center over it.
- Let go of each of them: the task is not complete while the gripper still touches either one.
MustardAboveRaisinTask
Instruction. Place the mustard on the raisin box.
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The mustard bottle must end up resting on the raisin box, supported by the raisin box itself with its center over it.
- Let go of the mustard bottle there: the task is not complete while any part of the gripper still touches it.
MustardInLeftBinTask
Instruction. Put the mustard in the left bin
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The mustard bottle must end up inside the left grey bin.
- Let go of the mustard bottle there: the task is not complete while any part of the gripper still touches it.
MustardInRightBinTask
Instruction. Put the mustard in the right bin
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The mustard bottle must end up inside the right grey bin.
- Let go of the mustard bottle there: the task is not complete while any part of the gripper still touches it.
NonHammerToolsInRightBinTask
Instruction. Put the non-hammer tools in the right bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- The non-hammer tools must end up inside the right bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
OneBottleInSquarePailTask
Instruction. Put any white plastic bottle in the square pail
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- One of the white plastic bottles must end up inside the square pail; one of them is enough.
- Let go of it there: an object the gripper still touches does not count.
OneBottleOnShelfTask
Instruction. Put any white plastic bottle on the shelf
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- One of the white plastic bottles must end up on the storage shelf, inside its frame; one of them is enough.
- Let go of it there: an object the gripper still touches does not count.
PhoneOrRemoteInBinTask
Instruction. Put the phone or the remote in the grey bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- Either the phone or the remote control must end up inside the grey bin; one of them is enough.
- Let go of it there: an object the gripper still touches does not count.
PickDrillTask
Instruction. Pick up the cordless drill.
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The cordless drill must be held in the gripper and lifted so that all of it is clear above the table top, still over the table.
- The task completes while it is held: once set down or dropped, it does not count.
PickGlassesTask
Instruction. Pick up the eye glasses
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The eyeglasses must be held in the gripper and lifted so that all of them are clear above the table top, still over the table.
- The task completes while they are held: once set down or dropped, they do not count.
PickOrangeObjectTask
Instruction. Pick up the orange measuring cup
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The orange measuring cups must be held in the gripper and lifted so that all of them are clear above the table top, still over the table.
- The task completes while they are held: once set down or dropped, they do not count.
PickUpBluePitcherTask
Instruction. Pick up the large blue pitcher
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The blue pitcher must be held in the gripper and lifted so that all of it is clear above the table top, still over the table.
- The task completes while it is held: once set down or dropped, it does not count.
PickUpGreenObjectTask
Instruction. Pick up the green vegetable block
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The green frozen vegetable box must be held in the gripper and lifted so that all of it is clear above the table top, still over the table.
- The task completes while it is held: once set down or dropped, it does not count.
PinkSpoonInPotTask
Instruction. Put the pink spaghetti spoon in the pot
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The pink spaghetti spoon must end up inside the pot.
- Let go of the pink spaghetti spoon there: the task is not complete while any part of the gripper still touches it.
PlasticBottlesInSquarePailTask
Instruction. Put all the small plastic bottles in the square pail
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- All the small plastic bottles must end up inside the square pail.
- Let go of them there: the task is not complete while the gripper still touches any of them.
PutBowlOnShelfTopTask
Instruction. Put the serving bowl anywhere on the shelf in front of you
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The serving bowl must end up resting on the shelf, supported by the shelf itself with its center over it.
- Let go of the serving bowl there: the task is not complete while any part of the gripper still touches it.
PutMugsOnShelfTask
Instruction. Put the two mugs on the shelf
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- Both the blue-patterned mug and the white mug must end up resting on the shelf, each supported by the shelf itself with its center over it.
- Let go of each of them: the task is not complete while the gripper still touches either one.
PutTwoMugsOnShelfTask
Instruction. Put two (2) mugs on the wire shelf
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- Exactly two of these must be on the wire shelf at the end, each touching it: the blue-patterned mug, the white mug and the red mug; three or more there does not complete the task.
- Let go of them there: an object the gripper still touches does not count.
RecycleCartonTask
Instruction. Put the recyclable cartons in the grey bin
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- The recyclable cartons must end up inside the bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
RecycleCartonsOnBoxTask
Instruction. Put the cartons that can be recycled on the box
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- The cartons that can be recycled must end up on top of the cardboard box, over it.
- Let go of them there: the task is not complete while the gripper still touches any of them.
RecycleCartonsVerticalCrateTask
Instruction. Put the cartons that can be recycled in the vertical crate
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- The cartons that can be recycled must end up inside the vertical crate.
- Let go of them there: the task is not complete while the gripper still touches any of them.
RedDishesInBinTask
Instruction. Put the red dishware in the grey bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The red dishware must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
RedItemsInBinTask
Instruction. Put all the red things in the grey bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- All the red things must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
ReorientAllMugsTask
Instruction. Reorient all the mugs upright so that the opening is facing upwards.
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- Every one of these must end up standing upright, each with its opening facing up: the red mug, the blue-patterned mug and both white mugs.
- Let go of each of them: the task is not complete while the gripper still touches any of them.
ReorientJugTask
Instruction. Stand the jug upright
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The plastic jug must end up standing upright on its base.
- Let go of the plastic jug: the task is not complete while any part of the gripper still touches it.
ReorientRedMugTask
Instruction. Put the red mug upright so that the opening is facing upwards.
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The red mug must end up standing upright, with its opening facing up.
- Let go of the red mug: the task is not complete while any part of the gripper still touches it.
ReorientWhiteMugsTask
Instruction. Make sure all the white mugs are upright so that the opening is facing upwards.
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- All the white mugs must end up standing upright, each with its opening facing up.
- Let go of them: the task is not complete while the gripper still touches any of them.
RubiksCubeAndBananaTask
Instruction. Put the cube and the banana in the bowl
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- Both the cube and the banana must end up inside the bowl, each touching it.
- Let go of each of them: the task is not complete while the gripper still touches either one.
RubiksCubeBehindBowlTask
Instruction. Put the rubiks cube behind the bowl
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The Rubik's cube must end up behind the bowl, on its far side from the robot, rather than diagonally beside it, resting on the table.
- Let go of the Rubik's cube: the task is not complete while any part of the gripper still touches it.
RubiksCubeInFrontOfBowlTask
Instruction. Put the rubiks cube in front of the bowl
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The Rubik's cube must end up in front of the bowl, on the robot's side of it, rather than diagonally beside it.
- Let go of the Rubik's cube: the task is not complete while any part of the gripper still touches it.
RubiksCubeLeftOfBowlTask
Instruction. Put the rubiks cube to the left of the bowl
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The Rubik's cube must end up to the left of the bowl as seen from the robot, rather than diagonally beside it.
- Let go of the Rubik's cube: the task is not complete while any part of the gripper still touches it.
RubiksCubeOrBananaTask
Instruction. Put the cube or the banana in the bowl
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- Either the cube or the banana must end up inside the bowl, touching it; one of them is enough.
- Let go of it there: an object the gripper still touches does not count.
RubiksCubeRightOfBowlTask
Instruction. Put the rubiks cube to the right of the bowl
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The Rubik's cube must end up to the right of the bowl as seen from the robot, rather than diagonally beside it.
- Let go of the Rubik's cube: the task is not complete while any part of the gripper still touches it.
RubiksCubeTask
Instruction. Put the cube in the bowl
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The cube must end up inside the bowl and touching it.
- Let go of the cube there: the task is not complete while any part of the gripper still touches it.
RubiksCubeThenBananaTask
Instruction. Put the cube then the banana in the bowl
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- Both the cube and the banana must end up inside the bowl, each touching it.
- The cube must come to rest in the bowl before the banana does: the order is fixed the first time each of them rests there, released, and taking one out again does not undo it.
- Let go of each of them: the task is not complete while the gripper still touches either one.
RubiksCubesInBinTask
Instruction. Sort all rubiks cubes into the bin
Native action limit. 1800 (120 s at 15 Hz).
Completion contract.
- All three Rubik's cubes must end up inside the grey bin.
- Let go of each of them: the task is not complete while the gripper still touches any of them.
SauceBottlesCrateTask
Instruction. Put the red bbq sauce bottle in the crate
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The BBQ sauce bottle must end up inside the purple crate.
- Let go of the BBQ sauce bottle there: the task is not complete while any part of the gripper still touches it.
SmallPumpkinInBinTask
Instruction. Put the small pumpkin in the bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The small pumpkin must end up inside the bin.
- Let go of the small pumpkin there: the task is not complete while any part of the gripper still touches it.
SmallerObjectButterInBinTask
Instruction. Place the smaller object in the grey bin.
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The smaller object must end up inside the grey bin.
- Let go of it there: the task is not complete while any part of the gripper still touches it.
SmartphoneInBinTask
Instruction. Put the smartphone in the grey bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The smartphone must end up inside the grey bin.
- Let go of the smartphone there: the task is not complete while any part of the gripper still touches it.
SpoonInMugTask
Instruction. Put the metal spoon that's in the wooden bowl in the mug
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The metal spoon must end up inside the mug.
- Let go of the metal spoon there: the task is not complete while any part of the gripper still touches it.
SpoonsInPotTask
Instruction. Put all of the serving spoons with no holes in the pot
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- All of the serving spoons with no holes must end up inside the pot.
- Let go of them there: the task is not complete while the gripper still touches any of them.
Stack3RubiksCubeTask
Instruction. Stack the rubiks cubes in a tower
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- All three Rubik's cubes must form a single tower, each one on top of another and touching it, in any order.
StackWhiteMugsTask
Instruction. Stack the white mugs on top of each other.
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The white mugs must end up stacked on top of each other, each touching the one below it, in any order.
StackYellowOnRedTask
Instruction. Stack the yellow block on the red block
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The yellow block must end up on top of the red block, touching it.
TakeMeasuringSpoonOutTask
Instruction. Take the white colored measuring spoon out of the red bowl and put it on the table.
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The measuring spoon that starts in the red bowl must end up out of the bowl, on the table.
- Let go of it: the task is not complete while any part of the gripper still touches it.
TakeMugsOffOfShelfTask
Instruction. Take the mugs off the shelf
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- Both the blue-patterned mug and the white mug must end up off the shelf, resting directly on the table.
- Let go of each of them: the task is not complete while the gripper still touches either one.
TakeSpatulaOffShelfTask
Instruction. Take the spatula off the shelf and put it on the table
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The wooden spatula must end up off the wire shelf, resting directly on the table.
- Let go of the wooden spatula: the task is not complete while any part of the gripper still touches it.
ThrowAwayAppleTask
Instruction. Throw away the apple
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The apple must end up inside the green pail.
- Let go of the apple there: the task is not complete while any part of the gripper still touches it.
ThrowAwaySnacksTask
Instruction. Put away the snacks in the bin
Native action limit. 1800 (120 s at 15 Hz).
Completion contract.
- The snacks must end up inside the green pail.
- Let go of them there: the task is not complete while the gripper still touches any of them.
ToolOrganizationBothTask
Instruction. Put hammers in the right bin and do not touch anything else
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- Both the red hammer and the black hammer must end up inside the right bin.
- Let go of each of them: the task is not complete while the gripper still touches either one.
- Do not move any other object.
ToolOrganizationTask
Instruction. Put the red hammer and black hammer in the left bin
Native action limit. 2700 (180 s at 15 Hz).
Completion contract.
- Both the red hammer and the black hammer must end up inside the left bin.
- Let go of each of them: the task is not complete while the gripper still touches either one.
ToolsPickingAllHammersTask
Instruction. Take out all the hammers and put them on the table
Native action limit. 3600 (240 s at 15 Hz).
Completion contract.
- Every one of these must end up out of the left bin, resting directly on the table: the black hammer, the blue hammer, the red hammer and the wooden hammer.
- Let go of each of them: the task is not complete while the gripper still touches any of them.
ToolsPickingDrillTask
Instruction. Select the cordless drill and put it on the table
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The cordless drill must end up resting directly on the table, out of the bins.
- Let go of it: the task is not complete while any part of the gripper still touches it.
ToolsPickingHammerTask
Instruction. Select the blue hammer and put it on the table
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The blue hammer must end up out of the left bin, resting directly on the table.
- Let go of the blue hammer: the task is not complete while any part of the gripper still touches it.
ToyInBinTask
Instruction. Put the lizard away in the bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The lizard figurine must end up inside the grey bin.
- Let go of the lizard figurine there: the task is not complete while any part of the gripper still touches it.
UnstackRubiksCubeTask
Instruction. Unstack the rubiks cube tower
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- All three Rubik's cubes of the tower must end up resting directly on the table, none of them on another cube and none in the grey bin.
- Let go of each of them: the task is not complete while the gripper still touches any of them.
UtensilsInMugTask
Instruction. Put the fork and spoon in the ceramicmug
Native action limit. 1350 (90 s at 15 Hz).
Completion contract.
- Both the fork and the metal spoon must end up inside the mug.
- Let go of each of them: the task is not complete while the gripper still touches either one.
WhiteMugInCenterOfTableTask
Instruction. Put the white mug in the center of the table.
Native action limit. 450 (30 s at 15 Hz).
Completion contract.
- The white mug must end up at the center of the table, touching the table.
- Let go of the white mug: the task is not complete while any part of the gripper still touches it.
WhiteMugsInBinTask
Instruction. Clean up the white mugs
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The white mugs must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
WoodSpatulaToBowlTask
Instruction. Put the wooden spatula in the bowl
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- The wooden spatula must end up inside the wooden bowl and touching it.
- Let go of the wooden spatula there: the task is not complete while any part of the gripper still touches it.
YellowAndWhiteObjectsInBinTask
Instruction. Put all white objects and yellow objects in the grey bin
Native action limit. 900 (60 s at 15 Hz).
Completion contract.
- All white objects and yellow objects must end up inside the grey bin.
- Let go of them there: the task is not complete while the gripper still touches any of them.
YogurtInBowlTask
Instruction. Put the small red yogurt in the red bowl
Native action limit. 600 (40 s at 15 Hz).
Completion contract.
- The yogurt cup must end up inside the red bowl.
- Let go of the yogurt cup there: the task is not complete while any part of the gripper still touches it.