Robots and tasks

RoboLab tasks

120 admitted RoboLab tasks on the DROID Franka with a Robotiq 2F-85 gripper. For each: the upstream default instruction, the native-action limit (the upstream episode length at 15 Hz) and the public completion contract ORA gives the model. Success is decided only by RoboLab's own success termination; the contract restates it and never replaces it. Generated from ora/environment/benchmarks/robolab.py (TASKS) and ora/policy/environments/robolab/task-contracts/registry-v1.json.

Task Instruction Native action limit Contract
AnimalsInBinTask Put the lizards in the bin 1350 reviewed
AppleAndYogurtInBowlTask Put the apple and yogurt in the bowl 1800 reviewed
BBQSauceInBinTask Put the red BBQ sauce bottles in the grey bin 1350 reviewed
BagelsOnPlateTask Put the bagels on the plate 900 reviewed
BananaInBowlTask Pick up the banana and place it in the bowl 750 reviewed
BananaOnPlateTask Pick up the banana and put it on the plate 600 reviewed
BananaThenRubiksCubeTask put the banana then the cube in the bowl 900 reviewed
BananasInBinOneMoreTask Put one (1) more bananas in the grey bin. 900 reviewed
BananasInBinThreeTotalTask Make sure there are 3 (three) bananas in the grey bin. 900 reviewed
BananasInCrateTask Put 2 bananas in the crate 900 reviewed
BananasOutOfBinTask Take the bananas out 1350 reviewed
BigPumpkinInBinTask Put the bigger pumpkin in the bin 900 reviewed
BlackItemsInBinTask Put the black items in the grey bin 1800 reviewed
BlockStackingOrderAgnosticTask Stack the blocks into a tower 1350 reviewed
BlockStackingSpecifiedOrderTask Stack the blocks in the order from bottom to top: red, blue, green, yellow 1350 reviewed
BlocksInBinTask Sort all colored blocks into the bin 2250 reviewed
BowlInBinTask put the bowl in the grey bin 900 reviewed
BowlStackingLeftOnRightTask Stack the left bowl on the right bowl 300 reviewed
BowlStackingRightOnLeftTask Stack the right bowl on the left bowl 300 reviewed
ButterAboveRaisinTask Pick up the butter box and place it on top of the raisin box 600 reviewed
CannedFoodInBinTask Put the canned food in the grey bin 900 reviewed
ClampInRightBinTask Put the spring clamp in the right bin 900 reviewed
CleanUpToysTask Clean up all the smaller toys and leave the birdhouse on the table 4500 reviewed
ClearOrganicObjectsTask Clear away the organic objects 3600 reviewed
ClutterPlasticTask Put all plastic bottles away in the bin 2700 reviewed
ClutterPumpkinTask Put all the pumpkins away in the bin 1350 reviewed
CoffeePotInBinTask Put the coffee pot in the grey bin 900 reviewed
CondimentsInBinTask Sort the sauce condiments into the grey bin 2700 reviewed
CookingClearPlateTask Put the two measuring cups outside of the plate 2700 reviewed
CookingPickPastaToolTask Move the pink tool from this utensil container to the other utensil holder 900 reviewed
CubesAndBlocksInBinTask Put all the cubes and blocks in the bin 3600 reviewed
DishesInBinTask Put the dishware in the grey bin 2700 reviewed
ElectronicsInBinTask Put the electronic devices in the grey bin 2700 reviewed
FoodPacking1BoxesTask Pack boxed foods into the bin 900 reviewed
FoodPacking1CansTask Pack canned foods into the bin 900 reviewed
FoodPacking2BoxesTask Pack boxed foods into the bin 2700 reviewed
FoodPacking2CansTask Pack canned foods into the bin 2700 reviewed
FoodPacking3BoxesTask Pack boxed foods into the bin 3600 reviewed
FoodPacking3CansTask Pack canned foods into the bin 3600 reviewed
FoodPackingByColorTask Pack yellow objects in right container and blue object in the left container 1800 reviewed
FruitsGreenLimesOnPlateTask Put all the green fruit on the plate 1350 reviewed
FruitsMovingOrangeOrLimeTask Move an orange or a lime to the wood bowl 900 reviewed
FruitsMovingTask Move an orange to the white bowl 900 reviewed
FruitsOnPlate3Task Put three (3) fruits on the plate 3000 reviewed
FruitsOnPlateTask Put all the fruits on the plate 4500 reviewed
FruitsOnionTask Put the onion in the wood bowl 900 reviewed
FruitsOnionToPlateTask Put the onion on the plate 900 reviewed
FruitsOrangesOnPlateTask Put all the oranges on the plate 1350 reviewed
GrabABagelTask Grab a bagel 450 reviewed
GrabAFruitTask Pick up a fruit 450 reviewed
GreenSpoonsInPotTask Put the green spoons in the pot 2700 reviewed
HammersInLeftBinTask Put the red hammer and black hammer in the left bin 2700 reviewed
JugsOnShelfTask Put all the jugs on the shelf 1800 reviewed
KeyboardOutOfBinTask Take the keyboard out of the bin and put it on the table 900 reviewed
LargerObjectRaisinBoxInBinTask Place the larger object in the grey bin. 450 reviewed
MarkerInMugTask Put the whiteboard marker in the mug 600 reviewed
MouseOnKeyboardTask Put the computer mouse on the keyboard 900 reviewed
MoveBananaToBagelPlateTask Move the bananas to the bagel plate 1350 reviewed
MustardAboveRaisinTask Place the mustard on the raisin box. 600 reviewed
MustardInLeftBinTask Put the mustard in the left bin 450 reviewed
MustardInRightBinTask Put the mustard in the right bin 450 reviewed
NonHammerToolsInRightBinTask Put the non-hammer tools in the right bin 2700 reviewed
OneBottleInSquarePailTask Put any white plastic bottle in the square pail 900 reviewed
OneBottleOnShelfTask Put any white plastic bottle on the shelf 900 reviewed
PhoneOrRemoteInBinTask Put the phone or the remote in the grey bin 900 reviewed
PickDrillTask Pick up the cordless drill. 600 reviewed
PickGlassesTask Pick up the eye glasses 450 reviewed
PickOrangeObjectTask Pick up the orange measuring cup 900 reviewed
PickUpBluePitcherTask Pick up the large blue pitcher 450 reviewed
PickUpGreenObjectTask Pick up the green vegetable block 450 reviewed
PinkSpoonInPotTask Put the pink spaghetti spoon in the pot 900 reviewed
PlasticBottlesInSquarePailTask Put all the small plastic bottles in the square pail 2700 reviewed
PutBowlOnShelfTopTask Put the serving bowl anywhere on the shelf in front of you 900 reviewed
PutMugsOnShelfTask Put the two mugs on the shelf 2700 reviewed
PutTwoMugsOnShelfTask Put two (2) mugs on the wire shelf 2700 reviewed
RecycleCartonTask Put the recyclable cartons in the grey bin 1350 reviewed
RecycleCartonsOnBoxTask Put the cartons that can be recycled on the box 1350 reviewed
RecycleCartonsVerticalCrateTask Put the cartons that can be recycled in the vertical crate 1350 reviewed
RedDishesInBinTask Put the red dishware in the grey bin 900 reviewed
RedItemsInBinTask Put all the red things in the grey bin 900 reviewed
ReorientAllMugsTask Reorient all the mugs upright so that the opening is facing upwards. 1350 reviewed
ReorientJugTask Stand the jug upright 900 reviewed
ReorientRedMugTask Put the red mug upright so that the opening is facing upwards. 900 reviewed
ReorientWhiteMugsTask Make sure all the white mugs are upright so that the opening is facing upwards. 900 reviewed
RubiksCubeAndBananaTask Put the cube and the banana in the bowl 900 reviewed
RubiksCubeBehindBowlTask Put the rubiks cube behind the bowl 450 reviewed
RubiksCubeInFrontOfBowlTask Put the rubiks cube in front of the bowl 450 reviewed
RubiksCubeLeftOfBowlTask Put the rubiks cube to the left of the bowl 450 reviewed
RubiksCubeOrBananaTask Put the cube or the banana in the bowl 450 reviewed
RubiksCubeRightOfBowlTask Put the rubiks cube to the right of the bowl 450 reviewed
RubiksCubeTask Put the cube in the bowl 600 reviewed
RubiksCubeThenBananaTask Put the cube then the banana in the bowl 900 reviewed
RubiksCubesInBinTask Sort all rubiks cubes into the bin 1800 reviewed
SauceBottlesCrateTask Put the red bbq sauce bottle in the crate 600 reviewed
SmallPumpkinInBinTask Put the small pumpkin in the bin 900 reviewed
SmallerObjectButterInBinTask Place the smaller object in the grey bin. 450 reviewed
SmartphoneInBinTask Put the smartphone in the grey bin 900 reviewed
SpoonInMugTask Put the metal spoon that's in the wooden bowl in the mug 900 reviewed
SpoonsInPotTask Put all of the serving spoons with no holes in the pot 2700 reviewed
Stack3RubiksCubeTask Stack the rubiks cubes in a tower 900 reviewed
StackWhiteMugsTask Stack the white mugs on top of each other. 900 reviewed
StackYellowOnRedTask Stack the yellow block on the red block 900 reviewed
TakeMeasuringSpoonOutTask Take the white colored measuring spoon out of the red bowl and put it on the table. 600 reviewed
TakeMugsOffOfShelfTask Take the mugs off the shelf 2700 reviewed
TakeSpatulaOffShelfTask Take the spatula off the shelf and put it on the table 900 reviewed
ThrowAwayAppleTask Throw away the apple 900 reviewed
ThrowAwaySnacksTask Put away the snacks in the bin 1800 reviewed
ToolOrganizationBothTask Put hammers in the right bin and do not touch anything else 2700 reviewed
ToolOrganizationTask Put the red hammer and black hammer in the left bin 2700 reviewed
ToolsPickingAllHammersTask Take out all the hammers and put them on the table 3600 reviewed
ToolsPickingDrillTask Select the cordless drill and put it on the table 900 reviewed
ToolsPickingHammerTask Select the blue hammer and put it on the table 900 reviewed
ToyInBinTask Put the lizard away in the bin 900 reviewed
UnstackRubiksCubeTask Unstack the rubiks cube tower 1350 reviewed
UtensilsInMugTask Put the fork and spoon in the ceramicmug 1350 reviewed
WhiteMugInCenterOfTableTask Put the white mug in the center of the table. 450 reviewed
WhiteMugsInBinTask Clean up the white mugs 900 reviewed
WoodSpatulaToBowlTask Put the wooden spatula in the bowl 900 reviewed
YellowAndWhiteObjectsInBinTask Put all white objects and yellow objects in the grey bin 900 reviewed
YogurtInBowlTask Put the small red yogurt in the red bowl 600 reviewed

AnimalsInBinTask

Instruction. Put the lizards in the bin

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • Both lizard figurines must end up inside the grey bin.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

AppleAndYogurtInBowlTask

Instruction. Put the apple and yogurt in the bowl

Native action limit. 1800 (120 s at 15 Hz).

Completion contract.

  • Both the apple and the yogurt cup must end up inside the wooden bowl.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

BBQSauceInBinTask

Instruction. Put the red BBQ sauce bottles in the grey bin

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • The red BBQ sauce bottles must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

BagelsOnPlateTask

Instruction. Put the bagels on the plate

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • Both bagels must end up resting on the plate, each supported by the plate itself with its center over it.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

BananaInBowlTask

Instruction. Pick up the banana and place it in the bowl

Native action limit. 750 (50 s at 15 Hz).

Completion contract.

  • The banana must end up inside the bowl and touching it.
  • Let go of the banana there: the task is not complete while any part of the gripper still touches it.

BananaOnPlateTask

Instruction. Pick up the banana and put it on the plate

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The banana must end up resting on the plate, supported by the plate itself with its center over it.
  • Let go of the banana there: the task is not complete while any part of the gripper still touches it.

BananaThenRubiksCubeTask

Instruction. put the banana then the cube in the bowl

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • Both the banana and the cube must end up inside the bowl, each touching it.
  • The banana must come to rest in the bowl before the cube does: the order is fixed the first time each of them rests there, released, and taking one out again does not undo it.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

BananasInBinOneMoreTask

Instruction. Put one (1) more bananas in the grey bin.

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • Of the bananas that start on the table, exactly one must end up inside the grey bin; a second one inside the bin as well does not complete the task.
  • Let go of it there: a banana the gripper still touches does not count.
  • Leave the bananas that are already in the bin there.

BananasInBinThreeTotalTask

Instruction. Make sure there are 3 (three) bananas in the grey bin.

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • Of the bananas that start on the table, exactly one must end up inside the grey bin, so that three are in it; a second one from the table does not complete the task.
  • Let go of it there: a banana the gripper still touches does not count.
  • Leave the bananas that are already in the bin there.

BananasInCrateTask

Instruction. Put 2 bananas in the crate

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • Exactly two bananas must be inside the purple crate at the end, counting the one that starts there; a third banana inside does not complete the task.
  • Let go of them there: a banana the gripper still touches does not count.

BananasOutOfBinTask

Instruction. Take the bananas out

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • Both bananas that start in the grey bin must end up out of it.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

BigPumpkinInBinTask

Instruction. Put the bigger pumpkin in the bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The bigger pumpkin must end up inside the bin.
  • Let go of it there: the task is not complete while any part of the gripper still touches it.

BlackItemsInBinTask

Instruction. Put the black items in the grey bin

Native action limit. 1800 (120 s at 15 Hz).

Completion contract.

  • The black items must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

BlockStackingOrderAgnosticTask

Instruction. Stack the blocks into a tower

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • The red block, the blue block, the green block and the yellow block must form a single tower, each one on top of another and touching it, in any order.

BlockStackingSpecifiedOrderTask

Instruction. Stack the blocks in the order from bottom to top: red, blue, green, yellow

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • The blocks must form one tower in this order from bottom to top: the red block, the blue block, the green block, then the yellow block; each one must sit on top of the one below it, touching it.

BlocksInBinTask

Instruction. Sort all colored blocks into the bin

Native action limit. 2250 (150 s at 15 Hz).

Completion contract.

  • All the colored blocks must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

BowlInBinTask

Instruction. put the bowl in the grey bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The bowl must end up inside the grey bin.
  • Let go of the bowl there: the task is not complete while any part of the gripper still touches it.

BowlStackingLeftOnRightTask

Instruction. Stack the left bowl on the right bowl

Native action limit. 300 (20 s at 15 Hz).

Completion contract.

  • The left bowl must end up inside the right bowl and touching it.
  • Let go of the left bowl there: the task is not complete while any part of the gripper still touches it.

BowlStackingRightOnLeftTask

Instruction. Stack the right bowl on the left bowl

Native action limit. 300 (20 s at 15 Hz).

Completion contract.

  • The right bowl must end up inside the left bowl and touching it.
  • Let go of the right bowl there: the task is not complete while any part of the gripper still touches it.

ButterAboveRaisinTask

Instruction. Pick up the butter box and place it on top of the raisin box

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The butter box must end up resting on the raisin box, supported by the raisin box itself with its center over it.
  • Let go of the butter box there: the task is not complete while any part of the gripper still touches it.

CannedFoodInBinTask

Instruction. Put the canned food in the grey bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The canned food must end up inside the grey bin.
  • Let go of it there: the task is not complete while any part of the gripper still touches it.

ClampInRightBinTask

Instruction. Put the spring clamp in the right bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The spring clamp must end up inside the right bin.
  • Let go of the spring clamp there: the task is not complete while any part of the gripper still touches it.

CleanUpToysTask

Instruction. Clean up all the smaller toys and leave the birdhouse on the table

Native action limit. 4500 (300 s at 15 Hz).

Completion contract.

  • All the smaller toys must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.
  • Leave the birdhouse on the table.

ClearOrganicObjectsTask

Instruction. Clear away the organic objects

Native action limit. 3600 (240 s at 15 Hz).

Completion contract.

  • The organic objects must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

ClutterPlasticTask

Instruction. Put all plastic bottles away in the bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • All the plastic bottles must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

ClutterPumpkinTask

Instruction. Put all the pumpkins away in the bin

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • Both the large pumpkin and the small pumpkin must end up inside the bin.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

CoffeePotInBinTask

Instruction. Put the coffee pot in the grey bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The coffee pot must end up inside the grey bin.
  • Let go of the coffee pot there: the task is not complete while any part of the gripper still touches it.

CondimentsInBinTask

Instruction. Sort the sauce condiments into the grey bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • The sauce condiments must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

CookingClearPlateTask

Instruction. Put the two measuring cups outside of the plate

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • Both the teal measuring spoons and the orange measuring cups must end up off the clay plate.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

CookingPickPastaToolTask

Instruction. Move the pink tool from this utensil container to the other utensil holder

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The pink tool must end up inside the other utensil holder (not the one it starts in) and touching it.
  • Let go of it there: the task is not complete while any part of the gripper still touches it.

CubesAndBlocksInBinTask

Instruction. Put all the cubes and blocks in the bin

Native action limit. 3600 (240 s at 15 Hz).

Completion contract.

  • Every one of these must end up inside the grey bin: all three Rubik's cubes, the yellow block, the red block, the green block and the blue block.
  • Let go of each of them: the task is not complete while the gripper still touches any of them.

DishesInBinTask

Instruction. Put the dishware in the grey bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • The dishware must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

ElectronicsInBinTask

Instruction. Put the electronic devices in the grey bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • The electronic devices must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FoodPacking1BoxesTask

Instruction. Pack boxed foods into the bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The boxed foods must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FoodPacking1CansTask

Instruction. Pack canned foods into the bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The canned foods must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FoodPacking2BoxesTask

Instruction. Pack boxed foods into the bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • The boxed foods must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FoodPacking2CansTask

Instruction. Pack canned foods into the bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • The canned foods must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FoodPacking3BoxesTask

Instruction. Pack boxed foods into the bin

Native action limit. 3600 (240 s at 15 Hz).

Completion contract.

  • The boxed foods must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FoodPacking3CansTask

Instruction. Pack canned foods into the bin

Native action limit. 3600 (240 s at 15 Hz).

Completion contract.

  • The canned foods must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FoodPackingByColorTask

Instruction. Pack yellow objects in right container and blue object in the left container

Native action limit. 1800 (120 s at 15 Hz).

Completion contract.

  • The blue object must end up inside the bin on the left, and the yellow objects inside the bin on the right.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FruitsGreenLimesOnPlateTask

Instruction. Put all the green fruit on the plate

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • All the green fruit must end up resting on the clay plate, each supported by the clay plate itself with its center over it.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FruitsMovingOrangeOrLimeTask

Instruction. Move an orange or a lime to the wood bowl

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • One of the oranges or limes must end up inside the wooden bowl, touching it; one of them is enough.
  • Let go of it there: an object the gripper still touches does not count.

FruitsMovingTask

Instruction. Move an orange to the white bowl

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • One of the oranges must end up inside the white bowl, touching it; one of them is enough.
  • Let go of it there: an object the gripper still touches does not count.

FruitsOnPlate3Task

Instruction. Put three (3) fruits on the plate

Native action limit. 3000 (200 s at 15 Hz).

Completion contract.

  • Exactly three fruits must end up resting on the clay plate, each supported by the plate itself with its center over it, counting any fruit that starts there; a fourth fruit on the plate does not complete the task.
  • Let go of them there: a fruit the gripper still touches does not count.

FruitsOnPlateTask

Instruction. Put all the fruits on the plate

Native action limit. 4500 (300 s at 15 Hz).

Completion contract.

  • All the fruits must end up resting on the clay plate, each supported by the clay plate itself with its center over it.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

FruitsOnionTask

Instruction. Put the onion in the wood bowl

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The red onion must end up inside the wooden bowl and touching it.
  • Let go of the red onion there: the task is not complete while any part of the gripper still touches it.

FruitsOnionToPlateTask

Instruction. Put the onion on the plate

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The red onion must end up resting on the clay plate, supported by the clay plate itself with its center over it.
  • Let go of the red onion there: the task is not complete while any part of the gripper still touches it.

FruitsOrangesOnPlateTask

Instruction. Put all the oranges on the plate

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • Both oranges must end up resting on the clay plate, each supported by the clay plate itself with its center over it.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

GrabABagelTask

Instruction. Grab a bagel

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • One bagel must be held in the gripper and lifted so that all of it is clear above the table top, still over the table; any of the three bagels counts.
  • The task completes while it is held: once set down or dropped, it does not count.

GrabAFruitTask

Instruction. Pick up a fruit

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • A fruit must be held in the gripper and lifted so that all of it is clear above the table top, still over the table; any one counts.
  • The task completes while it is held: once set down or dropped, it does not count.

GreenSpoonsInPotTask

Instruction. Put the green spoons in the pot

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • The green spoons must end up inside the pot.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

HammersInLeftBinTask

Instruction. Put the red hammer and black hammer in the left bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • Both the red hammer and the black hammer must end up inside the left bin.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

JugsOnShelfTask

Instruction. Put all the jugs on the shelf

Native action limit. 1800 (120 s at 15 Hz).

Completion contract.

  • Both plastic jugs must end up on the storage shelf, inside its frame.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

KeyboardOutOfBinTask

Instruction. Take the keyboard out of the bin and put it on the table

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The keyboard must end up out of the grey bin, resting directly on the table.
  • Let go of the keyboard: the task is not complete while any part of the gripper still touches it.

LargerObjectRaisinBoxInBinTask

Instruction. Place the larger object in the grey bin.

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The larger object must end up inside the grey bin.
  • Let go of it there: the task is not complete while any part of the gripper still touches it.

MarkerInMugTask

Instruction. Put the whiteboard marker in the mug

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The whiteboard marker must end up inside the mug.
  • Let go of the whiteboard marker there: the task is not complete while any part of the gripper still touches it.

MouseOnKeyboardTask

Instruction. Put the computer mouse on the keyboard

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The computer mouse must end up resting on the keyboard, supported by the keyboard itself with its center over it.
  • Let go of the computer mouse there: the task is not complete while any part of the gripper still touches it.

MoveBananaToBagelPlateTask

Instruction. Move the bananas to the bagel plate

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • Both bananas must end up resting on the bagel plate, each supported by the bagel plate itself with its center over it.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

MustardAboveRaisinTask

Instruction. Place the mustard on the raisin box.

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The mustard bottle must end up resting on the raisin box, supported by the raisin box itself with its center over it.
  • Let go of the mustard bottle there: the task is not complete while any part of the gripper still touches it.

MustardInLeftBinTask

Instruction. Put the mustard in the left bin

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The mustard bottle must end up inside the left grey bin.
  • Let go of the mustard bottle there: the task is not complete while any part of the gripper still touches it.

MustardInRightBinTask

Instruction. Put the mustard in the right bin

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The mustard bottle must end up inside the right grey bin.
  • Let go of the mustard bottle there: the task is not complete while any part of the gripper still touches it.

NonHammerToolsInRightBinTask

Instruction. Put the non-hammer tools in the right bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • The non-hammer tools must end up inside the right bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

OneBottleInSquarePailTask

Instruction. Put any white plastic bottle in the square pail

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • One of the white plastic bottles must end up inside the square pail; one of them is enough.
  • Let go of it there: an object the gripper still touches does not count.

OneBottleOnShelfTask

Instruction. Put any white plastic bottle on the shelf

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • One of the white plastic bottles must end up on the storage shelf, inside its frame; one of them is enough.
  • Let go of it there: an object the gripper still touches does not count.

PhoneOrRemoteInBinTask

Instruction. Put the phone or the remote in the grey bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • Either the phone or the remote control must end up inside the grey bin; one of them is enough.
  • Let go of it there: an object the gripper still touches does not count.

PickDrillTask

Instruction. Pick up the cordless drill.

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The cordless drill must be held in the gripper and lifted so that all of it is clear above the table top, still over the table.
  • The task completes while it is held: once set down or dropped, it does not count.

PickGlassesTask

Instruction. Pick up the eye glasses

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The eyeglasses must be held in the gripper and lifted so that all of them are clear above the table top, still over the table.
  • The task completes while they are held: once set down or dropped, they do not count.

PickOrangeObjectTask

Instruction. Pick up the orange measuring cup

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The orange measuring cups must be held in the gripper and lifted so that all of them are clear above the table top, still over the table.
  • The task completes while they are held: once set down or dropped, they do not count.

PickUpBluePitcherTask

Instruction. Pick up the large blue pitcher

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The blue pitcher must be held in the gripper and lifted so that all of it is clear above the table top, still over the table.
  • The task completes while it is held: once set down or dropped, it does not count.

PickUpGreenObjectTask

Instruction. Pick up the green vegetable block

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The green frozen vegetable box must be held in the gripper and lifted so that all of it is clear above the table top, still over the table.
  • The task completes while it is held: once set down or dropped, it does not count.

PinkSpoonInPotTask

Instruction. Put the pink spaghetti spoon in the pot

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The pink spaghetti spoon must end up inside the pot.
  • Let go of the pink spaghetti spoon there: the task is not complete while any part of the gripper still touches it.

PlasticBottlesInSquarePailTask

Instruction. Put all the small plastic bottles in the square pail

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • All the small plastic bottles must end up inside the square pail.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

PutBowlOnShelfTopTask

Instruction. Put the serving bowl anywhere on the shelf in front of you

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The serving bowl must end up resting on the shelf, supported by the shelf itself with its center over it.
  • Let go of the serving bowl there: the task is not complete while any part of the gripper still touches it.

PutMugsOnShelfTask

Instruction. Put the two mugs on the shelf

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • Both the blue-patterned mug and the white mug must end up resting on the shelf, each supported by the shelf itself with its center over it.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

PutTwoMugsOnShelfTask

Instruction. Put two (2) mugs on the wire shelf

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • Exactly two of these must be on the wire shelf at the end, each touching it: the blue-patterned mug, the white mug and the red mug; three or more there does not complete the task.
  • Let go of them there: an object the gripper still touches does not count.

RecycleCartonTask

Instruction. Put the recyclable cartons in the grey bin

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • The recyclable cartons must end up inside the bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

RecycleCartonsOnBoxTask

Instruction. Put the cartons that can be recycled on the box

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • The cartons that can be recycled must end up on top of the cardboard box, over it.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

RecycleCartonsVerticalCrateTask

Instruction. Put the cartons that can be recycled in the vertical crate

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • The cartons that can be recycled must end up inside the vertical crate.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

RedDishesInBinTask

Instruction. Put the red dishware in the grey bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The red dishware must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

RedItemsInBinTask

Instruction. Put all the red things in the grey bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • All the red things must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

ReorientAllMugsTask

Instruction. Reorient all the mugs upright so that the opening is facing upwards.

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • Every one of these must end up standing upright, each with its opening facing up: the red mug, the blue-patterned mug and both white mugs.
  • Let go of each of them: the task is not complete while the gripper still touches any of them.

ReorientJugTask

Instruction. Stand the jug upright

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The plastic jug must end up standing upright on its base.
  • Let go of the plastic jug: the task is not complete while any part of the gripper still touches it.

ReorientRedMugTask

Instruction. Put the red mug upright so that the opening is facing upwards.

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The red mug must end up standing upright, with its opening facing up.
  • Let go of the red mug: the task is not complete while any part of the gripper still touches it.

ReorientWhiteMugsTask

Instruction. Make sure all the white mugs are upright so that the opening is facing upwards.

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • All the white mugs must end up standing upright, each with its opening facing up.
  • Let go of them: the task is not complete while the gripper still touches any of them.

RubiksCubeAndBananaTask

Instruction. Put the cube and the banana in the bowl

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • Both the cube and the banana must end up inside the bowl, each touching it.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

RubiksCubeBehindBowlTask

Instruction. Put the rubiks cube behind the bowl

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The Rubik's cube must end up behind the bowl, on its far side from the robot, rather than diagonally beside it, resting on the table.
  • Let go of the Rubik's cube: the task is not complete while any part of the gripper still touches it.

RubiksCubeInFrontOfBowlTask

Instruction. Put the rubiks cube in front of the bowl

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The Rubik's cube must end up in front of the bowl, on the robot's side of it, rather than diagonally beside it.
  • Let go of the Rubik's cube: the task is not complete while any part of the gripper still touches it.

RubiksCubeLeftOfBowlTask

Instruction. Put the rubiks cube to the left of the bowl

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The Rubik's cube must end up to the left of the bowl as seen from the robot, rather than diagonally beside it.
  • Let go of the Rubik's cube: the task is not complete while any part of the gripper still touches it.

RubiksCubeOrBananaTask

Instruction. Put the cube or the banana in the bowl

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • Either the cube or the banana must end up inside the bowl, touching it; one of them is enough.
  • Let go of it there: an object the gripper still touches does not count.

RubiksCubeRightOfBowlTask

Instruction. Put the rubiks cube to the right of the bowl

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The Rubik's cube must end up to the right of the bowl as seen from the robot, rather than diagonally beside it.
  • Let go of the Rubik's cube: the task is not complete while any part of the gripper still touches it.

RubiksCubeTask

Instruction. Put the cube in the bowl

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The cube must end up inside the bowl and touching it.
  • Let go of the cube there: the task is not complete while any part of the gripper still touches it.

RubiksCubeThenBananaTask

Instruction. Put the cube then the banana in the bowl

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • Both the cube and the banana must end up inside the bowl, each touching it.
  • The cube must come to rest in the bowl before the banana does: the order is fixed the first time each of them rests there, released, and taking one out again does not undo it.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

RubiksCubesInBinTask

Instruction. Sort all rubiks cubes into the bin

Native action limit. 1800 (120 s at 15 Hz).

Completion contract.

  • All three Rubik's cubes must end up inside the grey bin.
  • Let go of each of them: the task is not complete while the gripper still touches any of them.

SauceBottlesCrateTask

Instruction. Put the red bbq sauce bottle in the crate

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The BBQ sauce bottle must end up inside the purple crate.
  • Let go of the BBQ sauce bottle there: the task is not complete while any part of the gripper still touches it.

SmallPumpkinInBinTask

Instruction. Put the small pumpkin in the bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The small pumpkin must end up inside the bin.
  • Let go of the small pumpkin there: the task is not complete while any part of the gripper still touches it.

SmallerObjectButterInBinTask

Instruction. Place the smaller object in the grey bin.

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The smaller object must end up inside the grey bin.
  • Let go of it there: the task is not complete while any part of the gripper still touches it.

SmartphoneInBinTask

Instruction. Put the smartphone in the grey bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The smartphone must end up inside the grey bin.
  • Let go of the smartphone there: the task is not complete while any part of the gripper still touches it.

SpoonInMugTask

Instruction. Put the metal spoon that's in the wooden bowl in the mug

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The metal spoon must end up inside the mug.
  • Let go of the metal spoon there: the task is not complete while any part of the gripper still touches it.

SpoonsInPotTask

Instruction. Put all of the serving spoons with no holes in the pot

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • All of the serving spoons with no holes must end up inside the pot.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

Stack3RubiksCubeTask

Instruction. Stack the rubiks cubes in a tower

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • All three Rubik's cubes must form a single tower, each one on top of another and touching it, in any order.

StackWhiteMugsTask

Instruction. Stack the white mugs on top of each other.

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The white mugs must end up stacked on top of each other, each touching the one below it, in any order.

StackYellowOnRedTask

Instruction. Stack the yellow block on the red block

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The yellow block must end up on top of the red block, touching it.

TakeMeasuringSpoonOutTask

Instruction. Take the white colored measuring spoon out of the red bowl and put it on the table.

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The measuring spoon that starts in the red bowl must end up out of the bowl, on the table.
  • Let go of it: the task is not complete while any part of the gripper still touches it.

TakeMugsOffOfShelfTask

Instruction. Take the mugs off the shelf

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • Both the blue-patterned mug and the white mug must end up off the shelf, resting directly on the table.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

TakeSpatulaOffShelfTask

Instruction. Take the spatula off the shelf and put it on the table

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The wooden spatula must end up off the wire shelf, resting directly on the table.
  • Let go of the wooden spatula: the task is not complete while any part of the gripper still touches it.

ThrowAwayAppleTask

Instruction. Throw away the apple

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The apple must end up inside the green pail.
  • Let go of the apple there: the task is not complete while any part of the gripper still touches it.

ThrowAwaySnacksTask

Instruction. Put away the snacks in the bin

Native action limit. 1800 (120 s at 15 Hz).

Completion contract.

  • The snacks must end up inside the green pail.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

ToolOrganizationBothTask

Instruction. Put hammers in the right bin and do not touch anything else

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • Both the red hammer and the black hammer must end up inside the right bin.
  • Let go of each of them: the task is not complete while the gripper still touches either one.
  • Do not move any other object.

ToolOrganizationTask

Instruction. Put the red hammer and black hammer in the left bin

Native action limit. 2700 (180 s at 15 Hz).

Completion contract.

  • Both the red hammer and the black hammer must end up inside the left bin.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

ToolsPickingAllHammersTask

Instruction. Take out all the hammers and put them on the table

Native action limit. 3600 (240 s at 15 Hz).

Completion contract.

  • Every one of these must end up out of the left bin, resting directly on the table: the black hammer, the blue hammer, the red hammer and the wooden hammer.
  • Let go of each of them: the task is not complete while the gripper still touches any of them.

ToolsPickingDrillTask

Instruction. Select the cordless drill and put it on the table

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The cordless drill must end up resting directly on the table, out of the bins.
  • Let go of it: the task is not complete while any part of the gripper still touches it.

ToolsPickingHammerTask

Instruction. Select the blue hammer and put it on the table

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The blue hammer must end up out of the left bin, resting directly on the table.
  • Let go of the blue hammer: the task is not complete while any part of the gripper still touches it.

ToyInBinTask

Instruction. Put the lizard away in the bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The lizard figurine must end up inside the grey bin.
  • Let go of the lizard figurine there: the task is not complete while any part of the gripper still touches it.

UnstackRubiksCubeTask

Instruction. Unstack the rubiks cube tower

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • All three Rubik's cubes of the tower must end up resting directly on the table, none of them on another cube and none in the grey bin.
  • Let go of each of them: the task is not complete while the gripper still touches any of them.

UtensilsInMugTask

Instruction. Put the fork and spoon in the ceramicmug

Native action limit. 1350 (90 s at 15 Hz).

Completion contract.

  • Both the fork and the metal spoon must end up inside the mug.
  • Let go of each of them: the task is not complete while the gripper still touches either one.

WhiteMugInCenterOfTableTask

Instruction. Put the white mug in the center of the table.

Native action limit. 450 (30 s at 15 Hz).

Completion contract.

  • The white mug must end up at the center of the table, touching the table.
  • Let go of the white mug: the task is not complete while any part of the gripper still touches it.

WhiteMugsInBinTask

Instruction. Clean up the white mugs

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The white mugs must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

WoodSpatulaToBowlTask

Instruction. Put the wooden spatula in the bowl

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • The wooden spatula must end up inside the wooden bowl and touching it.
  • Let go of the wooden spatula there: the task is not complete while any part of the gripper still touches it.

YellowAndWhiteObjectsInBinTask

Instruction. Put all white objects and yellow objects in the grey bin

Native action limit. 900 (60 s at 15 Hz).

Completion contract.

  • All white objects and yellow objects must end up inside the grey bin.
  • Let go of them there: the task is not complete while the gripper still touches any of them.

YogurtInBowlTask

Instruction. Put the small red yogurt in the red bowl

Native action limit. 600 (40 s at 15 Hz).

Completion contract.

  • The yogurt cup must end up inside the red bowl.
  • Let go of the yogurt cup there: the task is not complete while any part of the gripper still touches it.