54 admitted RoboDojo tasks on the dual-arm ARX X5. For each: RoboDojo's own action limit for the task and, where one has been reviewed, the public completion contract ORA gives the model. Success is decided only by RoboDojo's official result; the contract restates it and never replaces it. Generated from ora/environment/benchmarks/robodojo.py (NATIVE_ACTION_LIMITS) and ora/policy/environments/robodojo/task-contracts/registry-v10.json.
align_blocks
Native action limit. 200
Completion contract.
- All three blocks must end up in one straight row, with their centres lying on a single straight line.
- Each block must also be squared to that row, its sides running along and straight across the line of the row; a block left twisted at an angle to the row does not count, even if its centre is on the line.
- Every block must stay down on the table the whole time: if any block is ever lifted off the table or raised up onto anything, even briefly, the episode ends at once as a permanent failure, and setting it back down does not undo it.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
arrange_largest_number
Native action limit. 1050
Completion contract.
- Use all the number pieces to form the largest possible number, read from left to right along world +X: the most significant digit goes on the pad furthest toward world -X, on the side of the table where the left arm is mounted, and each piece must be centred on its own pad.
- Lay every piece flat so the number reads correctly from the robot's side of the table, with the top of each numeral pointing toward the far edge (world +Y).
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
arrange_largest_number_random
Native action limit. 1050
Completion contract.
- Use all the number pieces to form the largest possible number, read from left to right along world +X: the most significant digit goes on the pad furthest toward world -X, on the side of the table where the left arm is mounted, and each piece must be centred on its own pad.
- Lay every piece flat so the number reads correctly from the robot's side of the table, with the top of each numeral pointing toward the far edge (world +Y).
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
build_tower
Native action limit. 1050
Completion contract.
- The four upright blocks start as two pairs, one pair on each side of the table (world -X and world +X). The longest board must rest across one block from each pair, and the second-longest board must rest across the remaining block of each pair, those two blocks standing on the longest board.
- The second-longest board must sit centred over the middle of the longest board, not merely somewhere on its two blocks.
- Centre the smallest board above the second-longest board and the roof-shaped piece above that; align their long edges and keep the roof upright.
- Keep the blocks upright and the boards level.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
classify_objects
Native action limit. 1100
Completion contract.
- Group all objects of the same category together, using a separate basket for each category.
- Lower the objects into the baskets rather than leaving them above the openings.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
classify_objects_by_language
Native action limit. 1100
Completion contract.
- Put every object of each named category into the basket the instruction assigns to that category. The left basket is the one toward world -X, on the side of the table where the left arm is mounted; the right basket is the one toward world +X, on the right-arm side; the middle basket is between them.
- Lower the objects into the baskets rather than leaving them above the openings.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
cover_blocks
Native action limit. 800
Completion contract.
- Left to right runs from world -X, the side of the table where the left arm is mounted, toward world +X, the right-arm side. The blocks' left-to-right order is the order in which they stand when the episode resets.
- A block counts as covered when one of the three cups, upside down with its opening toward the table, has been lowered over it so that the whole block is inside the cup and the cup's rim is down around the block rather than above it. A cup hovering above a block or resting tilted on it does not cover it, and a block with no cup over it in this way is uncovered.
- The official check looks for six arrangements one after another, each at some moment after the one before: first only the leftmost block covered; then the leftmost and middle blocks covered while the rightmost is still uncovered; then all three covered; then the red block uncovered while the green and blue blocks are still covered; then the red and green blocks uncovered while the blue block is still covered; and last all three uncovered. The task is complete only once this whole sequence has been passed through and has ended with all three blocks uncovered.
- All three cups must be upside down, with their openings toward the table, at each of those six moments, including the last.
- The blocks themselves must stay where they are: if any block is ever pushed, knocked or carried away from the place where it stood when the episode reset, the episode ends at once as a permanent failure, and moving it back afterwards does not undo it.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
deposit_coin
Native action limit. 300
Completion contract.
- The coin must end up entirely inside the coin bank, down in the lower part of its interior. A coin left only part-way in, resting on top of the bank or lying beside it does not count.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
fasten_screws
Native action limit. 1900
Completion contract.
- The screws in this scene are the threaded bolts standing upright on the table, and the nuts are the separate hexagonal pieces. Each nut must end up threaded onto the screw of its own color, centred on that screw's shaft and sitting level, with its flat faces horizontal.
- Each nut must be run down its screw far enough that its lower face is well below the top of the screw, not merely resting on or balanced at the tip.
- Both grippers must be left fully open, not closed on a nut or on anything else.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
fill_egg_holder
Native action limit. 700
Completion contract.
- All four eggs must end up inside the egg holder, each one resting low down in it the way an egg sits in an egg carton, not perched on another egg, on the rim or on the lid.
- The egg holder's lid must be closed down over the holder, not left standing open or only partly closed.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
fill_pen_holder
Native action limit. 1100
Completion contract.
- All four pens must end up standing in the pen holder, each one reaching well down inside it with its lower end within the holder, not lying across the rim, propped against the outside or left on the table.
- Each pen must stand with the end that carries its cap or its clip at the top and its other end down in the holder; a pen put in the other way up does not count.
- The pen holder must be left standing upright, not tipped over or leaning.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
fold_clothes
Native action limit. 500
Completion contract.
- Fold each sleeve across the torso toward the opposite side of the chest.
- Fold the lower body of the garment toward the shoulders, bringing each side of the hem near its corresponding shoulder and aligning the hem edge with the shoulder edge.
- The fold is judged at the moment the robot enters the state of both arms back at their reset poses with both grippers open. Everything above must already be true at that moment; if it is not, only a later fresh entry into that state is judged.
- If either arm arrives back at its reset pose while the body is folded but a sleeve is not across the chest, the episode ends at once as a permanent failure.
fold_clothes_random
Native action limit. 500
Completion contract.
- Fold each sleeve across the torso toward the opposite side of the chest.
- Fold the lower body of the garment toward the shoulders, bringing each side of the hem near its corresponding shoulder and aligning the hem edge with the shoulder edge.
- The fold is judged at the moment the robot enters the state of both arms back at their reset poses with both grippers open. Everything above must already be true at that moment; if it is not, only a later fresh entry into that state is judged.
- If either arm arrives back at its reset pose while the body is folded but a sleeve is not across the chest, the episode ends at once as a permanent failure.
general_pickup
Native action limit. 200
Completion contract.
- Raise the object named in the instruction by more than the distance the instruction states, measured from the height at which it rested when the episode reset. It counts at the first moment it is that high; it need not be held there, carried anywhere or set back down afterwards.
- This task does not require the arms to end at their reset poses.
hang_mugs
Native action limit. 800
Completion contract.
- All three mugs must end up hanging on the mug rack, each one clear of the table and carried by the rack.
- Each mug must hang by its handle, with a peg of the rack passing through the handle and the body of the mug hanging below it, not merely resting against the rack or set on top of it.
- Each mug's handle must end up well above the table, up at the height of the rack's pegs, rather than sagging below the peg that holds it.
- All three mugs must end up threaded along the same one horizontal direction. The rack's pegs run along two directions at right angles to each other: its lowest pair and its highest pair share one direction, and its middle pair runs crosswise to that. Only the direction the lowest and highest pairs share counts, and either way along it counts; a mug threaded along the crosswise direction does not count, however securely it hangs.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
hang_mugs_random
Native action limit. 800
Completion contract.
- All three mugs must end up hanging on the mug rack, each one clear of the table and carried by the rack.
- Each mug must hang by its handle, with a peg of the rack passing through the handle and the body of the mug hanging below it, not merely resting against the rack or set on top of it.
- Each mug's handle must end up well above the table, up at the height of the rack's pegs, rather than sagging below the peg that holds it.
- All three mugs must end up threaded along the same one horizontal direction. The rack's pegs run along two directions at right angles to each other: its lowest pair and its highest pair share one direction, and its middle pair runs crosswise to that. Only the direction the lowest and highest pairs share counts, and either way along it counts; a mug threaded along the crosswise direction does not count, however securely it hangs.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
imitate_sorting_sequence
Native action limit. 1600
Completion contract.
- Your basket is the one on the left-arm side of the table, toward world -X, and the nearer of the two to the robot. The other basket, on the right-arm side toward world +X and farther from the robot, is the one the demonstrating arm fills.
- Keep both robot arms at their initial poses while the other arm demonstrates the placement sequence.
- Place the corresponding objects into your basket in the observed order, leaving later objects outside until their turn.
- Keep the demonstrated objects in the other basket. Do not release and leave a later object in your basket ahead of its predecessors.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
The demonstration is scripted by the environment and advances only while native actions are consumed: it does not progress while you look at images or plan. Wait with both arms held still while it runs, and look again before acting on the order you saw.
insert_key
Native action limit. 300
Completion contract.
- The key must end up pushed fully down into the keyhole, standing straight up in it with its head at the top.
- Seen from above, the key must be left turned clockwise from the keyhole's slit: its teeth must point partway round clockwise from the direction of the slit, clearly away from it but short of pointing square across it. Teeth still along the slit, turned anticlockwise, or turned square across the slit or further do not count.
- This task does not require the arms to end at their reset poses.
insert_tubes
Native action limit. 500
Completion contract.
- All three tubes must end up inside the rack, each one down in a hole rather than standing on top of the rack or leaning against its outside.
- Each tube must be seated all the way down in its hole, not left standing part way out.
- Each tube must end up standing upright the way a tube sits in a rack, mouth up and closed end down, rather than upside down, tipped over or lying across the rack.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
make_kong
Native action limit. 600
Completion contract.
- The opponent's discard, one of the opponent's standing tiles across the table being knocked over, advances only while robot commands are consuming native actions; while no robot command executes, the opponent does not move.
- If either robot arm is away from its reset pose while the opponent's arm is away from its own resting pose, the episode ends at once as a permanent failure; moving the arm back afterwards does not undo it.
- Lay the three tiles in your standing row that match the discarded tile down flat, face up, and keep every other tile in that row standing.
- The draw tile is the face-down tile on top of the stack nearer the robot at the left end of the table (world -X). The official check first requires the matching tiles to lie face up while the draw tile still lies face down as it started; after that, the draw tile must stand upright in the next place at the open right end of your row (world +X), in line with the row, with both grippers open and the other tiles unchanged.
- This task does not require the arms to end at their reset poses.
make_toast
Native action limit. 1400
Completion contract.
- One slice of bread must end up in each of the toaster's two slots, standing down inside its slot and resting on the bottom of it, not sitting on top of the toaster or caught high in the opening.
- The other two slices must stay in the bread rack.
- All four slices, the two in the toaster and the two in the rack, must be standing up on an edge, not lying flat.
- The toaster's lever must be left pressed all the way down, not only part of the way.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
make_toast_random
Native action limit. 1400
Completion contract.
- One slice of bread must end up in each of the toaster's two slots, standing down inside its slot and resting on the bottom of it, not sitting on top of the toaster or caught high in the opening.
- The other two slices must stay in the bread rack.
- All four slices, the two in the toaster and the two in the rack, must be standing up on an edge, not lying flat.
- The toaster's lever must be left pressed all the way down, not only part of the way.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
match_and_pick_from_conveyor
Native action limit. 700
Completion contract.
- The object that counts is the matching one that comes along the conveyor later, a second copy of the first object. Lifting the first object itself, or any other object, does not count.
- That matching object must be lifted well up off the conveyor, clearly higher than it rode on the belt; a slight lift, or sliding or pushing it along the belt, does not count. It counts at the first moment it is that high; it need not be held there, carried anywhere or set down afterwards.
- This task does not require the arms to end at their reset poses.
The conveyor belt advances only while robot commands are consuming native actions; while no robot command executes, the belt does not move.
organize_table
Native action limit. 1000
Completion contract.
- Place the mouse on its mouse pad, the keyboard lying flat over its marked frame so that it covers the middle of the frame, the figurine upright on its stand, and the alarm clock upright on top of the drawer unit, and let each placed object come to rest.
- The keyboard is larger than its frame, so the instruction's 'push the keyboard into the frame' cannot mean fitting it inside: the keyboard lies over the frame, overhanging the frame's edges, centred so that it covers the frame's central strip along nearly the frame's whole length.
- Keep the keyboard aligned with its frame, facing the same way and with the same side up as when the episode reset, and keep the mouse aligned with its pad, facing the same way as when the episode reset.
- The instruction's 'place the alarm clock on the drawer' means on top of the drawer unit, not inside it.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
pack_objects_into_box
Native action limit. 1300
Completion contract.
- All four objects must be inside the box, down on its bottom, each lying with its length along the box's long direction.
- Each object's front end must point toward world -X, the robot's own left and the side of the table where the left arm is mounted, with its back end toward world +X. This is what the instruction means by front sides facing left; the direction is fixed in the world and does not change with the camera view.
- The front end is the car's nose, the electric toothbrush's brush-head end, the hammer's head end and the shoe's toe. The back end is the car's rear, the bottom end of the toothbrush handle, the free end of the hammer's handle and the shoe's heel.
- The box must stay upright with its long direction running along world X.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
pack_objects_into_box_random
Native action limit. 1300
Completion contract.
- All four objects must be inside the box, down on its bottom, each lying with its length along the box's long direction.
- Each object's front end must point toward world -X, the robot's own left and the side of the table where the left arm is mounted, with its back end toward world +X. This is what the instruction means by front sides facing left; the direction is fixed in the world and does not change with the camera view.
- The front end is the car's nose, the electric toothbrush's brush-head end, the hammer's head end and the shoe's toe. The back end is the car's rear, the bottom end of the toothbrush handle, the free end of the hammer's handle and the shoe's heel.
- The box must stay upright with its long direction running along world X.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
pick_from_conveyor_by_image
Native action limit. 700
Completion contract.
- The target object is the one shown in the image on the board; no other object counts in its place.
- The target object must end up inside the basket, lying on the basket's bottom and entirely within it, not hanging over the rim, perched on the edge or held up above the bottom.
- At that same moment the basket must be raised, so that the target object lying in it is higher than it was when the episode reset by more than the lift height the task instruction names. A basket lifted while still empty and set down again before the object is in it does not count.
- This task does not require the arms to end at their reset poses.
The conveyor belt advances only while robot commands are consuming native actions; while no robot command executes, the belt does not move.
play_stacking_toy
Native action limit. 1200
Completion contract.
- The toy's pieces come in four sets of identical pieces: a set of four, a set of three, a set of two and a single piece. Each set has one correct peg, fixed by how many pieces it holds: the set of four goes on the tallest peg, the set of three on the second tallest, the set of two on the third tallest and the single piece on the shortest peg.
- Every piece must be threaded onto its set's peg and slid down it, resting on the base or on the piece below it, not caught on the tip of the peg or left beside it. All ten pieces must be on their pegs at the same time.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
play_tic_tac_toe
Native action limit. 1100
Completion contract.
- Your pieces are the five rings; the opponent, the separate robot arm across the table, plays the four crosses. You move first.
- The opponent takes its turn only when the board shows exactly one more of your rings than of its crosses, each centred in a cell, and both of your arms are back at their reset poses. Its move advances only while robot commands are consuming native actions; while no robot command executes, the opponent does not move.
- If either of your arms is away from its reset pose while the opponent's arm is away from its own resting pose, the episode ends at once as a permanent failure; moving the arm back afterwards does not undo it.
- The game is complete only when the board is full: all nine pieces, your five rings and the opponent's four crosses, each lying on the board and centred in a cell of its own. Making three in a row does not end the game, and which side wins is not judged.
- This task does not require the arms to end at their reset poses.
play_Xylophone
Native action limit. 500
Completion contract.
- Left to right runs from world -X, the side of the table where the left arm is mounted, toward world +X, the right-arm side. Every key must be struck, one after another in the order the keys lie along the xylophone, beginning with the key at its left end and ending with the key at its right end.
- A key counts as struck when the head of the mallet comes down to that key, touching it or just above it, over the key itself rather than between keys or beside the xylophone. Contact by any other part of the mallet, or by a gripper, does not count.
- After each strike the mallet must be lifted clearly back up from that key before a strike on the next key counts; sliding the mallet along the keys without lifting it counts as a single strike at most.
- A key counts only once every key to its left has been struck in turn; a key struck out of turn must be struck again later. The task is complete at the moment the key at the right end is struck.
- This task does not require the arms to end at their reset poses.
plug_in_charger
Native action limit. 400
Completion contract.
- The charger must end up plugged into the power strip: standing upright with its two prongs pointing straight down, pushed all the way into one of the strip's outlets until the body of the charger is down against the top of the strip. A charger resting on top of the strip, only part-way in, lying on its side or left leaning over does not count.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
pour_balls_into_vase
Native action limit. 600
Completion contract.
- All the balls that start in the cup must end up inside the vase.
- The cup must be left upright, with its opening facing up; a cup left lying on its side, tipped over or upside down does not count, even when every ball is in the vase.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
pour_by_language
Native action limit. 800
Completion contract.
- Each bottle's liquid must go into the bowl the instruction pairs it with, the bottles and bowls being told apart by the colours the instruction names: the first bottle named into the first bowl named, the second into the second and the third into the third. Liquid poured into any other bowl does not count for that bottle.
- A bottle's pour counts only when just a little of its liquid is left in it and almost none of the liquid that has left it lies anywhere but inside its paired bowl. Small droplets lying scattered apart from the rest of that liquid are disregarded, but if such scattered droplets add up to a sizeable share of it, that pour does not count.
- Each bottle's pour is judged at the moment that bottle comes back close to upright, neck up, after having been tipped away from upright, whether it is still held or already set down. Its pour must already count at that moment; if it does not, only a later fresh tip and return to upright of that bottle is judged. A bottle left tipped, lying on its side or upside down is never judged. A pour once judged to count stays counted, and the task is complete, and the episode ends, as soon as all three pours have been judged to count; the arm reset named at the end of the instruction is therefore never judged.
- The instruction lists the pours in order, first to third, and that order is checked whenever an arm returns to its reset pose. If at that moment a bowl named later in the instruction holds enough of its bottle's liquid for that pour to count while a bowl named earlier does not, the episode ends at once as a permanent failure that nothing done afterwards can undo. An earlier bowl whose liquid has since been spilled or knocked out counts as not holding it.
- This task does not require the arms to end at their reset poses.
pour_liquid_into_cup
Native action limit. 400
Completion contract.
- Pour the bottle's liquid into the cup: only a little of it may be left in the bottle, and almost none of the liquid that has left the bottle may lie anywhere but inside the cup.
- Small droplets lying scattered apart from the rest of the liquid are disregarded, but if such scattered droplets add up to a sizeable share of the liquid, the pour does not count.
- The pour is judged at the moment the bottle comes back close to upright, neck up, after having been tipped away from upright, whether it is still held or already set down. Everything above must already be true at that moment; if it is not, only a later fresh tip and return to upright is judged. A bottle left tipped, lying on its side or upside down is never judged, however much liquid is in the cup. The task is complete, and the episode ends, at the first such moment at which everything above is true.
- This task does not require the arms to end at their reset poses.
pour_liquid_into_cup_random
Native action limit. 400
Completion contract.
- Pour the bottle's liquid into the cup: only a little of it may be left in the bottle, and almost none of the liquid that has left the bottle may lie anywhere but inside the cup.
- Small droplets lying scattered apart from the rest of the liquid are disregarded, but if such scattered droplets add up to a sizeable share of the liquid, the pour does not count.
- The pour is judged at the moment the bottle comes back close to upright, neck up, after having been tipped away from upright, whether it is still held or already set down. Everything above must already be true at that moment; if it is not, only a later fresh tip and return to upright is judged. A bottle left tipped, lying on its side or upside down is never judged, however much liquid is in the cup. The task is complete, and the episode ends, at the first such moment at which everything above is true.
- This task does not require the arms to end at their reset poses.
press_by_number
Native action limit. 700
Completion contract.
- Each red button must be pressed exactly as many times as the number shown on the number card that stands behind it, on the far side of the button from the robot.
- The presses must come in this order: first every press of the red button on the left, toward world -X on the side of the table where the left arm is mounted; then one press of the blue button; then every press of the red button in the middle; then a second press of the blue button. The blue button is pressed twice in all, once after each red button's presses.
- A press counts once the button has been pushed well down, and it is finished only when the button has been let go and has sprung all the way back up; the next press must start from the fully raised button.
- Every press of any button is counted, whenever it happens. Pressing a button more often than this sequence calls for ends the episode at once as a permanent failure that cannot be undone, and a press made out of turn still counts, so it leaves the sequence impossible to complete.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
push_T
Native action limit. 600
Completion contract.
- The T-shaped block must lie directly over the gray T-shaped pad with its footprint matching the pad's own T footprint: centred on it and turned to the same heading, so that the two T shapes coincide. Resting inside or overlapping the pad's outline without matching it is not enough.
- The block must be lying flat on the table the same way up as it started.
- The block must stay down on the table surface throughout the attempt; if it is ever raised or tipped up off the table, the episode ends at once as a permanent failure, and setting the block back down does not undo that.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
push_T_random
Native action limit. 600
Completion contract.
- The T-shaped block must lie directly over the gray T-shaped pad with its footprint matching the pad's own T footprint: centred on it and turned to the same heading, so that the two T shapes coincide. Resting inside or overlapping the pad's outline without matching it is not enough.
- The block must be lying flat on the table the same way up as it started.
- The block must stay down on the table surface throughout the attempt; if it is ever raised or tipped up off the table, the episode ends at once as a permanent failure, and setting the block back down does not undo that.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
put_bottles_into_dustbin
Native action limit. 700
Completion contract.
- Put all four bottles fully inside the dustbin, down in its lower interior.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
solve_equation
Native action limit. 300
Completion contract.
- The correct piece is the one number or operator that makes the equation laid out on the row of pads true. It must end up on the one empty pad of that equation, centred on the pad rather than hanging off its edge.
- That piece must lie flat and face up, squared to the row of pads and reading the right way up from the robot's side of the table, like the pieces already in the equation. For a symbol that looks the same either way round, the right way round is the way it lay when the episode reset; a piece turned sideways or end for end does not count.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
sort_nesting_dolls_by_size
Native action limit. 1050
Completion contract.
- Left to right runs from world -X, the side of the table where the left arm is mounted, toward world +X, the right-arm side.
- All five dolls must stand in one straight row running from left to right, their centres closely lined up at the same distance from the robot, so that the row runs straight across the table rather than slanting or staggered toward or away from the robot.
- Along that row each doll must be larger than the one to its left: the smallest doll at the left end, the largest at the right end, and each doll standing clearly to the right of the next smaller one.
- Every doll must be left standing upright on its base, not lying on its side or upside down.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
sort_nesting_dolls_by_size_random
Native action limit. 1050
Completion contract.
- Left to right runs from world -X, the side of the table where the left arm is mounted, toward world +X, the right-arm side.
- All five dolls must stand in one straight row running from left to right, their centres closely lined up at the same distance from the robot, so that the row runs straight across the table rather than slanting or staggered toward or away from the robot.
- Along that row each doll must be larger than the one to its left: the smallest doll at the left end, the largest at the right end, and each doll standing clearly to the right of the next smaller one.
- Every doll must be left standing upright on its base, not lying on its side or upside down.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
stack_blocks
Native action limit. 550
Completion contract.
- Arrange all three blocks one above another, with their centers vertically aligned. No particular texture order is required.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
stack_blocks_by_language
Native action limit. 400
Completion contract.
- The three blocks must end up in one stack in the colour order the instruction gives, read from the bottom up: the first colour named at the bottom, the second in the middle and the third on top.
- Each block must sit on top of the block below it, centred over it rather than set off toward one side or placed beside it.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
stack_blocks_random
Native action limit. 550
Completion contract.
- Arrange all three blocks one above another, with their centers vertically aligned. No particular texture order is required.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
stack_bowls
Native action limit. 800
Completion contract.
- All three bowls must end up gathered into one stack, each bowl centred over the one below it rather than beside it or merely overlapping it, and each sitting clearly higher than the bowl beneath it.
- Every bowl must be left upright with its opening facing upward, not on its side and not turned over.
- The bowl at the bottom of the stack must be left sitting flat and level on its base; upright is not enough if it is left leaning.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
stack_bowls_random
Native action limit. 800
Completion contract.
- All three bowls must end up gathered into one stack, each bowl centred over the one below it rather than beside it or merely overlapping it, and each sitting clearly higher than the bowl beneath it.
- Every bowl must be left upright with its opening facing upward, not on its side and not turned over.
- The bowl at the bottom of the stack must be left sitting flat and level on its base; upright is not enough if it is left leaning.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
store_laptop_and_headphones
Native action limit. 800
Completion contract.
- The headphones must hang on the headphone stand by their headband: the top of the headband resting in the curved cradle at the top of the stand, with the band running along the cradle and an ear cup hanging down on each side, upright rather than tipped far over.
- The headphones must hang the same way round as they lay on the table when the episode reset: the ear cup that lay toward world +X, the right-arm side, must hang on the stand's +X side. Headphones turned the other way round, with their ear cups swapped, do not count.
- The laptop must be closed, its screen folded down flat onto the keyboard, not left standing open or only partly closed.
- The laptop must stand in the vertical laptop stand, the low rack with a narrow upright slot, not on the flat stand it started on. It must stand almost exactly upright on its front edge, the edge opposite the hinge, with the middle of that edge down inside the rack and the hinge edge at the top; a laptop stood in on its hinge edge, or leaning noticeably, does not count.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
store_laptop_and_headphones_random
Native action limit. 800
Completion contract.
- The headphones must hang on the headphone stand by their headband: the top of the headband resting in the curved cradle at the top of the stand, with the band running along the cradle and an ear cup hanging down on each side, upright rather than tipped far over.
- The headphones must hang the same way round as they lay on the table when the episode reset: the ear cup that lay toward world +X, the right-arm side, must hang on the stand's +X side. Headphones turned the other way round, with their ear cups swapped, do not count.
- The laptop must be closed, its screen folded down flat onto the keyboard, not left standing open or only partly closed.
- The laptop must stand in the vertical laptop stand, the low rack with a narrow upright slot, not on the flat stand it started on. It must stand almost exactly upright on its front edge, the edge opposite the hinge, with the middle of that edge down inside the rack and the hinge edge at the top; a laptop stood in on its hinge edge, or leaning noticeably, does not count.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
store_tools_in_toolbox
Native action limit. 900
Completion contract.
- Each of the four tools, the hammer, the pliers, the tape measure and the wrench, must end up in its own compartment of the toolbox, the recess shaped for that tool, centred in it rather than in another tool's recess or lying across two.
- Each tool must lie in its compartment the way the recess is shaped to take it, which is the same side up and pointing the same way as the tool lay on the table when the episode reset. The pliers alone may lie either side up; a hammer, tape measure or wrench turned over or turned round does not count.
- Every tool must be wholly inside the toolbox, within its outline seen from above and down in it, with no part sticking out over its edge or up above its rim.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
swap_blocks
Native action limit. 700
Completion contract.
- Swapping means that each block ends up on the mat where the other block stood when the episode reset. The two blocks look alike, so the finished arrangement looks the same as the start; it counts only if each block has actually been moved to the other's mat.
- The official check looks for exactly three moves, one after another: first one block is moved from its own mat onto the mat that was empty at the reset; then the other block is moved onto the mat the first block came from; and last the first block is moved from the formerly empty mat onto the mat the second block came from. Either block may go first. A move is finished only when its block has been set down on the middle of its new mat while the other block rests on its mat.
- A move counts only if its block is lifted clearly up off the mats on the way; a block slid, pushed or carried only just above the mats does not count as moved.
- After each move is finished, the button must be pressed once: pushed firmly down, then let go so that it springs back up, before the next move begins. The task is complete once the button has sprung back up after the press that follows the third move.
- The button may be pressed only three times in the whole episode, once after each move. Every press counts toward that limit whenever it is made, including one made before a move is finished or an extra press to be sure, and a fourth press ends the episode at once as a permanent failure; letting go of the button afterwards does not undo it.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
swap_T
Native action limit. 400
Completion contract.
- The red T-shaped block must end up on the spot where the blue one stood when the episode reset, and the blue block on the spot where the red one stood, each centred almost exactly on that spot.
- Each block must also take over the other block's starting heading almost exactly: turned so that its T points the same way the other block's T pointed at the reset. A block that keeps its own starting heading, or is turned only roughly, does not count.
- Both blocks must end up lying flat on the table the same side up as they started; a block that has been turned over does not count, even though its outline looks the same from above.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
sweep_blocks
Native action limit. 1000
Completion contract.
- All three blocks must end up inside the dustpan's pan, the shallow scoop in front of its handle, lying well within the pan's outline seen from above, toward its middle rather than at its edges or corners. A block left beside the dustpan, on its rim or on its handle does not count.
- The dustpan must be left resting flat on the table the right way up, as it lay at the start: not lifted, held up, tipped onto its lip or propped on a block or on the broom.
- The broom must be left clearly to the right of the dustpan, farther toward world +X, the side of the table where the right arm is mounted; a broom left on the dustpan's left side, or only about level with it from left to right, does not count.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.
sweep_blocks_random
Native action limit. 1000
Completion contract.
- Every toy brick, earbud and crumpled paper ball on the table must end up inside the dustpan's pan, the shallow scoop in front of its handle, lying well within the pan's outline seen from above, toward its middle rather than at its edges or corners. If any one of them is left beside the dustpan, on its rim or on its handle, the task is not complete.
- The dustpan must be left resting flat on the table the right way up, as it lay at the start: not lifted, held up, tipped onto its lip or propped on one of the swept objects or on the broom.
- The broom must be left clearly to the right of the dustpan, farther toward world +X, the side of the table where the right arm is mounted; a broom left on the dustpan's left side, or only about level with it from left to right, does not count.
- Both arms must be back at the poses they held when the episode reset, at the same instant that everything else in this contract is true.