Difference between revisions of "Problems"

From Tamp Benchmarking
Jump to: navigation, search
(Problem 3 : Sorting Objects)
(Problem 5 : Kitchen)
 
(22 intermediate revisions by the same user not shown)
Line 5: Line 5:
 
! Features !! Pb 1 !! Pb 2 !! Pb 3 !! Pb 4 !! Pb 5 !! Pb6 !!Discussed in
 
! Features !! Pb 1 !! Pb 2 !! Pb 3 !! Pb 4 !! Pb 5 !! Pb6 !!Discussed in
 
|-
 
|-
| blocking objects          ||  ||  || X || X ||   ||    || [[Comments_from_Calean#Benchmarking_suggestion_3_17|bench. sugg. 3]]
+
| blocking objects          ||  ||  || X || X || X ||    || [[Comments_from_Calean#Benchmarking_suggestion_3_17|bench. sugg. 3]]
 
|-
 
|-
| large task spaces        || X || X ||   ||  ||  ||  ||  [[Comments_from_Calean#Benchmarking_suggestion_3_17|bench. sugg. 3]], [[Comments_from_Neil#Difficult_problem_instances_10|diff. pb. inst.]]
+
| large task spaces        || X || X || X ||  ||  ||  ||  [[Comments_from_Calean#Benchmarking_suggestion_3_17|bench. sugg. 3]], [[Comments_from_Neil#Difficult_problem_instances_10|diff. pb. inst.]]
 
|-
 
|-
 
| infeasible task operators || x || X ||  ||  ||  ||  ||  [[Comments_from_Calean#Benchmarking_suggestion_3_17|bench. sugg. 3]], [[Comments_from_Neil#Difficult_problem_instances_10|diff. pb. inst.]]
 
| infeasible task operators || x || X ||  ||  ||  ||  ||  [[Comments_from_Calean#Benchmarking_suggestion_3_17|bench. sugg. 3]], [[Comments_from_Neil#Difficult_problem_instances_10|diff. pb. inst.]]
Line 13: Line 13:
 
| trade-off motion planning/task planning ||  || X ||  ||  ||  ||  ||  [[Talk:Problems#Difficult_problem_instances_10|diff. pb. inst.]]
 
| trade-off motion planning/task planning ||  || X ||  ||  ||  ||  ||  [[Talk:Problems#Difficult_problem_instances_10|diff. pb. inst.]]
 
|-
 
|-
| non-monotonicity          ||  ||  ||  || X ||   ||  X ||  [[Talk:Problems#Benchmarking_suggestion_4_27|bench. sugg. 4]]
+
| non-monotonicity          ||  ||  ||  || X || X ||  X ||  [[Talk:Problems#Benchmarking_suggestion_4_27|bench. sugg. 4]]
|-
 
|NAMO  ||  || ?  || X || X ||  ||  X ||  [[Talk:Problems#Comment_4_52|Sidd. comment 4]]
 
 
|-
 
|-
 
| Non-geometric actions  ||  ||  ||  ||  || X ||  ||  [[Talk:Problems#Comment_4_52|Sidd. comment 4]]
 
| Non-geometric actions  ||  ||  ||  ||  || X ||  ||  [[Talk:Problems#Comment_4_52|Sidd. comment 4]]
Line 25: Line 23:
  
 
==== Description ====
 
==== Description ====
Tower of Hanoi with mobile robots<ref>S. Cambon, R. Alami, and F. Gravot. A hybrid approach to intricate motion, manipulation and task planning. The Int. Journal of Robotics Research, 2009.</ref>.
+
This is the classical Tower of Hanoi problem (inspired by Cambon et al.<ref>S. Cambon, R. Alami, and F. Gravot. A hybrid approach to intricate motion, manipulation and task planning. The Int. Journal of Robotics Research, 2009.</ref>.). The base of the robot is fixed. The rods are set in a triangular fashion and the discs are very thick, so that stacking them on a rod may temporarily create an obstacle and prevent from picking/placing discs on other rods.
  
 
==== Challenge ====
 
==== Challenge ====
For ''n'' discs, ''2''<sup>''n''</sup> - ''1'' moves are needed (in the non-geometric case).<br />
+
Although the rules are simple, the optimal solution plan for ''n'' discs contains ''2''<sup>''n''</sup> - ''1'' steps, without con-
Placing a disk on the central rod may prevent, depending on their relative sizes, to transfer discs from rod 1 to rod 3 (or vice versa).<br />
+
sidering geometry (large task space). The rules of the game impose to go through intermediate states, many of which are geometrically unfeasible (unfeasible task operators) if the chosen order creates occlusions.
The problem has been adapted to a humanoid robot setup. The idea is to have similar geometric constraints by setting the positions of the rods in a triangular shape and by using "thick" discs, in order to cause collisions between forearms and discs.
 
  
 
==== Download ====
 
==== Download ====
[[download_page_pb1|Download page]]
+
[[download_page_pb1|Download page (PR2)]]
  
 
== Problem 2 : Blocks-World 3D ==
 
== Problem 2 : Blocks-World 3D ==
Line 39: Line 36:
  
 
==== Description ====
 
==== Description ====
Using top-grasps only, and not using hand-over, stack the blocks in alphabetical order anywhere (on the table, or on one of the trays).<br />
+
Another classical task planning problem, in which the goal is to stack the blocks in alphabetical order anywhere it is possible. The base is fixed, only top-grasps can be used, and hand-over is not allowed. An obstacle is hovering over the table, such that the grippers would collide with it if more than 2 blocks are stacked on the table (unfeasible task operators).
With a PR2 robot, the flying obstacle would be lower.
 
  
 
==== Challenge ====
 
==== Challenge ====
Because of the "hovering obstacle", the pile cannot be built on the table.<br />
+
Both initial piles need to be un-stacked somewhere and re-stacked on one of the trays. During this process, half of the blocks need to transit from one tray to another, through the table. This requires many actions (large task space). The region on the table where blocks transit has to be reachable by both arms, therefore its size is limited. One must choose between few steps and cluttered table, or many steps and uncluttered table (motion/task trade-off).
Because of the "hovering obstacle", no more than 2 blocks can be stacked on the table (then the wrist touches the obstacle).<br />
 
Whether the red or blue tray is chosen as location for building the pile, both initial piles need to be unstacked somewhere, somewhere reachable by both arms: R.<br />
 
R is limited in size, and no more than 2 blocks can be stacked in this region, so there is a trade-off between:
 
* a short symbolic plan with a cluttered R
 
* a long symbolic plan with manageable R
 
Here is an [https://youtu.be/2DgtzdbER8o example of solution].
 
  
 
==== Download ====
 
==== Download ====
[[download_page_pb2|Download page]]
+
[[download_page_pb2|Download page (PR2)]]
  
 
== Problem 3 : Sorting Objects ==
 
== Problem 3 : Sorting Objects ==
[[File:bm4.jpg|problem 4|300px]]
+
[[File:bm4.jpg|problem 4|400px]]
  
 
==== Description ====
 
==== Description ====
The goal constraints are that all 7 blue blocks must be on the left table and all 7 green blocks must be on the right table. There are also 14  red blocks.
+
The goal constraints are that all N blue blocks must be on the left table and all N green blocks must be on the right table. There are also 2N red blocks acting as obstacles for reaching blue and green blocks.
  
 
==== Challenge ====
 
==== Challenge ====
The close proximity of the blocks forces the planner to carefully order its operations as well as to move red blocks out of the way.
+
The close proximity of the blocks forces the planner to carefully order its operations, as well as to move red blocks out of the way without creating new occlusions (blocking objects). Solving the problem requires to move many objects, sometimes multiple times (large task space).
  
 
==== Download ====
 
==== Download ====
[[download_page_pb3|Download page]]
+
[[download_page_pb3|Download page (PR2)]]
  
 
== Problem 4 : Non-Monotonic ==
 
== Problem 4 : Non-Monotonic ==
[[File:bm5.jpg|problem 5|300px]]
+
[[File:Bm5.jpg|problem 5|300px]]
  
 
==== Description ====
 
==== Description ====
The robot must move the green blocks from the left table to a corresponding position on the right table. Both the initial and goal poses are blocked by four blue and cyan blocks respectively.  
+
The robot must move the green blocks from the left table to a corresponding position on the right table. Both the initial and goal poses are blocked by four red and blue blocks respectively. In the goal state, red and blue blocks have to be at their respective initial locations.
  
 
==== Challenge ====
 
==== Challenge ====
Critically, the blue and cyan blocks have goal conditions to remain in their initial poses. This is the source of the nonmonotonicity as the robot must undo several goals by moving the blue and cyan blocks in order to solve the problem.
+
The goal condition of blue and cyan blocks requires to temporarily move them away and bring them back later on (non-monotonicity) in order to solve the problem.
 +
 
 +
==== Download ====
 +
[[download_page_pb4|Download page (PR2)]]
  
 
== Problem 5 : Kitchen ==
 
== Problem 5 : Kitchen ==
[[File:bm55.jpg|problem 5|400px]]
+
[[File:Kitchen.png|problem 5|350px]]
  
 
==== Description ====
 
==== Description ====
The robot must obtain two green cabbages from the shelves, clean them on the dishwasher, cook them on the microwave, and serve them. Additionally, the robot must organize the dirty cups on the table, clean them, and set the table.
+
The robot must prepare a meal by cleaning two glasses (blue cylinders), cooking two cabbages (green blocks), and setting the table. Objects can be cleaned when placed on the dishwasher and cooked when placed on the microwave. An object must be cleaned before it can be cooked. Finally, the radishes (pink blocks) initially obstruct the cabbages on the shelf forcing the robot to move them. But, to maintain a tidy kitchen, the robot must also return them to their initial poses (the tray).
  
 
==== Challenge ====
 
==== Challenge ====
 +
This benchmark demonstrates that these challenges do appear in target applications. It combines several criteria including blocking objects, non-monotonicity, and non-geometric actions (cleaning and cooking).
  
TODO
+
==== Download ====
 +
[[download_page_pb5|Download page (PR2)]]
  
== Problem 6 : Rearrangement Planning (replaced by problem 3) ==
+
== Problem 6 : '''(DEPRECATED)''' Rearrangement Planning (replaced by problem 4) ==
 
[[File:bm3.jpg|problem 3|400px]]
 
[[File:bm3.jpg|problem 3|400px]]
  

Latest revision as of 15:45, 27 May 2018

Table summarizing some features we want to test. To be refined or extended.

Features Pb 1 Pb 2 Pb 3 Pb 4 Pb 5 Pb6 Discussed in
blocking objects X X X bench. sugg. 3
large task spaces X X X bench. sugg. 3, diff. pb. inst.
infeasible task operators x X bench. sugg. 3, diff. pb. inst.
trade-off motion planning/task planning X diff. pb. inst.
non-monotonicity X X X bench. sugg. 4
Non-geometric actions X Sidd. comment 4


Problem 1 : Tower of Hanoi

problem 1 problem 1 problem 1

Description

This is the classical Tower of Hanoi problem (inspired by Cambon et al.[1].). The base of the robot is fixed. The rods are set in a triangular fashion and the discs are very thick, so that stacking them on a rod may temporarily create an obstacle and prevent from picking/placing discs on other rods.

Challenge

Although the rules are simple, the optimal solution plan for n discs contains 2n - 1 steps, without con- sidering geometry (large task space). The rules of the game impose to go through intermediate states, many of which are geometrically unfeasible (unfeasible task operators) if the chosen order creates occlusions.

Download

Download page (PR2)

Problem 2 : Blocks-World 3D

problem 2

Description

Another classical task planning problem, in which the goal is to stack the blocks in alphabetical order anywhere it is possible. The base is fixed, only top-grasps can be used, and hand-over is not allowed. An obstacle is hovering over the table, such that the grippers would collide with it if more than 2 blocks are stacked on the table (unfeasible task operators).

Challenge

Both initial piles need to be un-stacked somewhere and re-stacked on one of the trays. During this process, half of the blocks need to transit from one tray to another, through the table. This requires many actions (large task space). The region on the table where blocks transit has to be reachable by both arms, therefore its size is limited. One must choose between few steps and cluttered table, or many steps and uncluttered table (motion/task trade-off).

Download

Download page (PR2)

Problem 3 : Sorting Objects

problem 4

Description

The goal constraints are that all N blue blocks must be on the left table and all N green blocks must be on the right table. There are also 2N red blocks acting as obstacles for reaching blue and green blocks.

Challenge

The close proximity of the blocks forces the planner to carefully order its operations, as well as to move red blocks out of the way without creating new occlusions (blocking objects). Solving the problem requires to move many objects, sometimes multiple times (large task space).

Download

Download page (PR2)

Problem 4 : Non-Monotonic

problem 5

Description

The robot must move the green blocks from the left table to a corresponding position on the right table. Both the initial and goal poses are blocked by four red and blue blocks respectively. In the goal state, red and blue blocks have to be at their respective initial locations.

Challenge

The goal condition of blue and cyan blocks requires to temporarily move them away and bring them back later on (non-monotonicity) in order to solve the problem.

Download

Download page (PR2)

Problem 5 : Kitchen

problem 5

Description

The robot must prepare a meal by cleaning two glasses (blue cylinders), cooking two cabbages (green blocks), and setting the table. Objects can be cleaned when placed on the dishwasher and cooked when placed on the microwave. An object must be cleaned before it can be cooked. Finally, the radishes (pink blocks) initially obstruct the cabbages on the shelf forcing the robot to move them. But, to maintain a tidy kitchen, the robot must also return them to their initial poses (the tray).

Challenge

This benchmark demonstrates that these challenges do appear in target applications. It combines several criteria including blocking objects, non-monotonicity, and non-geometric actions (cleaning and cooking).

Download

Download page (PR2)

Problem 6 : (DEPRECATED) Rearrangement Planning (replaced by problem 4)

problem 3

Description

The goal is to exchange the positions (i.e., the centre of objects) of the red object and the tray.

Challenge

One of the two objects has to be moved first to a temporary location. This may require to move other objects around, carefully choosing places that do not interfere.

The rearrangement planning problem [2] [3].

References

  1. S. Cambon, R. Alami, and F. Gravot. A hybrid approach to intricate motion, manipulation and task planning. The Int. Journal of Robotics Research, 2009.
  2. G. Havur et al., Geometric rearrangement of multiple movable objects on cluttered surfaces: A hybrid reasoning approach, Proceedings of ICRA 2014.
  3. F. Lagriffoul, B. Andres, Combining Task and Motion Planning: a culprit detection problem, The International Journal of Robotics Research, 2016.