Difference between revisions of "Main Page"

From Tamp Benchmarking
Jump to: navigation, search
(Contents)
(About this Wiki)
 
(38 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
== About this Wiki ==
 
== About this Wiki ==
  
Following the discussions at the TAMP workshop in RSS2016, a document was sketched for initiating thinking together about benchmarking for CTAMP planners. This wiki was created based on the previous document : we need more space to conduct proper discussions, and we may also have to share downloadable content later on. For now, the contents of the document were simply copy-pasted into different pages (sections Contents and Discussions below). Participants are invited to comment, correct, discuss, and bring their ideas.
+
Following the RSS2016 TAMP workshop, a discussion group (see ''Contributors'' below) was created to come up with a methodology and a set of benchmark problems for TAMP. Our discussions and the actual benchmarks can be found in the '''TAMP FO-DA''' section in the ''Contents'' menu. More details can be found in [https://ieeexplore.ieee.org/document/8411475/ this paper]. Our approach was to start with a set of problems which can be handled by the largest number of existing systems, by identifying the least common denominator for requirements and problem specification, at logical and geometric levels.
 +
 
 +
However, since TAMP covers a wide range of problems, it was not possible to come up with a set of benchmarks for '''all''' types of TAMP problems. Therefore the ''Contents'' of the wiki is organized according to '''subclasses''' of TAMP. If you find the assumptions and requirements for ''TAMP FO-DA'' incompatible with the type of problems you are interested in, please contribute by creating your own benchmark set in the ''Contents'' section. Candidate subclasses are suggested:
 +
 
 +
== Contents ==
 +
* [[TAMP_FO-DA|'''TAMP FO-DA''': Fullly Observable, Deterministic Actions]]
 +
* [[TAMP_PO-NDA|'''TAMP PO-NDA''': Partially Observable, Non Deterministic Actions]]  - '''TODO'''
 +
* [[TAMP_MP|'''TAMP MP''': Manipulation Planning (no symbolic planning)]]  - '''TODO'''
 +
* [[TAMP_PH|'''TAMP Physics''': Handling frictions (push-pull), gravity (building stable structures), dynamics]]  - '''TODO'''
 +
* Create your own...
 +
 
 +
== How to use this wiki ==
 +
 
 +
* This page is powered by MediaWiki, you can find instructions for editing pages [https://www.mediawiki.org/wiki/Help:Editing_pages here].
 +
* Do not modify a page for which you have not taken part in discussions.
 +
* Do not create a benchmark set on your own: this has to be a collaborative work involving other researchers.
 +
* For discussions, use the wiki "Discussion" tab, or set up a discussion thread, by creating a page and adding the following code at the top: <nowiki>{{#useliquidthreads:1}}</nowiki> (see for example [[Comments_from_Neil|this page]])
 +
* Note that there is an Atom feed for each discussion page (left menu) you can subscribe to for getting updated with new replies. You can adjust your preferences (top right menu) for getting notified by email.
 +
 
 +
== Contact ==
 +
If you want to contribute to this wiki, contact me at fabien[dot]lagriffoul[at]oru[dot]se and I'll create an account for you.
  
 
== Contributors ==
 
== Contributors ==
 +
* '''TAMP FO-DA''':
 
''Fabien Lagriffoul'' (Orebro University, Sweden.) <br />
 
''Fabien Lagriffoul'' (Orebro University, Sweden.) <br />
 
''Neil T. Dantam'' (Colorado School of Mines, USA) <br />
 
''Neil T. Dantam'' (Colorado School of Mines, USA) <br />
Line 9: Line 30:
 
''Ali Akbari'' (Tech. U. of Catalonia, Spain) <br />
 
''Ali Akbari'' (Tech. U. of Catalonia, Spain) <br />
 
''Siddharth Srivastava'' (Arizona State University, USA) <br />
 
''Siddharth Srivastava'' (Arizona State University, USA) <br />
 
== Aims ==
 
 
My proposal is to '''start with a set of simple benchmark problems, which can be handled by the largest number of existing systems.''' This requires to identify the least common denominator, in terms of requirements and problem specification, at logical and geometric levels.
 
 
These requirements will be extended later on, but in order to reach a “critical mass” so that enough people start using these benchmarks and disseminate them through their publications, we need to begin with something simple and accessible.
 
 
== How to edit this document ==
 
 
* The sections of the original document correspond to the different pages below (Contents and Discussions).
 
* In the Contents section, the comments have been pasted in the Discussion pages, in the form of discussion threads.
 
* If you think an important issue is overlooked, create a TODO item or reply to the thread (this should generate a New Message in each contributor's message box in the top-right menu).
 
* Note that there is an Atom feed for each discussion page (left menu) you can subscribe to for getting updated with new replies. You can also adjust your preferences (top right menu) for getting notified by email.
 
* If you think that an issue has been resolved, feel free to remove the thread / TODO and update the corresponding page.
 
* Syntax for signature: <nowiki>--~~~~</nowiki>
 
 
 
In order to add a new discussion topic, proceed as follow:
 
 
# Edit the side bar menu: http://tampbenchmark.aass.oru.se/index.php?title=MediaWiki:Sidebar
 
# Add the following at the end (in Discussions): <nowiki>**</nowiki> my_new_discussion_topic|My new discussion topic (replace with your actual topic)
 
# Save your changes.
 
# It should appear in the side menu. Click on it: the page does not exist, create it. Done.
 
# If you want this page to be a discussion thread itself, add the following code and save it : <nowiki>{{#useliquidthreads:1}}</nowiki>
 
 
== Contents ==
 
* [[TAMP_FO_DA|TAMP fullly observable deterministic actions]]
 
  ** [[TAMP Problem Definition]]
 
  ** Requirements (based on the article by Neil<ref>Neil T. Dantam, Zachary K. Kingston, Swarat Chaudhuri, and Lydia E. Kavraki, ''Incremental Task and Motion Planning: A Constraint-Based Approach'', (TAMP Workshop, RSS2016).</ref>)
 
    *** [[Task Planning Requirements]]
 
    *** [[Motion Planning Requirements]]
 
    *** [[Task-Motion Interface Requirements]]
 
  ** [[General Assumptions]]
 
  ** [[Metrics]]
 
  ** [[Problems]]
 
  ** [[Practical Issues]]
 
 
  ** Discussions
 
    *** [[Comments from Neil]]
 
    *** [[Comments from Calean]]
 
    *** [[Comments from Siddharth]]
 
 
== Discussions ==
 
 
* [[Comments from Neil]]
 
* [[Comments from Calean]]
 
* [[Comments from Siddharth]]
 
 
== Contact ==
 
If you want to join the discussion group, contact me at fabien[dot]lagriffoul[at]oru[dot]se.
 
  
 
== Support ==
 
== Support ==
Line 64: Line 35:
  
 
== RSS Workshops ==
 
== RSS Workshops ==
*2017: [http://www.kavrakilab.org/2017-rss-workshop/ Task and Motion Planning RSS 2017]
+
* 2018: [http://www.neil.dantam.name/2018/rss-tmp-workshop/ Exhibition and Benchmarking of Task and Motion Planners RSS 2018]
*2016: [http://www.kavrakilab.org/2016-rss-workshop/ Task and Motion Planning RSS 2016]
+
* 2017: [http://www.kavrakilab.org/2017-rss-workshop/ Task and Motion Planning RSS 2017]
 
+
* 2016: [http://www.kavrakilab.org/2016-rss-workshop/ Task and Motion Planning RSS 2016]
== References ==
 

Latest revision as of 09:44, 18 July 2018

About this Wiki

Following the RSS2016 TAMP workshop, a discussion group (see Contributors below) was created to come up with a methodology and a set of benchmark problems for TAMP. Our discussions and the actual benchmarks can be found in the TAMP FO-DA section in the Contents menu. More details can be found in this paper. Our approach was to start with a set of problems which can be handled by the largest number of existing systems, by identifying the least common denominator for requirements and problem specification, at logical and geometric levels.

However, since TAMP covers a wide range of problems, it was not possible to come up with a set of benchmarks for all types of TAMP problems. Therefore the Contents of the wiki is organized according to subclasses of TAMP. If you find the assumptions and requirements for TAMP FO-DA incompatible with the type of problems you are interested in, please contribute by creating your own benchmark set in the Contents section. Candidate subclasses are suggested:

Contents

How to use this wiki

  • This page is powered by MediaWiki, you can find instructions for editing pages here.
  • Do not modify a page for which you have not taken part in discussions.
  • Do not create a benchmark set on your own: this has to be a collaborative work involving other researchers.
  • For discussions, use the wiki "Discussion" tab, or set up a discussion thread, by creating a page and adding the following code at the top: {{#useliquidthreads:1}} (see for example this page)
  • Note that there is an Atom feed for each discussion page (left menu) you can subscribe to for getting updated with new replies. You can adjust your preferences (top right menu) for getting notified by email.

Contact

If you want to contribute to this wiki, contact me at fabien[dot]lagriffoul[at]oru[dot]se and I'll create an account for you.

Contributors

  • TAMP FO-DA:

Fabien Lagriffoul (Orebro University, Sweden.)
Neil T. Dantam (Colorado School of Mines, USA)
Caelan Garrett (Massachusetts Institute of Technology, USA)
Ali Akbari (Tech. U. of Catalonia, Spain)
Siddharth Srivastava (Arizona State University, USA)

Support

This initiative is supported by the Swedish Knowledge Foundation (KKS) project Semantic Robots. It is also supported by NSF grants IIS 1317849 and CCF-1514372 to the Kavraki Lab at Rice University, USA.

RSS Workshops