Difference between revisions of "Main Page"

From Tamp Benchmarking
Jump to: navigation, search
(About this Wiki)
 
(28 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
== About this Wiki ==
 
== About this Wiki ==
  
Following the discussions at the TAMP workshop in RSS2016, a discussion group (see ''Contributors'' below) about TAMP benchmarking was created to come up with a set of benchmark problems for TAMP. Our discussions and the resulting benchmarks can be found in the ''TAMP FO-DA'' section. A paper is also available [https://www.mediawiki.org/wiki/Help:Editing_pages|here].
+
Following the RSS2016 TAMP workshop, a discussion group (see ''Contributors'' below) was created to come up with a methodology and a set of benchmark problems for TAMP. Our discussions and the actual benchmarks can be found in the '''TAMP FO-DA''' section in the ''Contents'' menu. More details can be found in [https://ieeexplore.ieee.org/document/8411475/ this paper]. Our approach was to start with a set of problems which can be handled by the largest number of existing systems, by identifying the least common denominator for requirements and problem specification, at logical and geometric levels.
  
My proposal is to '''start with a set of simple benchmark problems, which can be handled by the largest number of existing systems.''' This requires to identify the least common denominator, in terms of requirements and problem specification, at logical and geometric levels.
+
However, since TAMP covers a wide range of problems, it was not possible to come up with a set of benchmarks for '''all''' types of TAMP problems. Therefore the ''Contents'' of the wiki is organized according to '''subclasses''' of TAMP. If you find the assumptions and requirements for ''TAMP FO-DA'' incompatible with the type of problems you are interested in, please contribute by creating your own benchmark set in the ''Contents'' section. Candidate subclasses are suggested:
 
 
These requirements will be extended later on, but in order to reach a “critical mass” so that enough people start using these benchmarks and disseminate them through their publications, we need to begin with something simple and accessible.
 
  
 
== Contents ==
 
== Contents ==
* [[TAMP_FO-DA|TAMP FO-DA : Fullly Observable, Deterministic Actions]]
+
* [[TAMP_FO-DA|'''TAMP FO-DA''': Fullly Observable, Deterministic Actions]]
* [[TAMP_PO-NDA|TAMP PO-NDA : Partially Observable, Non Deterministic Actions]]
+
* [[TAMP_PO-NDA|'''TAMP PO-NDA''': Partially Observable, Non Deterministic Actions]] - '''TODO'''
* [[TAMP_MP|TAMP MP : Manipulation Planning (no symbolic planning)]]
+
* [[TAMP_MP|'''TAMP MP''': Manipulation Planning (no symbolic planning)]] - '''TODO'''
* [[TAMP_PH|TAMP Physics : Handling frictions (push-pull), gravity (building stable structures), dynamics]]
+
* [[TAMP_PH|'''TAMP Physics''': Handling frictions (push-pull), gravity (building stable structures), dynamics]] - '''TODO'''
 
* Create your own...
 
* Create your own...
  
== How to edit this document ==
+
== How to use this wiki ==
  
* The sections of the original document correspond to the different pages below (Contents and Discussions).
+
* This page is powered by MediaWiki, you can find instructions for editing pages [https://www.mediawiki.org/wiki/Help:Editing_pages here].
* In the Contents section, the comments have been pasted in the Discussion pages, in the form of discussion threads.
+
* Do not modify a page for which you have not taken part in discussions.
* If you think an important issue is overlooked, create a TODO item or reply to the thread (this should generate a New Message in each contributor's message box in the top-right menu).
+
* Do not create a benchmark set on your own: this has to be a collaborative work involving other researchers.
* Note that there is an Atom feed for each discussion page (left menu) you can subscribe to for getting updated with new replies. You can also adjust your preferences (top right menu) for getting notified by email.
+
* For discussions, use the wiki "Discussion" tab, or set up a discussion thread, by creating a page and adding the following code at the top: <nowiki>{{#useliquidthreads:1}}</nowiki> (see for example [[Comments_from_Neil|this page]])
* If you think that an issue has been resolved, feel free to remove the thread / TODO and update the corresponding page.
+
* Note that there is an Atom feed for each discussion page (left menu) you can subscribe to for getting updated with new replies. You can adjust your preferences (top right menu) for getting notified by email.
* Syntax for signature: <nowiki>--~~~~</nowiki>
 
 
 
 
 
In order to add a new discussion topic, proceed as follow:
 
 
 
# Edit the side bar menu: http://tampbenchmark.aass.oru.se/index.php?title=MediaWiki:Sidebar
 
# Add the following at the end (in Discussions): <nowiki>**</nowiki> my_new_discussion_topic|My new discussion topic (replace with your actual topic)
 
# Save your changes.
 
# It should appear in the side menu. Click on it: the page does not exist, create it. Done.
 
# If you want this page to be a discussion thread itself, add the following code and save it : <nowiki>{{#useliquidthreads:1}}</nowiki>
 
  
 
== Contact ==
 
== Contact ==
If you want to join the discussion group, contact me at fabien[dot]lagriffoul[at]oru[dot]se.
+
If you want to contribute to this wiki, contact me at fabien[dot]lagriffoul[at]oru[dot]se and I'll create an account for you.
  
 
== Contributors ==
 
== Contributors ==
 +
* '''TAMP FO-DA''':
 
''Fabien Lagriffoul'' (Orebro University, Sweden.) <br />
 
''Fabien Lagriffoul'' (Orebro University, Sweden.) <br />
 
''Neil T. Dantam'' (Colorado School of Mines, USA) <br />
 
''Neil T. Dantam'' (Colorado School of Mines, USA) <br />
Line 46: Line 35:
  
 
== RSS Workshops ==
 
== RSS Workshops ==
*2017: [http://www.kavrakilab.org/2017-rss-workshop/ Task and Motion Planning RSS 2017]
+
* 2018: [http://www.neil.dantam.name/2018/rss-tmp-workshop/ Exhibition and Benchmarking of Task and Motion Planners RSS 2018]
*2016: [http://www.kavrakilab.org/2016-rss-workshop/ Task and Motion Planning RSS 2016]
+
* 2017: [http://www.kavrakilab.org/2017-rss-workshop/ Task and Motion Planning RSS 2017]
 
+
* 2016: [http://www.kavrakilab.org/2016-rss-workshop/ Task and Motion Planning RSS 2016]
== References ==
 

Latest revision as of 10:44, 18 July 2018

About this Wiki

Following the RSS2016 TAMP workshop, a discussion group (see Contributors below) was created to come up with a methodology and a set of benchmark problems for TAMP. Our discussions and the actual benchmarks can be found in the TAMP FO-DA section in the Contents menu. More details can be found in this paper. Our approach was to start with a set of problems which can be handled by the largest number of existing systems, by identifying the least common denominator for requirements and problem specification, at logical and geometric levels.

However, since TAMP covers a wide range of problems, it was not possible to come up with a set of benchmarks for all types of TAMP problems. Therefore the Contents of the wiki is organized according to subclasses of TAMP. If you find the assumptions and requirements for TAMP FO-DA incompatible with the type of problems you are interested in, please contribute by creating your own benchmark set in the Contents section. Candidate subclasses are suggested:

Contents

How to use this wiki

  • This page is powered by MediaWiki, you can find instructions for editing pages here.
  • Do not modify a page for which you have not taken part in discussions.
  • Do not create a benchmark set on your own: this has to be a collaborative work involving other researchers.
  • For discussions, use the wiki "Discussion" tab, or set up a discussion thread, by creating a page and adding the following code at the top: {{#useliquidthreads:1}} (see for example this page)
  • Note that there is an Atom feed for each discussion page (left menu) you can subscribe to for getting updated with new replies. You can adjust your preferences (top right menu) for getting notified by email.

Contact

If you want to contribute to this wiki, contact me at fabien[dot]lagriffoul[at]oru[dot]se and I'll create an account for you.

Contributors

  • TAMP FO-DA:

Fabien Lagriffoul (Orebro University, Sweden.)
Neil T. Dantam (Colorado School of Mines, USA)
Caelan Garrett (Massachusetts Institute of Technology, USA)
Ali Akbari (Tech. U. of Catalonia, Spain)
Siddharth Srivastava (Arizona State University, USA)

Support

This initiative is supported by the Swedish Knowledge Foundation (KKS) project Semantic Robots. It is also supported by NSF grants IIS 1317849 and CCF-1514372 to the Kavraki Lab at Rice University, USA.

RSS Workshops