Difference between revisions of "Metrics"

From Tamp Benchmarking
Jump to: navigation, search
m (Protected "Metrics" ([Edit=Allow only administrators] (indefinite) [Move=Allow only administrators] (indefinite)))
 
Line 1: Line 1:
* Planning time (not for comparing systems, but for evaluating scalability)
+
* Total planning time
 
* Success rate, over randomized problem instances
 
* Success rate, over randomized problem instances
* Plan quality. Here, several options to discuss:
+
* Plan quality:
 
** symbolic: plan length
 
** symbolic: plan length
** geometric: plan length (in WS, CS?), safety margins, etc.
+
** geometric: plan length in CS
 
* #calls to the motion planner
 
* #calls to the motion planner
 
   
 
To begin with, I suggest to limit the quality measure to (i) symbolic plan length and (ii) geometric plan length in the CS.
 

Latest revision as of 10:01, 23 May 2018

  • Total planning time
  • Success rate, over randomized problem instances
  • Plan quality:
    • symbolic: plan length
    • geometric: plan length in CS
  • #calls to the motion planner