Metrics

From Tamp Benchmarking
Revision as of 19:08, 8 January 2017 by Flladmin (talk | contribs) (Created page with "* Planning time (not for comparing systems, but for evaluating scalability) * Success rate, over randomized problem instances * Plan quality. Here, several options to discuss:...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search
  • Planning time (not for comparing systems, but for evaluating scalability)
  • Success rate, over randomized problem instances
  • Plan quality. Here, several options to discuss:
    • symbolic: plan length
    • geometric: plan length (in WS, CS?), safety margins, etc.
  • #calls to the motion planner


To begin with, I suggest to limit the quality measure to (i) symbolic plan length and (ii) geometric plan length in the CS.