Difference between revisions of "Metrics"
From Tamp Benchmarking
(Created page with "* Planning time (not for comparing systems, but for evaluating scalability) * Success rate, over randomized problem instances * Plan quality. Here, several options to discuss:...") |
m (Protected "Metrics" ([Edit=Allow only administrators] (indefinite) [Move=Allow only administrators] (indefinite))) |
(No difference)
| |
Revision as of 22:50, 8 January 2017
- Planning time (not for comparing systems, but for evaluating scalability)
- Success rate, over randomized problem instances
- Plan quality. Here, several options to discuss:
- symbolic: plan length
- geometric: plan length (in WS, CS?), safety margins, etc.
- #calls to the motion planner
To begin with, I suggest to limit the quality measure to (i) symbolic plan length and (ii) geometric plan length in the CS.
