Leaderboards

Want to submit a benchmarking asset to be listed? Use this Google form: https://forms.gle/LHrtmDpm82X4qrDk6 

This page is under construction! 

We are building a repository of benchmarking assets for robot manipulation. Below is a draft mock-up while we design how the repository will be organized. Help us build it! Use the Google form linked above to submit a benchmarking asset or give us feedback on how it's organized by joining the COMPARE Slack workspace linked at the bottom of the page!

Relevant COMPARE Slack Channel: #benchmarking_leaderboards

Each of these leaderboards are comprised of performance metrics derived from experiments using a benchmarking protocol along with other benchmarking assets like standard objects, tools, and datasets, many of which are included in the benchmarking repositories. When available, open-source products from the software components or hardware designs repositories used in the score are also cataloged on the leaderboard.