Towards Improving Open-Source and Benchmarking for Robot Manipulation
Home of the Collaborative Open-source Manipulation Performance Assessment for Robotics Enhancement (COMPARE) Ecosystem
🤖 Announcements and Upcoming Events 🤖
The 10th Robotic Grasping and Manipulation Competition at ICRA 2025: There will be four competition tracks at the upcoming RGMC to be held at ICRA 2025: Simulation-Sorting Manipulation Track, In-Hand Manipulation Track, Picking in Clutter Track, and Human-to-Robot Handover Track.  🤖 LINK 🤖Â
COMPARE Workshop on Benchmarking Robot Manipulation at RSS 2025: We will be hosting a full-day workshop at RSS 2025, "Benchmarking Robot Manipulation: Improving Interoperability and Modularity," one of several activities aimed at developing and activating the ecosystem.  🤖 LINK 🤖Â
COMPARE Summer School Cooperative Hackathon and Benchmarking Exercise: We will be hosting a 1-week summer school with participants from the international robot manipulation community with software components to contribute. More event details and application process coming soon!  🤖 TBD 🤖Â
This website is under construction!Â
Help us build it! Use these Google forms to submit open-source products, benchmarking assets, and events. Give us feedback on how the website is organized, what is missing, and how we can improve it. Join the COMPARE Slack Workspace or Google Group linked below and get in touch!
The COMPARE ecosystem aims to create a greater cohesion between open-source products that improves the modularity of open-source components in the robot manipulation pipeline for more effective performance benchmarking. COMPARE seeks to unite the existing community of users and developers to build upon and integrate existing open-source products as well as improve and evolve the future of robot manipulation research. This is achieved through the generation of community-driven standards for components of software pipelines, benchmarking practices, objects, datasets, and hardware designs.Â
To get involved, join the COMPARE Slack, participate in community discussions, attend events, and check out our continually evolving online resources!
Contact
If you are interested in contributing to the development of the COMPARE open-source ecosystem or have any questions or comments, please e-mail Adam Norton at adam_norton@uml.edu, or direct message him in the COMPARE Slack workspace.