Benchmarking Robot Manipulation Leaderboards
SceneReplica
Protocol citation: Khargonkar, Ninad, Sai Haneesh Allu, Yangxiao Lu, Balakrishnan Prabhakaran, and Yu Xiang. "SceneReplica: Benchmarking Real-World Robot Manipulation by Creating Replicable Scenes." In 2024 IEEE International Conference on Robotics and Automation (ICRA), pp. 8258-8264. IEEE, 2024. https://doi.org/10.1109/ICRA57147.2024.10610180Â
Project link: https://irvlutd.github.io/SceneReplica/
To sort and organize the repositories, open them in Google Spreadsheets by clicking the "Open Spreadsheets" icon in the top-right that appears when you hover over the sheet below, then use the drop-down menus along the top to find what you need.
SceneReplica Leaderboard
Performance Metrics: Pick-and-Place Success, Grasping Success; Benchmarking Information: Picking Order, Environment, Objects and Artifacts, Tools and Testbeds; Robot Software Configuration: Perception, Perception GitHub, Grasp Planner, Grasp Planner GitHub, Motion Planner, Motion Planner GitHub, Control, Control GitHub; Robot Hardware Configuration: Arm, Arm DOF, End Effector, End Effector Type, Sensor(s), Sensor Type(s), Sensor Perspective(s); Source: Link(s), Citation
