Object detection using Sawyer Camera for the Pick and Place Operation

[Joshua Sebastian]

Hi,

I need help in doing a simple pick and place task with the Sawyer robot in the Gazebo simulator. I tried the IK pick and place script which was provided but the gripper always used to miss pick the cube. Is there a way to integrate the OpenCV with the IK pick and place script so that the robot can detect the objects kept on a table and perform the operation in the right manner. Also, is there a way that the edge detection algorithm can be used for the pick and place operation? Please let me know of the resources, methodologies or scripts available for testing purposes. I also want to know if its possible to use a kinect sensor to help the robot in the pick and place operation.

Thanks!