question about camera calibration in real world about rvt

[imankgoyal]

Hi @FinnJob,

Thanks for your kind words.

In our real world experiments we just use one camera. We calibrate the robot-camera extrinsics and transform the perceived point clouds to the robot base frame. In the robot base frame, the robotic arm is front.

For two cameras, you could potentially calibraate each one of them wrt to the robot base frame.

For questions about the software we use for calibrating wrt to the robot base frame, @ychao-nvidia might be the best person.

Best,
Ankit

[FinnJob]

Thank you for your replay. It helps a lot!

[FinnJob]

May I ask what camera you are using for implementation? Currently, we are using the RealSense camera, but the accuracy decreases when the distance exceeds 50cm. Do you have any suggestions?

[imankgoyal]

We used an Azure Kinect camera. Every camera will have a range where the point cloud is reasonable. We found Azure Kinect to be good for our setup.

[FinnJob]

OK. Thank you for your replay.

[FinnJob]

When conducting landing experiments with UR3, we have encountered an issue where commanding the robotic arm to traverse a list of TCP poses sometimes leads to unexpected solutions. This results in significant joint changes, deviating from the expected motion as seen in the simulation environment. Could you provide insights on how you have addressed or mitigated this problem in your setup? We are seeking guidance on achieving more consistent and predictable execution of actions on the robotic arm in a real-world scenario, similar to the behavior observed in the simulation environment. Any advice or recommendations would be greatly appreciated. Thank you.

[imankgoyal]

Unfortunately, I have not used UR3, so I am unable to help here. For our experiments we used Franka and we used Frankapy to move the robot to specific poses.

[imankgoyal]

Closing because of inactivity.