Stereographic calibration on wide view cameras

I am using stereo cameras that are wide veiw (120 degrees). Orginially I calibrated using a checkerboard in the stereo camera App on matlab (https://www.mathworks.com/help/vision/ug/using-the-stereo-camera-calibrator-app.html) and thought everything went well:

That is until I began the deoth estimation process (https://www.mathworks.com/help/vision/ug/depth-estimation-from-stereo-video.html). I encounted a problem during the video rectification process:

As you can see the anaglyph is extremely distorted.

My next thoughts were to calibrate the cameras individualy using the fisheye calibration and take those parameters and upload them into the script from the stereo calibration, but I have been running into errors and right now it seems the fisheye parameters are not compatable with the stereo app. Is there any suggestions? Am I going about this in thw wrong way?

Thank you!!!

Answer 1

[Giridharan Kumaravelu]

Here are some issues in your workflows based on the information provided in your question:

Initial Stereo Camera Calibration:

Although the calibration appears to have gone well in the app, the calibration images do not follow the best practices mentioned in the documentation. Specifically, the checkerboard does not fill the images sufficiently to capture the effects of lens distortion. Consider capturing the calibration images again, this time placing the checkerboard closer to the camera and following all the best practices outlined on the aforementioned page.

Stereo Fisheye Camera Calibration:

Using fisheye parameters is currently not supported in the Stereo Camera Calibrator app. The following example demonstrates how to perform this calibration outside the app: https://www.mathworks.com/help/releases/R2025a/vision/ug/stereo-fisheye-camera-calibration.html

I recommend resorting to stereo fisheye camera calibration only if the results from the app remain inaccurate after recollecting the data. Ultimately, your calibration is only as good as your calibration data.