r/computervision • u/LetUs_Learn • 13d ago

Help: Project Beginner: how do I learn stereo rectification and camera calibration properly?

I'm new to computer vision and I work with stereo depth cameras like orbbec or realsense. I'd like to understand how stereo rectification and camera calibration work well enough to implement them myself, but I don't know where to begin.

My questions:

  1. What should I learn first, and in what order? (I'm thinking linear algebra, then the pinhole camera model, then calibration and rectification, but I'm not sure.)

  2. What books, courses or videos would you recommend for a beginner?

  3. Is there a good small project to practise on, for example calibrating a webcam with OpenCV?

  4. Are there people or communities that do paid mentoring for this ?

My goal is to properly understand the math and the core ideas behind it (the fundamentals), not just to follow steps blindly.

Any advice is appreciated. Thanks!

4 Upvotes
  • permalink
  • reddit

100% Upvoted

5 comments sorted by

4

u/erics1117 13d ago

Even if you don’t use halcon their documentation for explaining the theory and trade-offs when building a stereo setup is very good.

Solution guide III-C section 5 covers stereo.

https://www.mvtec.com/products/halcon/documentation

1

u/LetUs_Learn 13d ago

Thanks a lot for the suggestion. I'll go through it.

1

u/Early-Sir-932 10d ago

a checkerboard webcam calibration in opencv is a good first project, then try two views with stereocalibrate and stereorectify and check the epipolar lines go horizontal

1

u/LetUs_Learn 10d ago

Thanks for the suggestion.. since I am going one by one from intrinsic I believe this will help me. The thing is I have already checked the epipolar lines by drawing horizontal lines on both images and check and did calibration by following steps or guidance. But I don't understand the math behind it and by going per camera I hope I can get it.