Optimal calibration of a prism-based videoendoscopic system for precise 3D measurements

Автор: Gorevoy Alexey Vladimirovich, Machikhin Alexander Sergeevich

Журнал: Компьютерная оптика @computer-optics

Рубрика: Image processing, pattern recognition

Статья в выпуске: 4 т.41, 2017 года.

Бесплатный доступ

Modern videoendoscopes are capable of performing precise three-dimensional (3D) measurements of hard-to-reach elements. An attachable prism-based stereo adapter allows one to register images from two different viewpoints using a single sensor and apply stereoscopic methods. The key condition for achieving high measurement accuracy is the optimal choice of a mathematical model for calibration and 3D reconstruction procedures. In this paper, the conventional pinhole camera models with polynomial distortion approximation were analyzed and compared to the ray tracing model based on the vector form of Snell’s law. We, first, conducted a series of experiments using an industrial videoendoscope and utilized the criteria based on the measurement error of a segment length to evaluate the mathematical models considered. The experimental results confirmed a theoretical conclusion that the ray tracing model outperforms the pinhole models in a wide range of working distances. The results may be useful for the development of new stereoscopic measurement tools and algorithms for remote visual inspection in industrial and medical applications.

Еще

Remote visual inspection, 3d spatial measurements, camera calibration, distortion model, prism distortion

Короткий адрес: https://sciup.org/140228640

IDR: 140228640   |   DOI: 10.18287/2412-6179-2017-41-4-535-544

Список литературы Optimal calibration of a prism-based videoendoscopic system for precise 3D measurements

  • Mix, P.E. Introduction to nondestructive testing: A training guide/P.E. Mix. -2nd ed. -New York: John Wiley & Sons, 2005. -712 p. -ISBN: 978-0-471-42029-3.
  • Zhu, Y.-K. A review of optical NDT technologies/Y.-K. Zhu, G.-Y. Tian, R.-S. Lu, H. Zhang//Sensors. -2011. -Vol. 11, Issue 8. -P. 7773-7798. - DOI: 10.3390/s110807773
  • Olympus Corp. Demonstration of stereo measurement . -URL: http://www.olympus-ims.com/en/rvi-products/iplex-fx/demo-stereo-measurement/.
  • Hartley, R.I. Multiple view geometry in computer vision/R.I. Hartley, A. Zisserman. -2nd ed. -Cambridge: Cambridge University Press, 2004. -670 p. -ISBN: 978-0-521-54051-3.
  • Kannala, J. A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses/J. Kannala, S.S. Brandt//IEEE Transactions on Pattern Analysis and Machine Intelligence. -2006. -Vol. 28, Issue 8. -P. 1335-1340. - DOI: 10.1109/TPAMI.2006.153
  • Handbook of 3D machine vision: Optical metrology and imaging/ed. by S. Zhang. -Boca Raton, Fl: CRC Press, 2016. -414 p. -ISBN 978-1-138-19957-6.
  • Lee, D. A novel stereo camera system by a biprism/D. Lee, I. Kweon//IEEE Transactions on Robotics and Automation. -2000. -Vol. 16, Issue 5. -P. 528-541. - DOI: 10.1109/70.880803
  • Xiao, Y. Virtual stereovision system: New understanding on single-lens stereovision using a biprism/Y. Xiao, K.B. Lim//Journal of Electronic Imaging. -2005. -Vol. 14, Issue 4. -043020. - DOI: 10.1117/1.2137654
  • Xiao, Y. A prism-based single-lens stereovision system: From trinocular to multi-ocular/Y. Xiao, K.B. Lim//Image and Vision Computing. -2007. -Vol. 25, Issue 11. -P. 1725-1736. - DOI: 10.1016/j.imavis.2007.01.002
  • Wang, D. Geometrical approach for rectification of single-lens stereovision system with a triprism/D. Wang, K.B. Lim, W.L. Kee//Machine Vision and Applications. -2013. -Vol. 24, Issue 4. -P. 821-833. - DOI: 10.1007/s00138-012-0467-8
  • Kee, W.L. New understanding on the effects of angle and position of biprism on single-lens biprism stereovision system/W.L. Kee, K.B. Lim, Z.L. Tun, B. Yading//Journal of Electronic Imaging. -2014. -Vol. 23, Issue 3. -033005. - DOI: 10.1117/1.JEI.23.3.033005
  • Kee, W.L. Parameter error analysis of singlelens prism-based stereovision system/W.L. Kee, Y. Bai, K.B. Lim//Journal of the Optical Society of America A. -2015. -Vol. 32, Issue 3. -P. 367-373. - DOI: 10.1364/JOSAA.32.000367
  • Cui, X. Accurate geometrical optic model for single-lens stereovision system using a prism/X. Cui, K.B. Lim, Q. Guo, D. Wang//Journal of the Optical Society of America A. -2012. -Vol. 29, Issue 9. -P. 1828-1837. - DOI: 10.1364/JOSAA.29.001828
  • Wu, L. A modified virtual point model of the 3D dic technique using a single camera and a bi-prism/L. Wu, J. Zhu, H. Xie//Measurement Science and Technology. -2014. -Vol. 25. -115008. - DOI: 10.1088/0957-0233/25/11/115008
  • Wu, L. Single-lens 3D digital image correlatio system based on a bilateral telecentric lens and a bi-prism: validation and application/L. Wu, J. Zhu, H. Xie//Applied Optics. -2015. -Vol. 54, Issue 26. -P. 7842-7850. - DOI: 10.1364/AO.54.007842
  • Zhang, Z. Flexible camera calibration by viewing a plane from unknown orientations/Z. Zhang//Proceedings of the International Conference on Computer Vision. -1999. -P. 666-673.
  • Cui, X. Single-lens stereovision system using a prism: position estimation of a multi-ocular prism/X. Cui, K.B. Lim, Y. Zhao, W.L. Kee//Journal of the Optical Society of America A. -2014. -Vol. 31, Issue 5. -P. 1074-1082. - DOI: 10.1364/JOSAA.31.001074
  • Cui, X. Perspective projection model for prism-based stereovision/X. Cui, Y. Zhao, K. Lim, T. Wu//Optics Express. -2015. -Vol. 23, Issue 21. -P. 27542-27557. - DOI: 10.1364/OE.23.027542
  • Lim, K.B. Biprism distortion modeling and calibration for a single-lens stereovision system/K.B. Lim, B. Qian//Journal of the Optical Society of America A. -2016. -Vol. 33, Issue 11. -P. 2213-2224. - DOI: 10.1364/JOSAA.33.002213
  • Qian, B. Image distortion correction for single-lens stereo vision system employing a biprism/B. Qian, K.B. Lim//Journal of Electronic Imaging. -2016. -Vol. 25, Issue 4. -043024. - DOI: 10.1117/1.JEI.25.4.043024
  • Genovese, K. Stereo-digital image correlation (DIC) measurements with a single camera using a biprism/K. Genovese, L. Casaletto, J. Rayas, V. Flores, A. Martinez//Optics and Lasers in Engineering. -2013. -Vol. 51, Issue 3. -P. 278-285. - DOI: 10.1016/j.optlaseng.2012.10.001
  • U.S. Patent 7,564,626 G 02 B 27/22, 359/462, 600/101, 382/128. Stereo-measurement borescope with 3-D viewing/C. Bendall, R. Lia, J. Salvati, T. Chilek, filed of December 18, 2006, published of Jule 21, 2009.
  • U.S. Patent 8,979,743 A 61 B 1/06, A 61 B 1/00, 600/172. Endoscope device and endoscopi image distortion correction method/S. Nakano, F. Hori, K. Ogawa, filed of Jule 7, 2008, published of March 17, 2015.
  • Takata, Y. Distortion correction of wedge prism 3D endoscopic images/Y. Takata, T. Torigoe, E. Kobayashi, I. Sakuma//Proceedings of the 7th Asian-Pacific Conference on Medical and Biological Engineering (APCMBE 2008). -2008. -P. 750-753. - DOI: 10.1007/978-3-540-79039-6_185
  • Machikhin, A.S. Calibration of miniature prism-based stereoscopic imagers for precise spatial measurements/A.S. Machikhin, A.V. Gorevoy//Proceedings of SPIE. -2015. -Vol. 9917. -991707. - DOI: 10.1117/12.2229837
  • Machikhin, A.S. Accuracy evaluation for the non-contact area defect measurement at the complex shape-surfaces under videoendoscopic control/A.S. Machikhin, A.V. Gorevoy, A.M. Perfilov//Scientific and Technical Journal of Information Technologies, Mechanics and Optics. -2014. -Vol. 14. -P. 140-148. -.
  • Wu, C. A full geometric and photometric calibration method for oblique-viewing endoscope/C. Wu, B. Jaramaz, S. Narasimhan//Computer Aided Surgery: Official Journal of the International Society for Computer Aided Surgery. -2010. -Vol. 15, Issue 1-3. -P. 19-31. - DOI: 10.3109/10929081003718758
  • Brown, D.C. Decentering distortion of lenses/D.C. Brown//Photometric Engineering. -1966. -Vol. 32. -P. 444-462.
  • Kanatani, K. Statistical optimization for geometric computation: Theory and practice/K. Kanatani. -Mineola: Dover Publications, 2005. -526 p. -ISBN: 978-0486443089.
  • Mallon, J. Which pattern? Biasing aspects of planar calibration patterns and detection methods/J. Mallon, P.F. Whelan//Pattern Recognition Letters. -2007. -Vol. 28, Issue 8. -P. 921-930. - DOI: 10.1016/j.patrec.2006.12.008
Еще
Статья научная