Software package for estimation of the stereo camera calibration error in the computer vision system

A.Ye. Vitiuk, A.Yu. Doroshenko

Abstract


The approach for accuracy assessment of the object model a for the problem of stable grasping in the combined system of the proposal of grasping and the reconstruction of the three-dimensional model of the object was considered. Such a combined system allows stable capture of objects of any shape without restrictions on the types of shapes in the training data set. Novel approaches to surface reconstruction of the object are based on restoring the depth of points from a pair of images from two cameras. The quality of the 3D reconstruction is affected by several factors: the movement of the camera and environmental objects, spatial quantization of the image coordinates, correspondence of key points, camera calibration parameters, unaccounted camera distortions, as well as numerical and statistical properties of the selected reconstruction method. Camera parameter errors can be minimized by improving the calibration procedure, so the impact of errors on the quality of the 3D model was investigated. The deviation of the model from the plane is chosen as a metric for quality assessment. For its calculation, the point cloud is processed by plane identification and segmentation, for which an algorithm based on the RANSAC method is considered. The software package for accuracy estimation was developed. An experiment was conducted to obtain the dependence of the accuracy of the reconstructed planes on the errors of the camera parameters. The impact of calibration errors on 3D reconstruction was evaluated by comparing metrics for individual planes at different levels of artificial error and evaluating the impact of the error on these metrics. Modeling the error of the camera calibration parameters with a given noise level shows that the calibration parameters deteriorate as the noise level increases. In particular, it was established that an increase in error contributes to an increase in the error of estimation of calibration parameters. In addition, orientation parameters (rotation and translation) are more complex and therefore more sensitive to measurement noise than other parameters.

Prombles in programming 2022; 3-4: 469-477


Keywords


three-dimensional reconstruction; camera calibration; stable grip; point cloud; manipulator robot; mobile robot

Full Text:

PDF (Ukrainian)

References


Gesture simulator programming using statistical modeling / A.Yu. Doroshenko, O.C. Novak // Problems of programming. — 2015. — No. 1. — P. 58-64

K. He, X. Zhang, S. Ren and J. Sun, «Deep Residual Learning for Image Recognition,» 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 770-778, doi: 10.1109/CVPR.2016.90.

Sundermeyer, Martin & Mousavian, Arsalan & Triebel, Rudolph & Fox, Dieter. (2021). Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenes.

Zeng, Andy & Song, Shuran & Yu, Kuan-Ting & Donlon, Elliott & Hogan, Francois & Bauza, Maria & Ma, Daolin & Taylor, Orion & Liu, Melody & Romo Grau, Eudald & Fazeli, Nima & Alet, Ferran & Dafle, Nikhil & Holladay, Rachel & Morena, Isabella & Nair, Prem & Green, Druck & Taylor, Ian & Liu, Weber & Rodriguez, Alberto. (2018). Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matching. 1-8. 10.1109/ICRA.2018.8461044.

Staub, Benno & Tanwani, Ajay & Mahler, Jeffrey & Breyer, Michel

& Laskey, Michael & Takaoka, Yutaka & Bajracharya, Max & Siegwart, Roland & Goldberg, Kenneth. (2019). Dex-Net MM: Deep Grasping for Surface Decluttering with a Low-Precision Mobile Manipulator. 1373-1379. 10.1109/COASE.2019.8842901.

A. E. Vitiuk, Y. I. Kornaga, A. O. Barabash. Capturing unknown objects by a mobile robot using visual information, Scientific notes of

V. I. Vernadskyi Tavra National University. Series: Technical sciences. - 2018. - Vol. 29(68), No. 1(1). - P. 93-98

D. Yang, T. Tosun, B. Eisner, V. Isler and D. Lee, «Robotic Grasping through Combined Image-Based Grasp Proposal and 3D Reconstruction,» 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 6350-6356, doi: 10.1109/ ICRA48506.2021.9562046

Xu, Bo & Chen, Zhen & Zhu, Qing & Ge, Xuming & Huang, Shengzhi & Zhang, Yeting & Liu, Tianyang & Wu, Di. (2022). Geometrical Segmentation of Multi-Shape Point Clouds Based on Adaptive Shape Prediction and Hybrid Voting RANSAC. Remote Sensing. 14. 2024. 10.3390/rs14092024.


Refbacks

  • There are currently no refbacks.