SIA OpenIR  > 广州中国科学院沈阳自动化研究所分所
Alternative TitleSpatial calibration of thermal imager-RGB camera-IMU Sensor
王鑫1; 李伟1; 曾子铭2; 张吟龙3,4
Source Publication仪器仪表学报
Indexed ByEI
EI Accession number20210509835473
Contribution Rank3
Funding Organization国家科技重大专项(2017ZX02101007-004) ; 国家自然科学基金(61903357、61821005) ; 辽宁省自然科学基金(2020-MS-032) ; 中国博士后科学基金(2020M672600) ; 辽宁省博士启动基金 (20170520444) ; 辽宁省教育厅科研项目(lnjc202013) ; 广东省基础与应用基础研究基金项目(2020A1515010584)
Keyword热像仪 RGB相机 惯性测量单元 联合标定 混和高斯模型

热像仪、RGB相机、惯性测量单元(inertial measurement unit, IMU)在图像模态、感知精度和响应速度方面具有异质和互补的特性,在机器人和计算机视觉领域受到越来越多的关注。在热像仪、RGB相机和IMU传感器之间进行准确的标定是实现三者有效融合必不可少的过程。为此,本文提出了一种空间联合标定方法,将热像仪、RGB相机和IMU坐标系之间的空间关系关联在一起。为了保证联合标定的一致性,在棋盘格的角点处分别固定尺寸相同、直径约5mm的LED阵列,作为热像仪的标定板。在提取热像仪标定图像光源中心环节,本文采用混合高斯模型来提取标定位置信息,以此来保证LED光源部分缺失情况下鲁棒的位置估计。再建立目标优化函数,优化热像仪图像中提取的热源中心重投影误差、RGB图像中提取的棋盘角角点重投影误差、加速度和角速度误差来联合估计外参。实验环节,在搭建的热像仪-RGB相机-IMU多模态感知平台,采集了大量的实验数据,对所收集的热像仪-RGB相机-IMU测量结果进行了深入分析,可靠且准确的空间标定结果验证了所提方法的有效性。

Other Abstract

Thermal imager, RGB camera, and inertial measurement unit (IMU) are heterogeneous and complementary in terms of image modality, sensing accuracy and response speed. They have attracted increasing attention in the fields of robotics and computer vision. To effectively integrate the thermal imager, RGB camera and IMU, the accurate spatial calibration among sensors is an indispensable process. In this study, a joint spatial calibration method is proposed to correlate the spatial relationship among thermal imager, RGB camera and IMU. To ensure the consistency of the joint calibration, LED bulb arrays with the same size and about 5mm diameter are fixed at the corner points of the checkerboard, which are used as the calibration board of thermal imager. In the process of extracting the center of the image light source for the calibration of the thermal imager, this paper uses the Gaussian mixture model to achieve calibration position information, which can ensure robust position estimation in the case of partial missing LED light sources. The extrinsic parameters are estimated by jointly optimizing both the chessboard corner reprojection errors and acceleration & angular velocity error terms. In the experiment, a large amount of experimental data are collected through the built-up thermal imager-RGB camera-IMU sensing platform. The collected thermal imager-RGB camera-IMU measurement results are analyzed in depth. Reliable and accurate spatial calibration results verify the effectiveness of the proposed method.

Document Type期刊论文
Corresponding Author曾子铭
Recommended Citation
GB/T 7714
王鑫,李伟,曾子铭,等. 热像仪-RGB相机-IMU传感器的空间联合标定方法[J]. 仪器仪表学报,2020,41(11):216-225.
APA 王鑫,李伟,曾子铭,&张吟龙.(2020).热像仪-RGB相机-IMU传感器的空间联合标定方法.仪器仪表学报,41(11),216-225.
MLA 王鑫,et al."热像仪-RGB相机-IMU传感器的空间联合标定方法".仪器仪表学报 41.11(2020):216-225.
Files in This Item:
File Name/Size DocType Version Access License
热像仪_RGB相机_IMU传感器的空间联(7158KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Application Full Text
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[王鑫]'s Articles
[李伟]'s Articles
[曾子铭]'s Articles
Baidu academic
Similar articles in Baidu academic
[王鑫]'s Articles
[李伟]'s Articles
[曾子铭]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[王鑫]'s Articles
[李伟]'s Articles
[曾子铭]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 热像仪_RGB相机_IMU传感器的空间联合标定方法.pdf
Format: Adobe PDF
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.