How can I get the calibration data for camera and lidar data which I captured?

19 ビュー (過去 30 日間)
I have recorded the point cloud data using velodyne - VLP-16 Puck sensor and captured the data using logitech C270 (Normal Webcam). Now, I need to process the data for sensor fusion based object detection concept. For that, I need calib.mat file. But, I need to know how to calculate or get that .mat file. Without use of calib.mat (Calibration Mat file) file, I cannot detect the object in both the images(Image and .pcd data) in sensor fusion code.
People who are working or excel in this domain, kindly assist me on this.
Note:
I tried to get the data using camera calibrator but few values are null (means '0'). With that data i couldn't process further. Also i have a doubt, if I created the calib.mat file using one image, is that fine for all images(image & pcd data)? No need to change for different location of captured data?
Thanks in advance.
  1 件のコメント
Ramya Sivanandham
Ramya Sivanandham 2022 年 6 月 21 日
I have tried to explore the LidarCameraCalibrationExample using vlp16 sensor data which is available in the matlab intself, but it is throwing following error:
"Visualize the detected checkerboard by using the helperShowCheckerboardPlanes function.
helperShowCheckerboardPlanes(ptCloudFileNames,indices)"
due to index exceeds number of array elements.
After filtered the point cloud and image files that are not used for detection process, image and point cloud files are became null!
But it is working properly with HDL64 sensor! Kindly check and assist me on this!

サインインしてコメントする。

採用された回答

Kritika Bansal
Kritika Bansal 2022 年 6 月 23 日
Hi,
In order to get the calibration between lidar and camera, you can use the lidarCameraCalibrator app. This is a good place to help you get started with the process of calibration. You can refer to the following page for more details on getting started with the app: Get Started with Lidar Camera Calibrator.
The following page can help you with the recommended guidelines for the data collection process: Calibration Guidelines
-Kritika
  10 件のコメント
Ramya Sivanandham
Ramya Sivanandham 2022 年 6 月 30 日
Oh, oh, OK... I got it. Yeah, different names only, I'll change it..
Thank you so much!!!!!!!!!!
Sorry for the silly questions.. but I dont know.. I just started to explore the Lidar toolbox and calibration activities..
Ramya Sivanandham
Ramya Sivanandham 2022 年 7 月 11 日
編集済み: Ramya Sivanandham 2022 年 7 月 11 日
Hi Kritika and others,
I have an issue with the calibration of camera and lidar. I would like to know whether the process which I have done is proper or not! But I followed your instructions (Mathworks), but still not getting the matched pair.
  1. with the help of checkerboard pattern, have captured the data from camera and lidar
  2. captured the data as a frames through mScript.
  3. Lidar data captured through the veloview, as a pcap file. From pcap file, pcd file has extracted with the help of matlab convertion. Here is the issue that number of frames in camera and pcd data are different. I couldn't find the similar frames to do the calibration.
  4. another issue is, when i upload the lidar data, there won't be the proper ROI to detect the checkerboard. when i tried to adjust the ROI, placing of the ROI box is not happened.
  5. Sometimes, 1 frame will get matched but it was detected the different region from the checkerboard pattern.
My obervation from this issues,
  1. Due to different frame rate of lidar pcd data extraction from the pcap file, number of frame pair count is varying.
  2. Due to the different frame rate issue, couldn't detect the detectected pair.
  3. Due to improper ROI, detection is not happened.
Guys, Please let me know what i have missed and where should I concentrate or do the changes!!!!
I would like to try with cropped pcd data, but I didn't know. If someone helps me to crop the particular region of the input pcd data, will be more helpful to do this analysis.
or
Is any way to capture the sensor data at specified angle? (am using VLP-16 sensor)
Kindly assist me on this...
Thanks in advance.

サインインしてコメントする。

その他の回答 (0 件)

カテゴリ

Help Center および File ExchangeCalibration and Sensor Fusion についてさらに検索

製品


リリース

R2022a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by