Awesome

NTU VIRAL: A Visual-Inertial-Ranging-Lidar Dataset for Autonomous Aerial Vehicle

This site presents the datasets collected from our research Unmanned Aerial Vehicle (UAV) platform, featuring an extensive set of sensors:

• Two 3D lidars
• Two time-synchronized cameras
• Multiple Inertial Measurement Units (IMUs)
• Four Ultra-wideband (UWB) nodes on UAV, ranging to three anchor nodes.

The comprehensive sensor suite resembles that of an autonomous driving car, but features distinct and challenging characteristics of aerial operations. The flight tests are conducted in a variety of both indoor and outdoor conditions.

Citation

If you use some resource from this data suite, please cite it as

@article{nguyen2022ntu,
  title     = {NTU VIRAL: A Visual-Inertial-Ranging-Lidar Dataset, From an Aerial Vehicle Viewpoint},
  author    = {Nguyen, Thien-Minh and Yuan, Shenghai and Cao, Muqing and Lyu, Yang and Nguyen, Thien Hoang and Xie, Lihua},
  journal   = {The International Journal of Robotics Research},
  volume    = {41},
  number    = {3},
  pages     = {270--280},
  year      = {2022},
  publisher = {SAGE Publications Sage UK: London, England}
}

[Journal][Preprint]

Updates

05/02/2023: Update works using the datasets

26/09/2022: Extra sequences (rtp_01, rtp_02, rtp_03, tnp_01, tnp_02, tnp_03, spms_01, spms_02, spms_03) in more challenging scenarios are added.

12/07/2022: The ouster pointcloud and IMU messages are found to jitter due to synchronization issues. A script to regularize the ouster pointcloud and imu topics can be downloaded here.

Downloads

Note: The files below are hosted on NTU Data Repository. If you experience interuption from the NTU Data Reposity, please try downloading the files from this Onedrive folder.

Groundtruth is included in the bag. Or you can download them in csv formats here: https://github.com/ntu-aris/ntuviral_gt.

We note that many users forget to check for the 0.4m offset from the IMU to the prism, which is where ground truth is measured. To help evaluating things more easily, we have written a jupyter and MATLAB scripts to help with the evalution. Please check out the tutorial for their use.

<a name="tab-download"></a>

Quick use

We have done some experiments of state-of-the-art methods on our the datasets. If you are seeking to do the same, please check out the following to get the work done quickly.

Related works

The datasets were used in the following papers. Please checkout these works if you are interested. (Please contact us if you would like your work mentioned here).

• FAST-LIVO: Fast and Tightly-coupled Sparse-Direct LiDAR-Inertial-Visual Odometry
• VIRAL SLAM: Tightly Coupled Camera-IMU-UWB-Lidar SLAM
• MILIOM: Tightly Coupled Multi-Input Lidar-Inertia Odometry and Mapping (RAL 2021)
• LIRO: Tightly Coupled Lidar-Inertia-Ranging Odometry (ICRA 2021)

Notes:

For more information on the sensors and how to use the dataset, please checkout the other sections.

For resources and other works of our group please checkout our github.

If you have some inquiry, please raise an issue on github.

Licence

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License and is intended for non-commercial academic use. If you are interested in using the dataset for commercial purposes please contact us.