Home

Awesome

Ground-Challenge

A Multi-sensor SLAM Dataset Focusing on Corner Cases for Ground Robots

<div align=center>

Author Paper Preprint License News

<img src="fig/scenarios.jpg" width="800px"> </div> <p align="center">Figure 1. Different corner cases for SLAM</p>

Notice:

We strongly recommend that the newly proposed SLAM algorithm be tested on our Ground-Challenge benchmark, because our data has following features:

  1. A rich pool of sensory information including RGBD, wheel, IMU and so on.

  2. This benchmark includes diverse corner cases such as aggressive motion, severe occlusion, changing illumination, few textures, pure rotation, motion blur, wheel suspension, etc.

  3. This benchmark brings great challenge to existing cutting-edge SLAM algorithms including VINS-Mono, ORB-SLAM3, VINS-RGBD, VIW-Fusion and TartanVO. If your proposed algorihm outperforms SOTA systems on this dataset, your paper will be much more convincing and valuable.

License

The paper link is here.If you use Ground-Challenge in an academic work, please cite:

@inproceedings{yin2023ground,
  title={Ground-challenge: A multi-sensor slam dataset focusing on corner cases for ground robots},
  author={Yin, Jie and Yin, Hao and Liang, Conghui and Jiang, Haitao and Zhang, Zhengyou},
  booktitle={2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)},
  pages={1--5},
  year={2023},
  organization={IEEE}
}

ABSTRACT:

We introduce Ground-Challenge: a novel dataset collected by a ground robot with multiple sensors including an RGB-D camera, an inertial measurement unit (IMU), a wheel odometer and a 3D LiDAR to support the research on corner cases of visual SLAM systems. Our dataset comprises 36 trajectories with diverse corner cases such as aggressive motion, severe occlusion, changing illumination, few textures, pure rotation, motion blur, wheel suspension, etc. Some state-of-the-art SLAM algorithms are tested on our dataset, showing that these systems are seriously drifting and even failing on specific sequences. We will release the dataset and relevant materials upon paper publication to benefit the research community.

1.SENSOR SETUP

1.1 Acquisition Platform

The ground robot is given below. The unit of the figures is centimeter.

<div align=center> <img src="fig/robot.jpg" width="600px"> </div> <p align="left">Figure 2. The data capture robot.</p>

1.2 Sensor parameters

All the sensors and track devices and their most important parameters are listed as below:

The rostopics of our rosbag sequences are listed as follows:

2.DATASET SEQUENCES

An overview of Ground-Challenge is given in the table below:

ScenarioDarkroomOcclusionOfficeRoomWallMotionblurHallLoopRoughroadCorridorRotationStaticSlopeTOTAL
Number343333323232236
Dist/m92.0273.875.5102.186.7166.6236.3371.868.1164.312.41.9128.51780.0
Duration/s203.6334.2164.0154.7189.3145.5302.4332.7186.3198.1183.292.6195.02681.6
Size/GB6.19.94.74.65.64.38.79.95.45.85.42.75.778.8

2.1 Visual Challenges

<div align=center>
Sequence NameTotal SizeDurationFeaturesRosbag
Darkroom12.9g100sslight light, going into a roomRosbag
Darkroom22.3g76ssharp turnRosbag
Darkroom31.9g64sslight lightRosbag
Occlusion12.9g97smoving feet, far featuresRosbag
Occlusion23.2g108shand occlusionRosbag
Occlusion32.6g89shand occlusionRosbag
Occlusion41.2g40scomplete occlusionRosbag
Office11.3g46sexposure changeRosbag
Office21.9g66sgoing into a dark roomRosbag
Office31.5g52sofficeRosbag
Room11.3g46sexposure changeRosbag
Room21.9g66sgoing into a dark roomRosbag
Room31.5g52sofficeRosbag
Motionblur11.5g52saggressive motionRosbag
Motionblur21.6g54saggressive motionRosbag
Motionblur31.2g40saggressive motionRosbag
Wall11.7g59swall in a corridorRosbag
Wall22.0g66swall in a big hallRosbag
Wall33.9g65swall in a corridorRosbag
</div>

2.2 Wheel Challenge

<div align=center>
Sequence NameTotal SizeDurationFeaturesRosbag
Hall12.6g91sslippery ground, a reflective surfaceRosbag
Hall23.2g110sslippery ground, a reflective surfaceRosbag
Hall32.9g101sslippery ground, walking humanRosbag
Loop14.1g97smoving feet, far featuresRosbag
Loop25.8g137shand occlusionRosbag
Roughroad12.2g75srough roadRosbag
Roughroad21.5g52srough roadRosbag
Roughroad31.8g59srough roadRosbag
</div>

2.3 Specific Movement Patterns

<div align=center>
Sequence NameTotal SizeDurationFeaturesRosbag
Corridor12.9g100szigzag, long corridorRosbag
Corridor22.9g98sstraight forward, long corridorRosbag
Rotation11.6g53smoving feet, far featuresRosbag
Rotation22.1g73shand occlusionRosbag
Rotation31.7g57srough roadRosbag
Static11.6g56srough roadRosbag
Static21.1g37srough roadRosbag
Slope12.8g96sslopeRosbag
Slope22.9g99sslopeRosbag
</div>

3. Configuration Files

We provide configuration files for several cutting-edge baseline methods, including VINS-RGBD,TartanVO,VINS-Mono and VIW-Fusion.

Star History

Star History Chart