Home

Awesome

Event Camera Rotation Dataset (ECRot)

The Event Camera Rotation Dataset (ECRot) is a VGA-resolution event camera dataset designed for the development of event-based rotational motion related algorithms. ECRot contains ten real-world sequences recorded with a DVXplorer (640 x 480 pixels) and six synthetic sequences generated with a DAVIS240C camera model (240 x 180 pixels) and a DVS128 model.

We provide all sequences in ROSbag files that contain events using dvs_msgs/EventArray message types, and IMU data using sensor_msgs/Imu message types respectively. The camera calibration files are provided in yaml files.

For real data, rotational motion is generated in two modes: Motorized mount (7 sequences) and Hand-held (3 sequences). The motorized mount rotates the event camera approximately around its vertical axis, while the rotation center slightly deviates from the camera's optical center. In the hand-held sequences, there are also some minor unavoidable translations. To show the advantages of event cameras over standard cameras, these sequences contain challenging illumination conditions (e.g., looking directly at the sun, reflections in the river and windows) as well as dynamic objects (e.g., moving pedestrians, bicycles, cars, leaves and water on the river).

The six synthetic sequences cover indoor, outdoor, daylight, night, human-made and natural scenarios. The size of the input panoramas varies from 2K (playroom), 4K (bicycle), 6K (city and street), to 7K (town and bay) resolution. They were generated using the ESIM simulator. The input panoramas were downloaded from the Internet.

Citation

This data is associated to the paper CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximization, IEEE T-RO 2024, by Shuang Guo and Guillermo Gallego.

If you use it in your research, please cite it as follows:

@Article{Guo24tro,
  author        = {Shuang Guo and Guillermo Gallego},
  title         = {{CMax}-{SLAM}: Event-based Rotational-Motion Bundle Adjustment and {SLAM} System using Contrast Maximization},
  journal       = {{IEEE} Transactions on Robotics},
  year          = 2024,
  volume        = {},
  number        = {},
  pages         = {1--20}
}

Sequences

Synthetic data

SequenceCamera modelDuration [s]File size
PlayroomDVS1282.547.8 MB
BicycleDAVIS240C5.0264.3 MB
CityDAVIS240C5.01.0 GB
StreetDAVIS240C5.0699.1 MB
TownDAVIS240C5.0743.6 MB
BayDAVIS240C5.0827.7 MB

Real-world data (with a DVXplorer, VGA resolution)

SequenceSetupDuration [s]Rotation range [deg]File size
Brandenburg GateMotorized mount8.03601.40 GB
Charlottenburg PalaceMotorized mount8.43601.18 GB
Victory ColumnMotorized mount10.09062.2 MB
TU Berlin Main BuildingMotorized mount8.53601.41 GB
TU Berlin MAR BuildingMotorized mount4.0$\approx$ 90421 MB
Square CenterMotorized mount8.83601.37 GB
Square SideMotorized mount8.03601.46 GB
CrossroadHand-held10.2360792 MB
RiverHand-held5.5random862 MB
BridgeHand-held7.5random1.08 GB

Intrinsic calibration of the event camera:

Synthetic scenes (from the Internet)

The panoramas used to generate synthetic sequences and the panoramic Images of Warped Events (IWEs) produced by CMax-SLAM are presented as below.

Real-world scenes in Berlin (from an RGB frame-based camera)

The panoramas captured by an iPhone 11 and the panoramic Images of Warped Events (IWEs) produced by CMax-SLAM are presented as below.

Acknowledgements

Ms. Nan Cai (for assistance on the motorized sequences) and Mr. Yunfan Yang (for assistance with the hand-held sequences).

Additional Resources