Awesome

Event camera (DVS, Spike) based Papers Published on Top International Conference

Demo Videos

• Spike Camera: [Youtube] [https://www.vidar.cn/]

• DVS346: [Homepage] [Youtube]

• CeleX: [Youtube]

• PROPHESEE: [Homepage] [Demo Video]

• ALPIX-Titlis/ALPIX-Eiger: [Homepage]

• wikipedia: https://en.wikipedia.org/wiki/Event_camera

Survey Papers

• [arXiv:2409.17680] Event-based Stereo Depth Estimation: A Survey, Suman Ghosh, Guillermo Gallego [Paper]

• Gallego G, Delbrück T, Orchard G, et al. Event-based vision: A survey[J]. IEEE transactions on pattern analysis and machine intelligence, 2020, 44(1): 154-180. [Paper]

• Huang T J, Yu Z F, Li Y, Shi B X, Xiong R Q, Ma L and Wang W. 2022. Advances in spike vision. Journal of Image and Graphics, 27(06):1823-1839(黄铁军,余肇飞,李源,施柏鑫,熊瑞勤,马雷,王威. 2022. 脉冲视觉研究进展. 中国图象图形学报,27(06):1823- 1839) [DOI:10. 11834 / jig. 220175] [Paper]

• Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarks, Xu Zheng∗, Yexin Liu∗, Yunfan Lu, Tongyan Hua, Tianbo Pan, Weiming Zhang, Dacheng Tao, Lin Wang, [Paper] [GitHub]

• "Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods." Zhou, Chenlin, et al. arXiv preprint arXiv:2405.04289 (2024). [Paper] [Code]

Nature & Science

• Gehrig, D., Scaramuzza, D. Low-latency automotive vision with event cameras. Nature 629, 1034–1040 (2024). https://doi.org/10.1038/s41586-024-07409-w [Paper]

arXiv Pre-print

• EventSleep: Sleep Activity Recognition with Event Cameras, Carlos Plou, Nerea Gallego, Alberto Sabater, Eduardo Montijano, Pablo Urcola, Luis Montesano, Ruben Martinez-Cantin, Ana C. Murillo [Paper] [Dataset]

• [Pre-train] Data-efficient Event Camera Pre-training via Disentangled Masked Modeling, Zhenpeng Huang, Chao Li, Hao Chen, Yongjian Deng, Yifeng Geng, Limin Wang, [Paper]

• Efficient and Effective Time-Series Forecasting with Spiking Neural Networks, Changze Lv 1 Yansen Wang 2 Dongqi Han 2 Xiaoqing Zheng 1 Xuanjing Huang 1 Dongsheng Li [Paper]

• ALERT-Transformer: Bridging Asynchronous and Synchronous Machine Learning for Real-Time Event-based Spatio-Temporal Data, Carmen Martin-Turrero * 1 Maxence Bouvier * 1 Manuel Breitenstein 1 Pietro Zanuttigh 2 Vincent Parret 1 [Paper]

• From Chaos Comes Order: Ordering Event Representations for Object Detection, Nikola Zubic, Daniel Gehrig, Mathias Gehrig Davide Scaramuzza, [Paper]

• Spikformer: When Spiking Neural Network Meets Transformer, Zhaokun Zhou, Yuesheng Zhu, Chao He, Yaowei Wang, Shuicheng Yan, Yonghong Tian, Li Yuan [Paper] [Code]

• Wang, Xiao and Wu, Zongzhen and Jiang, Bo and Bao, Zhimin and Zhu, Lin and Li, Guoqi and Wang, Yaowei and Tian, Yonghong. "HARDVS: Revisiting Human Activity Recognition with Dynamic Vision Sensors." arXiv preprint arXiv:2211.09648 (2022). [Paper] [Code]

• Event-based Monocular Dense Depth Estimation with Recurrent Transformers, Xu Liu Jianing Li Xiaopeng Fan Yonghong Tian, [Paper]

• Event-Based Frame Interpolation with Ad-hoc Deblurring, Lei Sun1,2 Christos Sakaridis2, Jingyun Liang2 Peng Sun1, Jiezhang Cao2 Kai Zhang2, Qi Jiang1 Kaiwei Wang1 Luc Van Gool2,3 [Paper]

• Event Camera Data Dense Pre-training, Yan Yang [Paper]

ECCV 2024

• DailyDVS-200: A Comprehensive Benchmark Dataset for Event-Based Action Recognition, Qi Wang, Zhou Xu, Yuming Lin, Jingtao Ye, Hongsheng Li, Guangming Zhu, Syed Afaq Ali Shah, Mohammed Bennamoun, Liang Zhang [Paper] [Code]

CVPR 2024

• Generalized Event Cameras, Varun Sundar, Matthew Dutson, Andrei Ardelean, Claudio Bruschini, Edoardo Charbon, Mohit Gupta [Paper]

• Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline. Xiao Wang, Shiao Wang, Chuanming Tang, Lin Zhu, Bo Jiang, Yonghong Tian, Jin Tang (2023). arXiv preprint arXiv:2309.14611. [Paper] [Code] [DemoVideo]

• LEOD: Label-Efficient Object Detection for Event Cameras, Ziyi Wu, Mathias Gehrig, Qing Lyu, Xudong Liu, Igor Gilitschenski, CVPR'24 [Paper] [Code]

AAAI 2024

• Deng, Yongjian, Hao Chen, and Youfu Li. "A Dynamic GCN with Cross-Representation Distillation for Event-Based Learning." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 38. No. 2. 2024. [Paper]

• Zhao, Han, et al. "Dynamic Reactive Spiking Graph Neural Network." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 38. No. 15. 2024. [Paper]

ICLR 2024

BMVC 2023

• Highly Efficient SNNs for High-speed Object Detection, [Paper]

ICCV 2023

• Event Camera Data Pre-training， Yan Yang, Liyuan Pan, Liu Liu [Paper] [Code]

• Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Events , Hoonhee Cho, Hyeonseong Kim, Yujeong Chae, Kuk-Jin Yoon [Paper]

• RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimation, Zhexiong Wan, Yuxin Mao, Jing Zhang, Yuchao Dai [Paper] [Code]

• GET: Group Event Transformer for Event-Based Vision, Yansong Peng, Yueyi Zhang, Zhiwei Xiong, Xiaoyan Sun, Feng Wu [Paper] [Code]

• Person Re-Identification without Identification via Event anonymization, Shafiq Ahmad, Pietro Morerio, Alessio Del Bue [Paper] [Code]

• Efficient Converted Spiking Neural Network for 3D and 2D Classification, Yuxiang Lan, Yachao Zhang, Xu Ma, Yanyun Qu, Yun Fu [Paper]

• Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks, Qingyan Meng, Mingqing Xiao, Shen Yan, Yisen Wang, Zhouchen Lin, Zhi-Quan Luo [Paper] [Code]

• Masked Spiking Transformer, Ziqing Wang, Yuetong Fang, Jiahang Cao, Qiang Zhang, Zhongrui Wang, Renjing Xu [Paper] [Code]

ICLR 2023

• "Associative Memory Augmented Asynchronous Spatiotemporal Representation Learning for Event-based Perception." Kamal, Uday, Saurabh Dash, and Saibal Mukhopadhyay. In The Eleventh International Conference on Learning Representations. [Paper] [Code]

CVPR 2023

• EventNeRF: Neural Radiance Fields from a Single Colour Event Camera, Viktor Rudnev · Mohamed Elgharib · Christian Theobalt · Vladislav Golyanik

• Adaptive Global Decay Process for Event Cameras, Urbano Nunes · Ryad Benosman · Sio-Hoi Ieng

• Learning Event Guided High Dynamic Range Video Reconstruction, Yixin Yang · Jin Han · Jinxiu Liang · Zhihang Zhong · Boxin Shi

• Data-driven Feature Tracking for Event Cameras, Nico Messikommer* Carter Fang∗ Mathias Gehrig Davide Scaramuzza [Paper] [Code]

• Recurrent Vision Transformers for Object Detection with Event Cameras, Mathias Gehrig and Davide Scaramuzza [Paper] [Code]

WACV 2023

• Huang, Ze, et al. "EventPoint: Self-Supervised Interest Point Detection and Description for Event-Based Camera." Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2023. [Paper]

• Bajestani, Seyed Ehsan Marjani, and Giovanni Beltrame. "Event-Based RGB Sensing With Structured Light." Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2023. [Paper]

ECCV 2022

• Neuromorphic Data Augmentation for Training Spiking Neural Networks, Yuhang Li, [Paper] [Code]

• Event-Based Fusion for Motion Deblurring with Cross-modal Attention, Lei Sun1,2, Christos Sakaridis2, Jingyun Liang2, Qi Jiang1, Kailun Yang3, PengSun1, Yaozu Ye1, Kaiwei Wang1, and Luc Van Gool

• Boosting Event Stream Super-Resolution with A Recurrent Neural Network, Wenming Weng (University of Science and Technology of China)*; Yueyi Zhang (University of Science and Technology of China); Zhiwei Xiong (University of Science and Technology of China)

• Secrets of Event-Based Optical Flow, Shintaro Shiba, Yoshimitsu Aoki, Guillermo Gallego [Paper] [Code]

• DVS-Voltmeter: Stochastic Process-based Event Simulator for Dynamic Vision Sensors SongNan Lin (Nanyang Technological University)*; Ye Ma (McGill University); Zhenhua Guo (Aliababa Group); Bihan Wen (Nanyang Technological University) [Paper] [Code]

• Data Association between Event Streams and Intensity Frames under Diverse Baselines, Dehao Zhang Qiankun Ding Peiqi Duan Chu Zhou Boxin Shi [Paper]

• "Spike Transformer: Monocular Depth Estimation for Spiking Camera". Jiyuan Zhang*, Lulu Tang*, Zhaofei Yu , Jiwen Lu and Tiejun Huang, European Conference on Computer Vision (ECCV) 2022. [Paper] [Code]

CVPR 2022

• Brain-Inspired Multilayer Perceptron With Spiking Neurons, Wenshuo Li, Hanting Chen, Jianyuan Guo, Ziyang Zhang, Yunhe Wang; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 783-793 [Paper] [Code]

• Optical Flow Estimation for Spiking Camera, Liwen Hu, Rui Zhao, Ziluo Ding, Lei Ma, Boxin Shi, Ruiqin Xiong, Tiejun Huang; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 17844-17853 [Paper] [Code]

• Schaefer, Simon, Daniel Gehrig, and Davide Scaramuzza. "AEGNN: Asynchronous Event-based Graph Neural Networks." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Project] [Code]

• Zhou, Xinyu, et al. "EvUnroll: Neuromorphic Events Based Rolling Shutter Image Correction." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Code]

• Song, Chen, Qixing Huang, and Chandrajit Bajaj. "E-CIR: Event-Enhanced Continuous Intensity Recovery." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Code]

• He, Weihua, et al. "TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolation." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Project]

• Zhang, Jiqing, et al. "Spiking Transformers for Event-Based Single Object Tracking." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Code]

• Kim, Junho, Inwoo Hwang, and Young Min Kim. "Ev-TTA: Test-Time Adaptation for Event-Based Object Recognition." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper]

• Nam, Yeongwoo, et al. "Stereo Depth from Events Cameras: Concentrate and Focus on the Future." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Code]

• Liao, Wei, et al. "Synthetic Aperture Imaging With Events and Frames." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Code]

• Hidalgo-Carrió, Javier, Guillermo Gallego, and Davide Scaramuzza. "Event-aided Direct Sparse Odometry." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Code]

• Zhu, Lin, et al. "Event-based Video Reconstruction via Potential-assisted Spiking Neural Network." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Project] [Code]

• Tulyakov, Stepan, et al. "Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusion." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [Paper] [Project] [Code]

• Autofocus for Event Cameras, Shijie Lin, Yinqiang Zhang, Lei Yu, Bin Zhou, Xiaowei Luo, Jia Pan; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 16344-16353 [Paper] [Project] [Code] [Dataset] [Youtube] [Bilibili]

• Discrete Time Convolution for Fast Event-Based Stereo, Kaixuan Zhang, Kaiwei Che, Jianguo Zhang, Jie Cheng, Ziyang Zhang, Qinghai Guo, Luziwei Leng; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 8676-8686 [Paper]

• A Voxel Graph CNN for Object Classification With Event Cameras, Yongjian Deng, Hao Chen, Hai Liu, Youfu Li; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 1172-1181 [Paper]

• Multi-Grained Spatio-Temporal Features Perceived Network for Event-Based Lip-Reading, Ganchao Tan, Yang Wang, Han Han, Yang Cao, Feng Wu, Zheng-Jun Zha; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 20094-20103 [Paper] [Code] [Dataset]

• E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognition, Chiara Plizzari, Mirco Planamente, Gabriele Goletto, Marco Cannici, Emanuele Gusso, Matteo Matteucci, Barbara Caputo; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 19935-19947 [Paper] [Code]

• Unifying Motion Deblurring and Frame Interpolation With Events, Xiang Zhang, Lei Yu; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 17765-17774 [Paper] [Code]

ICCV-2021

• Event Stream Super-Resolution via Spatiotemporal Constraint Learning, Siqi Li1, Yutong Feng1, Yipeng Li2, Yu Jiang3, Changqing Zou4, Yue Gao [Paper]

• Viktor Rudnev, Vladislav Golyanik, Jiayi Wang, Hans-Peter Seidel, Franziska Mueller, Mohamed Elgharib, Christian Theobalt; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 12385-12395 [Paper] [Code]

• Zhiyang Yu, Yu Zhang, Deyuan Liu, Dongqing Zou, Xijun Chen, Yebin Liu, Jimmy S. Ren; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 14589-14598 [Paper] [Code]

• Ziwei Wang, Yonhon Ng, Cedric Scheerlinck, Robert Mahony; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 448-457 [Paper]

• Siqi Li, Yutong Feng, Yipeng Li, Yu Jiang, Changqing Zou, Yue Gao; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 4480-4489 [Paper] [Code]

• Yijin Li, Han Zhou, Bangbang Yang, Ye Zhang, Zhaopeng Cui, Hujun Bao, Guofeng Zhang; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 934-943 [Paper] [Code]

• Cheng Gu, Erik Learned-Miller, Daniel Sheldon, Guillermo Gallego, Pia Bideau; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 13495-13504 [Paper]

• Jin Han, Yixin Yang, Chu Zhou, Chao Xu, Boxin Shi; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 4882-4891 [Paper]

• Motion Deblurring With Real Events, Fang Xu, Lei Yu, Bishan Wang, Wen Yang, Gui-Song Xia, Xu Jia, Zhendong Qiao, Jianzhuang Liu; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 2583-2592 [Paper]

• Event-Based Video Reconstruction Using Transformer, Wenming Weng, Yueyi Zhang, Zhiwei Xiong; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 2563-2572 [Paper] [Code]

• Object Tracking by Jointly Exploiting Frame and Event Domain, Jiqing Zhang, Xin Yang, Yingkai Fu, Xiaopeng Wei, Baocai Yin, Bo Dong; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 13043-13052 [Paper] [Code]

• Bringing Events Into Video Deblurring With Non-Consecutively Blurry Frames, Wei Shang, Dongwei Ren, Dongqing Zou, Jimmy S. Ren, Ping Luo, Wangmeng Zuo; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 4531-4540 [Paper] [Code]

• N-ImageNet: Towards Robust, Fine-Grained Object Recognition With Event Cameras, Junho Kim, Jaehyeok Bae, Gangin Park, Dongsu Zhang, Young Min Kim; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 2146-2156 [Paper]

• Event-Intensity Stereo: Estimating Depth by the Best of Both Worlds, Mohammad Mostafavi, Kuk-Jin Yoon, Jonghyun Choi; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 4258-4267 [Paper]

• EventHPE: Event-Based 3D Human Pose and Shape Estimation, Shihao Zou, Chuan Guo, Xinxin Zuo, Sen Wang, Pengyu Wang, Xiaoqin Hu, Shoushun Chen, Minglun Gong, Li Cheng; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 10996-11005 [Paper]

• Dual Transfer Learning for Event-Based End-Task Prediction via Pluggable Event to Image Translation, Lin Wang, Yujeong Chae, Kuk-Jin Yoon; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 2135-2145 [Paper]

• Temporal-Wise Attention Spiking Neural Networks for Event Streams Classification, Man Yao, Huanhuan Gao, Guangshe Zhao, Dingheng Wang, Yihan Lin, Zhaoxu Yang, Guoqi Li; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 10221-10230 [Paper]

CVPR-2021

Video Tutorials

• [ACACES 2023: Neuromorphic computing: from theory to applications, Lecture 1 – Yulia Sandamirskaya]
• [Youtube (HiPEAC TV)]

==