Home

Awesome

REMOT

REMOT: A Hardware-Software Architecture for Attention-Guided Multi-Object Tracking with Dynamic Vision Sensors on FPGAs

Citation

@article{yizhao2021remot,
    title = "{REMOT: A Hardware-Software Architecture for Attention-Guided Multi-Object Tracking with Dynamic Vision Sensors on FPGAs}",
    author = {Yizhao, Gao and Song, Wang and So, Hayden K.-H.},
    journal = {The 2022 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays},
    year = {2022}
}

Introduction

REMOT is a hardware/software architecture for Multi-Object Tracking using Dynamic Vision Sensors on FPGA. It's designed around the concept of an attention unit (AU). Each AU will only pay attention to a specific region of interest, which is designed to changed as the object moves. In REMOT, a layer of parallel AUs is implemented on FPGA to collectively process the stream of asynchronous events from a DVS.

Outlines

Dependency

The repo has been verified on:

Vivado 2020.2

    source <vivado_root/2020.2/settings64.sh>

Python Environment Installation

    conda create -n au python=3.7
    conda activate au
    pip install -r requirements.txt
    cd <matlab_root/extern/engines/python>
    python setup.py install