Awesome
CVPR2020_GDNet
Don't Hit Me! Glass Detection in Real-world Scenes
Haiyang Mei, Xin Yang, Yang Wang, Yuanyuan Liu, Shengfeng He, Qiang Zhang, Xiaopeng Wei, and Rynson W.H. Lau
[Paper] [Project Page]
Abstract
Glass is very common in our daily life. Existing computer vision systems neglect the glass and thus might lead to severe consequence, \eg, the robot might crash into the glass wall. However, sensing the presence of the glass is not straightforward. The key challenge is that arbitrary objects/scenes can appear behind the glass and the content presented in the glass region typically similar to those outside of it. In this paper, we raise an interesting but important problem of detecting glass from a single RGB image. To address this problem, we construct a large-scale glass detection dataset (GDD) and design a glass detection network, called GDNet, by learning abundant contextual features from a global perspective with a novel large-field contextual feature integration module. Extensive experiments demonstrate the proposed method achieves superior glass detection results on our GDD test set. Particularly, we outperform state-of-the-art methods that fine-tuned for glass detection.
Citation
If you use this code or our dataset (including test set), please cite:
@InProceedings{Mei_2020_CVPR,
author = {Mei, Haiyang and Yang, Xin and Wang, Yang and Liu, Yuanyuan and He, Shengfeng and Zhang, Qiang and Wei, Xiaopeng and Lau, Rynson W.H.},
title = {Don't Hit Me! Glass Detection in Real-World Scenes},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2020}
}
Dataset
See Peoject Page
Requirements
- PyTorch == 1.0.0
- TorchVision == 0.2.1
- CUDA 10.0 cudnn 7.2
- Setup
sudo pip3 install -r requirements.txt
git clone https://github.com/Mhaiyang/dss_crf.git
sudo python setup.py install
Test
Download the resnext_101_32x4d.pth
at here and the trained model GDNet.pth
at here, then run infer.py
.
License
Please see license.txt
Contact
E-Mail: mhy666@mail.dlut.edu.cn