Awesome
2D Attentional Irregular Scene Text Recognizer
Unofficial PyTorch implementation of the paper, which transforms the irregular text with 2D layout to character sequence directly via 2D attentional scheme. They utilize a relation attention module to capture the dependencies of feature maps and a parallel attention module to decode all characters in parallel.
At present, the accuracy of the paper cannot be achieved. And i borrowed code from deep-text-recognition-benchmark
model <img src='./demo_image/model.png'>
result
Test on ICDAR2019 with only 51.15%, will continue to improve.
<img src='./demo_image/result.png'>
Feature
- Output image string once not like the seqtoseq model
Requirements
Pytorch >= 1.1.0
Test
-
download the pretrained model Baidu password: kdah.
-
test on images which in demo_image folder
python demo.py --image_folder demo_image --saved_model <model_path/best_accuracy.pth>
- some examples
| demo images | Bert_OCR |
|---|---|
| <img src="./demo_image/demo_1.png" width="300"> | available |
| <img src="./demo_image/demo_2.jpg" width="300"> | shakesshack |
| <img src="./demo_image/demo_3.png" width="300"> | london |
| <img src="./demo_image/demo_4.png" width="300"> | greenstead |
| <img src="./demo_image/demo_5.png" width="300" height="100"> | toast |
| <img src="./demo_image/demo_6.png" width="300" height="100"> | merry |
| <img src="./demo_image/demo_7.png" width="300"> | underground |
| <img src="./demo_image/demo_8.jpg" width="300"> | ronaldo |
| <img src="./demo_image/demo_9.jpg" width="300" height="100"> | bally |
| <img src="./demo_image/demo_10.jpg" width="300" height="100"> | university |
- result on benchmark data sets
| IIIT5k_3000 | SVT | IC03_860 | IC03_867 | IC13_857 | IC13_1015 | IC15_1811 | IC15_2077 | SVTP | CUTE80 |
|---|---|---|---|---|---|---|---|---|---|
| 84.367 | 79.907 | 91.860 | 91.465 | 88.448 | 86.010 | 65.654 | 63.215 | 68.527 | 81.185 |
total_accuracy: 78.423
Train
- I prepared a small dataset for train.The image and labels are in
./dataset/BAIDU.
python train.py --root ./dataset/BAIDU/images/ --train_csv ./dataset/BAIDU/small_train.txt --val_csv ./dataset/BAIDU/small_train.txt