Modify Google's attention model for Chinese text recognition.
More details can be found in this paper:"Attention-based Extraction of Structured Information from Street View Imagery" and Chinese introduction of this project click here
This project can run on Windows10 and Ubuntu 16.04, using the python3 environment and The network is built using tensorflow
According to the official website, I generated FSNS format tfrecord for Chinese text recognition and a dictionary of 5,400 Chinese characters. The method of generating FSNS tfrecord can be referred to here.https://awesomeopensource.com/project/A-bone1/FSNS-tfrecord-generate
1、Store data in the same format as the FSNS datasetand put the tfrecord and dic.txt under datasets / data / fsns / train / ,then just reuse the python/datasets/fsns.py module. E.g., create a file datasets/newtextdataset.py， You can imitate this newtextdataset.py, modify some simple parameters and paths on it
2、You will also need to include it into the datasets/init.py and specify the dataset name in the command line.If you are modifying directly on my newtextdataset.py, you do not have to do this step
3、train your own model
cd python python train.py --dataset_name=newtextdataset
4、（ps）My machine's memory of GPU is not enough to support me training this model, so I temporarily set it to only cpu training, if you want to train in the GPU, then Comment these two lines in the train.py
import os os.environ['CUDA_VISIBLE_DEVICES'] = ''
5、 The required files of tensorboard are stored under / logs and can be viewed using the commands below.
1、Generate your validation FSNS tfrecord and name it train_eval*, then place it under datasets / data / fsns / train /
2、Verify your own model
3、The results can be view used tensorboard , the required documents stored under / tmp / attention_ocr / eval
Now,The character accuracy of 1.8million Synthetic pictures is 92.96%,and the sequence accuracy is 80.18%
python demo_inference.py --batch_size=32 \ --checkpoint=model.ckpt-399731\ --image_path_pattern=./datasets/data/fsns/temp/fsns_train_%02d.png