Awesome
NLP for Gujarati
This repository contains State of the Art Language models and Classifier
for Gujarati, which is a language native to the Indian state of Gujarat.
The models trained here have been used in Natural Language Toolkit for Indic Languages
(iNLTK)
Dataset
Created as part of this project
-
Gujarati Wikipedia Articles
-
Gujarati News Dataset
Open Source Datasets
- iNLTK Headlines Corpus - Gujarati : Uses the Gujarati News Dataset prepared above.
Results
Language Model Perplexity (on validation set)
Architecture/Dataset | Gujarati Wikipedia Articles |
---|
ULMFiT | 34.12 |
TransformerXL | 28.12 |
Classification Metrics
ULMFiT
Dataset | Accuracy | MCC | Notebook to Reproduce results |
---|
iNLTK Headlines Corpus - Gujarati | 91.05 | 86.09 | Link |
Visualizations
Word Embeddings
Results of using Transfer Learning + Data Augmentation from iNLTK
On using complete training set (with Transfer learning)
Dataset | Dataset size (train, valid, test) | Accuracy | MCC | Notebook to Reproduce results |
---|
iNLTK Headlines Corpus - Gujarati | (5269, 659, 659) | 91.05 | 86.09 | Link |
On using 10% of training set (with Transfer learning)
Dataset | Dataset size (train, valid, test) | Accuracy | MCC | Notebook to Reproduce results |
---|
iNLTK Headlines Corpus - Gujarati | (526, 659, 659) | 80.88 | 70.18 | Link |
On using 10% of training set (with Transfer learning + Data Augmentation)
Dataset | Dataset size (train, valid, test) | Accuracy | MCC | Notebook to Reproduce results |
---|
iNLTK Headlines Corpus - Gujarati | (526, 659, 659) | 81.03 | 70.44 | Link |
Pretrained Models
Language Models
Download pretrained Language Models from here
Tokenizer
Trained tokenizer using Google's sentencepiece
Download the trained model and vocabulary from here