Awesome
capsules-tensorflow
Another implementation of Hinton's capsule networks in tensorflow. At the moment the implementation provides the means to set up the model presented in Dynamic Routing Between Capsules.
Results:
Results of this implementation on MNIST with batch size 256, learning rate decay 0.95, regularization weight 0.4:
| Epochs | Routing Iterations | Regularization | Accuracy |
|---|---|---|---|
| 20 | 1 | Off | 99.51% |
| 20 | 1 | On | 99.62% |
| 20 | 3 | Off | 99.30% |
| 20 | 3 | On | 99.47% |
| 500 | 1 | On | 99.55% |
| 500 | 3 | On | 99.50% |
Here are some reconstructions of testset digits obtained by the encoder of a capsnet trained on MNIST for 20 and 100 epochs with regularization and iter_routing=2:
<img src="https://github.com/chrislybaer/capsules-tensorflow/blob/master/results/results_20epochs.png" width="280" heigth="570"> <img src="https://github.com/chrislybaer/capsules-tensorflow/blob/master/results/results_100epochs.png" width="280" heigth="570">
The odd lines contain the input digits and the even lines the reconstructed digits. For the reconstruction the orientation of the longest DigitCapsule vector is used.
Reconstructions for the fashion MNIST dataset after 10 epochs with regularization and iter_routing=2:
<img src="https://github.com/chrislybaer/capsules-tensorflow/blob/master/results/results_10epochs_fmnist.png" width="280" heigth="570">Implemented:
- fully connected capsule layers with routing (capsule.py)
- convolutional capsule layers without routing (capsule.py)
- regularization (main_mnist_capsnet.py)
TODO:
- train for many epochs
- convoutional capsule layers with routing
- speed things up
For a minimal example please have a look at: main_mnist_capsnet.py. In this file a CapsNet with the architecture proposed in the linked paper is trained on the MNIST dataset.
I am new to tensorflow, therefore, feedback regarding coding style or mistakes is appreciated!
Other Implementations:
- Clean Keras implementation: Xifeng Guo