Home

Awesome

EfficientNet Keras (and TensorFlow Keras)

PyPI version Downloads

This repository contains a Keras (and TensorFlow Keras) reimplementation of EfficientNet, a lightweight convolutional neural network architecture achieving the state-of-the-art accuracy with an order of magnitude fewer parameters and FLOPS, on both ImageNet and five other commonly used transfer learning datasets.

The codebase is heavily inspired by the TensorFlow implementation.

Important!

There was a huge library update on 24th of July 2019. Now efficientnet works with both frameworks: keras and tensorflow.keras. If you have models trained before that date, please use efficientnet of version 0.0.4 to load them. You can roll back using pip install -U efficientnet==0.0.4 or pip install -U git+https://github.com/qubvel/efficientnet/tree/v0.0.4.

Table of Contents

  1. About EfficientNet Models
  2. Examples
  3. Models
  4. Installation
  5. Frequently Asked Questions
  6. Acknowledgements

About EfficientNet Models

EfficientNets rely on AutoML and compound scaling to achieve superior performance without compromising resource efficiency. The AutoML Mobile framework has helped develop a mobile-size baseline network, EfficientNet-B0, which is then improved by the compound scaling method to obtain EfficientNet-B1 to B7.

<table border="0"> <tr> <td> <img src="https://raw.githubusercontent.com/tensorflow/tpu/master/models/official/efficientnet/g3doc/params.png" width="100%" /> </td> <td> <img src="https://raw.githubusercontent.com/tensorflow/tpu/master/models/official/efficientnet/g3doc/flops.png", width="90%" /> </td> </tr> </table>

EfficientNets achieve state-of-the-art accuracy on ImageNet with an order of magnitude better efficiency:

Examples

# models can be build with Keras or Tensorflow frameworks
# use keras and tfkeras modules respectively
# efficientnet.keras / efficientnet.tfkeras
import efficientnet.keras as efn 

model = efn.EfficientNetB0(weights='imagenet')  # or weights='noisy-student'

# model use some custom objects, so before loading saved model
# import module your network was build with
# e.g. import efficientnet.keras / import efficientnet.tfkeras
import efficientnet.tfkeras
from tensorflow.keras.models import load_model

model = load_model('path/to/model.h5')

See the complete example of loading the model and making an inference in the Jupyter notebook here.

Models

The performance of each model variant using the pre-trained weights converted from checkpoints provided by the authors is as follows:

Architecture@top1* Imagenet@top1* Noisy-Student
EfficientNetB00.7720.788
EfficientNetB10.7910.815
EfficientNetB20.8020.824
EfficientNetB30.8160.841
EfficientNetB40.8300.853
EfficientNetB50.8370.861
EfficientNetB60.8410.864
EfficientNetB70.8440.869

* - topK accuracy score for converted models (imagenet val set)

Installation

Requirements

Installing from the source

$ pip install -U git+https://github.com/qubvel/efficientnet

Installing from PyPI

PyPI stable release

$ pip install -U efficientnet

PyPI latest release (with keras and tf.keras support)

$ pip install -U --pre efficientnet

Frequently Asked Questions

Pick the target directory (like dist) and run the converter script from the repo directory as follows:

$ ./scripts/convert_efficientnet.sh --target_dir dist

You can also optionally create the virtual environment with all the dependencies installed by adding --make_venv=true and operate in a self-destructing temporary location instead of the target directory by setting --tmp_working_dir=true.

Acknowledgements

I would like to thanks community members who actively contribute to this repository:

  1. Sasha Illarionov (@sdll) for preparing automated script for weights conversion
  2. Björn Barz (@Callidior) for model code adaptation for keras and tensorflow.keras frameworks