Home

Awesome

Go framework for DL model inference and API deployment

中文

Deep learning models are usually deployed in the cloud and the inference services are provided through APIs. This framework provides the basic architectural components for deploying APIs and achieves several goals:

Other features:

Distributed deployment architecture

<img src="doc/arch.png" alt="Distributed deployment architecture" width="500" />

Development documentation

  1. Development Guide
  2. API documentation template
  3. Local testing
  4. Tensorflow runtime environment

Star History

Star History Chart