Home

Awesome

<div align="center"> <img src="https://github.com/CODAIT/max-central-repo/raw/master/images/title.png"> </div>

:exclamation: We are Open Source and We Welcome Contributions :exclamation:

Our mission at CODAIT is to democratize AI, to make AI technologies accessible to practitioners who understand real-world problems and enable them to develop AI solutions that solve these problems.

The core technologies behind today’s AI systems rely heavily on open-source software projects. Going from raw data to training data to models to solutions requires many open technologies, and it’s crucial that these technologies not only work well, but work well together. Our developers and data scientists are continually improving these frameworks with our targeted open source contributions, making them work better both individually and as an integrated pipeline. Hence our name — the Center for Open-Source Data and AI Technologies.

Subscribe to our newsletters to keep updated with the recent announcements here.

Model Asset Exchange

The Model Asset Exchange on IBM Developer is a place for developers to find and use free, open source, state-of-the-art deep learning models for common application domains. The curated list includes deployable models that you can run as a microservice locally or in the cloud on contanerization platforms like Docker, Kubernetes or OpenShift, and trainable models where you can use your own data to train the models.

Models are licensed under the Apache 2.0 License.

Domains covered: Text, Vision, Audio, and Time-Series.

Models can be consumed via:

  1. Any programming language
  2. WebApp
  3. Node-RED Flow
  4. Serverless App
  5. CodePen

Contact Us

If you have any questions that you would like to discuss with us:

  1. For general discussion, you are welcome to open an issue in our issue tracker.
  2. For a question about a particular model, you are welcome to open an issue in the corresponding repository. You can find a list of the repositories here.

Contributing to the Model Asset Exchange

We welcome anyone who wants to make contributions to the Model Asset Exchange. Please review the contribution guidelines. This project adheres to code of conduct mentioned here. By participating, you are expected to uphold this code.

  1. To start a general discussion create an issue in this repo.
  2. For model-specific questions, go to the corresponding model repository and create an issue.
  3. For those who want to contribute a model to MAX, here is a quick summary of the process:
    • To contribute code, documentation, or tests, please submit a pull request in the model's repository (a list is available).
    • Our maintainers will review your proposal.
    • If approved, wrap the model using the MAX-Skeleton as a guide.

We use Github Pull Requests for tracking requests and bugs, please direct any questions to our Slack channel.

Model Information

  1. Deployable Models
  2. Deployable and Trainable Models

Deployable Models

DomainModelFrameworkDatasetApplicationModel Consumption
AudioAudio ClassifierKeras/TensorFlowGoogle AudioSetClassification<p> Demo <br> Node-RED <br> CodePen
AudioAudio Embedding GeneratorTensorFlowGoogle Audio DatasetEmbeddings
AudioAudio Sample GeneratorTensorFlowSpeech Commands and FMAAudio Modeling
AudioSpeech to Text ConverterTensorFlowMozilla Common VoiceSpeech Recognition
NLPText SummarizerTensorFlowCNN / Daily MailText Summarization
NLPToxic Comment ClassifierPyTorchKaggle Toxic Comment Classification datasetText Classification
NLPChinese Phonetic Similarity EstimatorPythonText Clustering/Phonetics
NLPNews Text GeneratorTensorFlowOne Billion Word Benchmark DatasetLanguage Modeling
NLPReview Text GeneratorKerasKaggle Yelp Reviews DatasetLanguage Modeling
VisionBreast Cancer Mitosis DetectorKerasTUPAC16Image Classification
VisionFast Neural Style TransferPyTorchCOCO 2014Style Transfer
VisionHuman Pose EstimatorTensorFlowCOCOHuman Pose Estimation<p> Demo <br> WebApp <br> Node-RED <br> CodePen
VisionImage Caption GeneratorTensorFlowCOCOImage Caption Generator<p> Demo <br> WebApp <br> Node-RED <br> CodePen
VisionImage ColorizerTensorFlowCOCOImage Coloring
VisionImage Resolution EnhancerTensorFlowOpenImages v4Super-Resolution
VisionInception-ResNet-v2KerasImageNetImage ClassificationNode-RED
VisionNucleus SegmenterKeras2018 Data Science BowlObject Detection
VisionScene ClassifierPyTorchPlaces365Image ClassificationNode-RED
VisionSports Video ClassifierTensorFlowSports-1MVideo Classification
Time-SeriesWeather ForecasterTensorFlow/KerasJFK Airport Weather Data, NOAAWeather Prediction

Deployable and Trainable Models

DomainModelFrameworkTraining Dataset for Deployable ModelApplicationModel Consumption
NLPText Sentiment ClassifierTensorFlowIBM Claim Stance DatasetSentiment Analysis
NLPNamed Entity TaggerKerasGroningen Meaning Bank (GMB) DatasetNamed Entity Recognition
NLPQuestion AnsweringTensorFlowSQuAD 1.1 DatasetQuestion and Answer
NLPWord Embedding GeneratorTensorFlowRandom TextWord Embeddings
VisionObject DetectorTensorFlowCOCOObject Detection<p> WebApp <br> Node-RED <br> CodePen
VisionResNet-50KerasImageNetImage Classification
VisionImage SegmenterTensorFlowVOC2012 ~10k imagesSemantic Image Segmentation<p> Demo <br> WebApp <br> Node-RED <br> CodePen

General resources

  1. Check the current status for the Model Asset Exchange ecosystem here.

  2. MAX Framework: Python package that contains common code shared across all MAX models - (link)

  3. MAX Skeleton: Docker based deployment skeleton for deep learning models on the Model Asset Exchange - (link)

  4. MAX Training Framework: WML training framework library for the Model Asset Exchange (link)

Tutorials

  1. Get started with the Model Asset Exchange
  2. Deploy deep learning models on Red Hat OpenShift
  3. Deploy MAX models to the cloud with Kubernetes
  4. Leverage deep learning in IBM Cloud Functions
  5. Leverage deep learning in your Node-RED flows
  6. Use Node-RED Node Generator to create new nodes from APIs and services

Blogs

  1. Get an introduction to the Model Asset Exchange on IBM Developer
  2. Open source and AI at IBM
  3. Expanding the reach of the IBM Model Asset eXchange
  4. An introduction to the internals of the Model Asset eXchange
  5. Where are my new models for NLP? They’re here!
  6. Running MAX Deep Learning models on Raspberry Pi

Slides and Video Recordings

Slides

  1. Slide - Ready to use Deep Learning Models: All You Need is 5 Minutes (Gabriela de Queiroz)

  2. Slide - Demystifying Data Science (Gabriela de Queiroz)

Videos

  1. Video - Image Cropping Web App (Nick Kasten) (based on the demp application code pattern)

    About : Use a free, open-source deep learning model to detect different types of objects in an image, then interact with them in a drag-and-drop web application.

  2. Video - Object Detector Web App demo (Alex Bozarth)

    About : The IBM Model Asset eXchange (MAX) has given application developers without data science experience easy access to prebuilt machine learning models. This web app uses the Object Detector from MAX and creates a simple web UI that displays bounding boxes around detected objects in an image and lets you filter the objects based on their label and probable accuracy given by the model.

  3. Video - Lighting Talk: IBM Code Model Asset Exchange (Brendan Dwyer)

    About: This talk walks you through the process of building Model Asset Exchange

  4. Video - Bringing an AI Ecosystem to the Domain Expert and Enterprise AI Developer (Frederick Reiss & Vijay Bommireddipalli)

    About : In this talk, we’ll break down the challenges a domain expert faces today in applying AI to real-world problems. We’ll talk about the challenges that a domain expert needs to overcome in order to go from “I know a model of this type exists” to “I can tell an application developer how to apply this model to my domain.”

  5. Video - Deploying Machine Learning Models in Practice (Nick Pentreath)

    About : The talk will cover various options for the most popular and widely used ML libraries, including MLeap, TF Serving and open standards such as PMML, PFA and the recently announced ONNX for Deep Learning. I will also introduce Aardpfark, initially covering Spark ML pipelines - as well as experimental work for exporting Spark ML pipelines to TensorFlow graphs for use with TF Serving.

  6. Video - Lessons Learned Building an Open Deep Learning Model Exchange (Nick Pentreath)

    About : This talk walks you through the process of building MAX and shares challenges and problems encountered, the solutions developed, and the lessons learned, along with best practices for cross-framework, standardized deep learning model training and deployment.

  7. Video - Deploy Deep Learning models as Microservices in minutes - Gabriela de Queiroz, Karthik Muthuraman and Saishruthi Swaminathan

    About The talk will cover Model Asset Exchange, Data Asset Exchange and explains steps for wrapping a custom model using MAX-Framework.

Community

  1. Join Community Slack
  2. CODAIT Twitter
  3. CODAIT Medium
  4. IBM Developer
  5. GitHub Issues