Home

Awesome

OpenVino GPT-Neo

This is a port of GPT-Neo that uses OpenVino - and hopefully the Intel Neural Compressor - to run on CPU.

Installation

  1. venv
  2. pip install -r requirements.txt
  3. python ovify.py

Run

pythong main.py

Links

For Embeddings:

Chatbot: