Home

Awesome

An Elderly Indoor Care Chatbot (OpenVINO optimised YOLOv8 + OpenAI Chat API with functions)

This is a fun application of OpenVINO and OpenAI Chatbot API. (In more simple words a YOLO-Chat or chat with current scene)

head

Some interesting capabilities of the chatbot:

How it works?

How can this be used?

How can this project be extended? (Since this is just an experimental project, we can extend it in the following ways)

How to run

  1. Install the requirements:
    pip install -r requirements.txt
    
  2. Create the optimized model by running the notebook cells at prepareModel.ipynb to convert the model to OpenVINO format. (IMPORTANT)
  3. Run the cells at main.ipynb to start the chatbot and interact with it.

Note: Demo won't work without creating the optimized model.

Project file structure

Demo (CPU)

Live interaction with the scene using the chatbot. (Left - Chatbot, Right - Camera feed. Notebook split to show the camera feed which outputs the live frames a cell above the chatbot cell.) demo1 demo2 demo3

OpenVINO Optimized YOLOv8 Model running on a CPU demo4