Awesome

Awesome AI Environment

AI research relies much on learning codes written by other experienced researchers. However, many of open-source codes requires divergent environments. The environment configuration files inside are usually too strict to be compatible with each other. In this repo, we build a general conda environment that can cover as much repositories as possible.

<div align="center"> <b>Currently We Support ...</b> </div> <table align="center"> <tbody> <tr align="center" valign="bottom"> <td> <b>Perception</b> </td> <td> <b>Generation</b> </td> <td> <b>Vision&LLM</b> </td> <td> <b>Others</b> </td> </tr> <tr valign="top"> <td> <b>Detectron2 Based</b> <ul> <li>- [x] <a href="#detectron2">Detectron2</a></li> <li>- [x] <a href="#detrex">Detrex</a></li> <li>- [x] <a href="#odise">ODISE</a></li> <li>- [x] <a href="#deepsolo">DeepSolo</a></li> </ul> <b>Others</b> <ul style="list-style-type:none;margin:0px;padding:0px;"> <li>- [ ] <a href="https://github.com/facebookresearch/segment-anything">SAM</a></li> </ul> </td> <td> <b>Diffusion Based</b> <ul> <li>- [x] <a href="#stable-diffusion-webui">stable-diffusion-webui</a></li> </ul> <b>GAN Based</b> <ul style="list-style-type:none;margin:0px;padding:0px;"> <li>- [x] <a href="#draggan">DragGAN</a></li> </ul> </td> <td> <b>ChatGPT Based</b> <ul style="list-style-type:none;margin:0px;padding:0px;"> <li>- [x] <a href="#taskmatrix">TaskMatrix</a></li> </ul> </td> <td> </td> </tr> </td> </tr> </tbody> </table>

We wish you can contribute

Feel free to experiment with other repos, and pull requests.

Set up a conda environment the same as us.
Check if other repos can run directly. If not, try make minimal changes on existing packages.
Provide short guidance. This is especially important if the pipeline under our env is different from the official tutorial.

Environment Setup

git clone https://github.com/volgachen/Awesome-AI-Environment.git
cd Awesome-AI-Environment

conda env create -f conda_env.yaml
conda activate awesome_env
pip install -r requirements.txt
pip install -r req_no_deps.txt --no-deps

# install the latest version of detectron2
git clone https://github.com/facebookresearch/detectron2.git
python -m pip install -e detectron2

# install maskformer
git clone https://github.com/NVlabs/ODISE.git
pip install panopticapi@https://github.com/cocodataset/panopticapi/archive/master.zip
pip install ODISE/third_party/mask2former --no-deps
# we take the env above, the official one from https://github.com/facebookresearch/Mask2Former.git has not been validated

Chinese users may refer here for faster installations with mirror source.

Detailed Instructions

Detectron2

Detectron has been installed in an editable way. You may edit and import it following official instructions.

Detrex

We consider Detrex as a code project, and would not link it to site-packages. Therefore, the following example codes only ensures that you can run detrex inside the folder.

git clone git@github.com:IDEA-Research/detrex.git
cd detrex
python setup.py build_ext --inplace
PYTHONPATH=/path/to/repo:$PYTHONPATH python tools/train_net.py --config-file ${CONFIG_FILE} --num-gpus ${NUM_GPUS}

ODISE

We consider ODISE as a code project, and would not compile and link it to site-packages. Therefore, the following example codes only ensures that you can run ODISE inside the folder.

git clone git@github.com:NVlabs/ODISE.git
cd ODISE
PYTHONPATH=/path/to/repo:$PYTHONPATH python tools/train_net.py --config-file ${CONFIG_FILE} --num-gpus ${NUM_GPUS}

DeepSolo

We consider ODISE as a code project, and would not compile and link it to site-packages. Therefore, the following example codes only ensures that you can run ODISE inside the folder.

git clone git@github.com:ViTAE-Transformer/DeepSolo.git
cd DeepSolo
python setup.py build_ext --inplace
PYTHONPATH=/path/to/repo:$PYTHONPATH python tools/train_net.py --config-file ${CONFIG_FILE} --num-gpus ${NUM_GPUS}

TaskMatrix

Please click the heading and follow our forked branch, the difference is:

Adapt to the newest version of langchain (v0.0.225)
Allow socks5 proxy to reach openai

Stable-Diffusion-WebUI

Validated at 394ffa7

We only demonstrate the easiest way to launch webui.

Note that we must replace REQS_FILE so that it would not automatically update our environment.

export REQS_FILE=/PATH-TO-Awesome-AI-Environment/requirements.txt
python launch.py --listen --port 4001 --disable-safe-unpickle --share