Awesome
<p align="center"> <img src="./figs/EA.bmp" alt="image" style="width:1000px;"> </p>Purpose: We aim to achieve a unfied intellignet image/video PS/enhancement framework. More functions will be developed.
Brief intro for current function: Enhance and restore anything continuously with Segment Anything Model for image processing (The initial version is achieved with CResMD, and it will be extended in future).
🌟 Enhance Anything Features
- Continuously Enhance Anything by a simple click
- Assist Colorizing Anything
- Assist multiple distortion types
- Assist multiple enhancement types
- Technique Analysis - Arxiv Version
- Demo
- Improving generalization capability
Visual Examples
Enhance zebra continuously
<p align="center"> <img src="./figs/yang_zebra_com.gif" alt="image" style="width:1000px;"> </p>Enhance dog and chair continuously
<p align="center"> <img src="./figs/yang_sample2_com.gif" alt="image" style="width:1000px;"> </p>Enhance dog continuously
<p align="center"> <img src="./figs/yang_sample1_com.gif" alt="image" style="width:1000px;"> </p>Enhance butterfly continuously
<p align="center"> <img src="./figs/yang_0006.gif" alt="image" style="width:500px;"> </p>Usages
Please download the weights for segment-anything, and move it to ./pretrained_weights. Then you can run the code with:
python enhance_anything_continusly.py --input_img ./examples/0006.png --point_coords 200 300 --point_labels 1 --dilate_kernel_size 30 --output_dir ./results --sam_model_type "vit_h" --sam_ckpt ./pretrained_models/sam_vit_h_4b8939.pth --opt ./CResMD/options/test/modulation_CResMD.yml
The results are shown in ./results_continuous/.
Environment
conda create -n seganything python
python -m pip install torch torchvision torchaudio
python -m pip install -e segment_anything
python -m pip install lmdb