Awesome

<br /> <div align="center"> <picture>  <source srcset="docs/source/assets/coolchic-logo-light.png" media="(prefers-color-scheme: light)" alt="Cool-chic Logo" height="200"/>  <source srcset="docs/source/assets/coolchic-logo-dark.png" media="(prefers-color-scheme: dark)" alt="Cool-chic Logo" height="200"/>  <img src="docs/source/assets/coolchic-logo-dark.png" alt="Cool-chic Logo" height="200"/> </picture> <p align="center">  <br /> <a href="https://orange-opensource.github.io/Cool-Chic/"><strong>Explore the docs »</strong></a> <br /> <br /> <a href="https://orange-opensource.github.io/Cool-Chic/getting_started/new_stuff.html">What's new in 3.4?</a> · <a href="https://orange-opensource.github.io/Cool-Chic/getting_started/results.html">Decode some bitstreams</a> · <a href="https://orange-opensource.github.io/Cool-Chic/getting_started/results.html#clic20-pro-valid">Coding performance</a> </p> </div>

Cool-chic (pronounced <span class="ipa">/kul ʃik/</span> as in French 🥖🧀🍷) is a low-complexity neural image codec based on overfitting. It offers image coding performance competitive with H.266/VVC for 1000 multiplications per decoded pixel.

🏆 Coding performance: Cool-chic compresses images as well as H.266/VVC 🏆

🚀 Fast CPU-only decoder: Decode a 1280x720 image in 100 ms on CPU with our decoder written in C 🚀

🔥 Fixed-point decoder: Fixed-point arithmetic at the decoder for bit-exact results on different hardwares 🔥

🖼️ I/O format: Encode PNG, PPM and YUV 420 & 444 files with a bitdepth of 8 to 16 bits 🖼️

</div>

Latest release: 🎉 Cool-chic 3.4: 30% less complex! 🎉

</div>

New and improved latent upsampling module
- Leverage symmetric and separable convolution kernels to reduce complexity & parameters count
- Learn two filters per upsampling step instead of one for all upsampling steps
1% to 5% rate reduction for the same image quality
30% complexity reduction using a smaller Auto-Regressive Module
- From 2000 MAC / decoded pixel to 1300 MAC / decoded pixel
- 10% faster decoding speed

Check-out the release history to see previous versions of Cool-chic.

Setup

More details are available on the Cool-chic page

# We need to get these packages to compile the C API and bind it to python.
sudo add-apt-repository -y ppa:deadsnakes/ppa && sudo apt update
sudo apt install -y build-essential python3.10-dev pip
git clone https://github.com/Orange-OpenSource/Cool-Chic.git && cd Cool-Chic

# Install create and activate virtual env
python3.10 -m pip install virtualenv
python3.10 -m virtualenv venv && source venv/bin/activate

# Install Cool-chic
pip install -e .

# Sanity check
python -m test.sanity_check

You're good to go!

Performance

The Cool-chic page provides comprehensive rate-distortion results and compressed bitstreams allowing to reproduce the results inside the results/ directory.

<table class="tg"><thead> <tr> <th class="tg-86ol" rowspan="2"></th> <th class="tg-86ol" colspan="6">BD-rate of Cool-chic 3.4 vs. [%]</th> <th class="tg-86ol" colspan="2">Avg. decoder complexity</th> </tr> <tr> <th class="tg-86ol"><a href="https://arxiv.org/abs/2001.01568" target="_blank" rel="noopener noreferrer">Cheng</a></th> <th class="tg-86ol"><a href="https://arxiv.org/abs/2203.10886" target="_blank" rel="noopener noreferrer">ELIC</a></th> <th class="tg-dfl2"><span style="font-weight:bold">Cool-chic 3.3</span></th> <th class="tg-86ol"><a href="https://arxiv.org/abs/2312.02753" target="_blank" rel="noopener noreferrer">C3</a></th> <th class="tg-86ol">HEVC (HM 16)</th> <th class="tg-86ol">VVC (VTM 19)</th> <th class="tg-86ol">MAC / pixel</th> <th class="tg-86ol">CPU Time [ms]</th> </tr></thead> <tbody> <tr> <td class="tg-86ol">kodak</td> <td class="tg-qch7"><span style="color:green" > -4.2 % </span></td> <td class="tg-xd3r"><span style="color:red" > +7.5 % </span></td> <td class="tg-qch7"><span style="color:green" > -0.9 % </span></td> <td class="tg-qch7"><span style="color:green" > -4.3 % </span></td> <td class="tg-qch7"><span style="color:green" > -17.2 % </span></td> <td class="tg-xd3r"><span style="color:red" > +3.4 % </span></td> <td class="tg-dfl2">1303</td> <td class="tg-dfl2">74</td> </tr> <tr> <td class="tg-86ol">clic20-pro-valid</td> <td class="tg-qch7"><span style="color:green" > -13.2 % </span></td> <td class="tg-qch7"><span style="color:green" > -0.2 % </span></td> <td class="tg-qch7"><span style="color:green" > -0.3 % </span></td> <td class="tg-qch7"><span style="color:green" > -1.3 % </span></td> <td class="tg-qch7"><span style="color:green" > -25.1 % </span></td> <td class="tg-qch7"><span style="color:green" > -2.3 %<br> </span></td> <td class="tg-dfl2">1357</td> <td class="tg-dfl2">354</td> </tr> <tr> <td class="tg-86ol">jvet </td> <td class="tg-5niz"><span style="color:gray" >/</span></td> <td class="tg-5niz"><span style="color:gray" >/</span></td> <td class="tg-qch7"><span style="color:green" >-0.2 %</span></td> <td class="tg-5niz"><span style="color:gray" >/</span></td> <td class="tg-qch7"><span style="color:green" >-18.3 %</span></td> <td class="tg-xd3r"><span style="color:red" >+18.6 %</span></td> <td class="tg-dfl2">1249</td> <td class="tg-dfl2">143</td> </tr> </tbody></table> <br/>

Decoding time are obtained on a single CPU core of an an AMD EPYC 7282 16-Core Processor

PSNR is computed in the RGB domain for kodak and CLIC20, in the YUV420 domain for jvet

Kodak

CLIC20 Pro Valid

JVET Class B

Thanks

Special thanks go to Hyunjik Kim, Matthias Bauer, Lucas Theis, Jonathan Richard Schwarz and Emilien Dupont for their great work enhancing Cool-chic: C3: High-performance and low-complexity neural compression from a single image or video, Kim et al.

<div align="center">

</br> <picture>  <img src="docs/source/assets/logo_orange.png" alt="Cool-chic Logo" height="150"/> </picture> </div>