Awesome

This project is associated with our survey paper, which comprehensively reviews the advancement of colorization technology in the past two decades using our proposed taxonomy.

Computer-aided Colorization State-of-the-science: A Survey Yu Cao, Xin Duan, Xiangqiao Meng, P. Y. Mok, Ping Li, and Tong-Yee Lee This work is submitted.

You are welcome to promote papers via pull request. The process to submit a pull request:

a. Fork the project into your own repository.
b. Add the Title, Author, Year Full name of Journal or Conference, Paper link in README.md with the below format:

**Title** <br>
*Author* <br>
Year Full name of Journal or Conference 
[[Paper](Paper link)]

c. Submit the pull request to this branch.

Related Surveys

Image Colorization: A Survey and Dataset Saeed Anwar, Muhammad Tahir, Chongyi Li, Ajmal Mian, Fahad Shahbaz Khan, and Abdul Wahab Muzaffar 2020 Arxiv [Paper]

Deep Learning for Image Colorization: Current and Future Prospects Shanshan Huang, Xin Jin, Qian Jiang, and Li Liu 2022 Engineering Applications of Artificial Intelligence [Paper]

A Review of Image and Video Colorization: From Analogies to Deep Learning Shu-Yu Chen, Jia-Qi Zhang, You-You Zhao, Paul L. Rosin, Yu-Kun Lai, and Lin Gao 2022 Visual Informatics [Paper]

Conditional Colorization

Reference-based Methods

Transferring Color to Greyscale Images Tomihisa Welsh, Michael Ashikhmin, and Klaus Mueller 2002 ACM Transactions on Graphics [Paper]

Local Color Transfer via Probabilistic Segmentation by Expectation-Maximization Yu-Wing Tai, Jiaya Jia, and Chi-Keung Tang 2005 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Colorization by Example Revital Ironi, Daniel Cohen-Or, and Dani Lischinski 2005 Eurographics Symposium on Rendering [Paper]

Automatic Image Colorization via Multimodal Predictions Guillaume Charpiat, Matthias Hofmann, and Bernhard Schölkopf 2008 European Conference on Computer Vision [Paper]

Intrinsic Colorization Xiaopei Liu, Liang Wan, Yingge Qu, Tien-Tsin Wong, Stephen Lin, Chi-Sing Leung, and Pheng-Ann Heng 2008 ACM Transactions on Graphics [Paper]

Automatic colorization of grayscale images using multiple images on the Web Yuji Morimoto, Yuichi Taguchi, and Takeshi Naemura 2009 ACM SIGGRAPH Talks [Paper]

Semantic Colorization with Internet Images Alex Yong-Sang Chia, Shaojie Zhuo, Raj Kumar Gupta, Yu-Wing Tai, Siu-Yeung Cho, Ping Tan, and Stephen Lin 2011 ACM Transactions on Graphics [Paper]

Image Colorization Using Similar Images Raj Kumar Gupta, Alex Yong-Sang Chia, Deepu Rajan, Ee Sin Ng, and Huang Zhiyong 2012 ACM International Conference on Multimedia [Paper]

Variational Exemplar-Based Image Colorization Aurélie Bugeau, Vinh-Thong Ta, and Nicolas Papadakis 2014 IEEE Transactions on Image Processing [Paper]

Twin Deep Convolutional Neural Network for Example-based Image Colorization Domonkos Varga, and Tamás Szirányi 2017 Computer Analysis of Images and Patterns [Paper]

Comicolorization: Semi-Automatic Manga Colorization Chie Furusawa, Kazuyuki Hiroshiba, Keisuke Ogaki, and Yuri Odagiri 2017 ACM SIGGRAPH Asia Technical Briefs [Paper]

TextureGAN: Controlling Deep Image Synthesis with Texture Patches Wenqi Xian, Patsorn Sangkloy, Varun Agrawal, Amit Raj, Jingwan Lu, Chen Fang, Fisher Yu, and James Hays 2018 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Deep Exemplar-based Colorization Mingming He, Dongdong Chen, Jing Liao, Pedro V. Sander, and Lu Yuan 2018 ACM Transactions on Graphics [Paper]

Example-Based Colourization Via Dense Encoding Pyramids Chufeng Xiao, Chu Han, Zhuming Zhang, Jing Qin, Tien-Tsin Wong, Guoqiang Han, and Shengfeng He 2019 Computer Graphics Forum [Paper]

Automatic Example-Based Image Colorization Using Location-Aware Cross-Scale Matching Bo Li, Yu-Kun Lai, Matthew John, and Paul L. Rosin 2019 IEEE Transactions on Image Processing [Paper]

Colorization of Line Drawings with Empty Pupils K. Akita, Y. Morimoto, and R. Tsuruno 2020 Computer Graphics Forum [Paper]

Reference-Based Sketch Image Colorization using Augmented-Self Reference and Dense Semantic Correspondence Junsoo Lee, Eungyeup Kim, Yunsung Lee, Dongjun Kim, Jaehyuk Chang, and Jaegul Choo 2020 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Stylization-Based Architecture for Fast Deep Exemplar Colorization Zhongyou Xu, Tingting Wang, Faming Fang, Yun Sheng, and Guixu Zhang 2020 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Deep-Eyes: Fully Automatic Anime Character Colorization with Painting of Details on Empty Pupils K. Akita, Y. Morimoto, and R. Tsuruno 2020 Eurographics [Paper]

Gray2ColorNet: Transfer More Colors from Reference Image Peng Lu, Jinbei Yu, Xujun Peng, Zhaoran Zhao, and Xiaojie Wang 2020 ACM International Conference on Multimedia [Paper]

Manga Filling Style Conversion with Screentone Variational Autoencoder Minshan Xie, Chengze Li, Xueting Liu, and Tien-Tsin Wong 2020 ACM Transactions on Graphics [Paper]

A Superpixel-Based Variational Model for Image Colorization Faming Fang, Tingting Wang, Tieyong Zeng, and Guixu Zhang 2020 IEEE Transactions on Visualization and Computer Graphics [Paper]

Line Art Colorization Based on Explicit Region Segmentation Ruizhi Cao, Haoran Mo, and Chengying Gao 2021 Computer Graphics Forum [Paper]

Color2Embed: Fast Exemplar-Based Image Colorization using Color Embeddings Hengyuan Zhao, Wenhao Wu, Yihao Liu, and Dongliang He 2021 Arxiv [Paper]

Yes, “Attention Is All You Need”, for Exemplar based Colorization Wang Yin, Peng Lu, Zhaoran Zhao, and Xujun Peng 2021 ACM International Conference on Multimedia [Paper]

Globally and Locally Semantic Colorization via Exemplar-Based Broad-GAN Haoxuan Li, Bin Sheng, Ping Li, Riaz Ali, and C. L. Philip Chen 2021 IEEE Transactions on Image Processing [Paper]

Super-Attention for Exemplar-Based Image Colorization Hernan Carrillo, Michaël Clément, and Aurélie Bugeau 2022 Asian Conference on Computer Vision [Paper]

Reference-Guided Structure-Aware Deep Sketch Colorization for Cartoons Xueting Liu, Wenliang Wu, Chengze Li, Yifan Li, and Huisi Wu 2022 Computational Visual Media [Paper]

Eliminating Gradient Conflict in Reference-based Line-Art Colorization Zekun Li, Zhengyang Geng, Zhao Kang, Wenyu Chen, and Yibo Yang 2022 European Conference on Computer Vision [Paper]

Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization Yunpeng Bai, Chao Dong, Zenghao Chai, Andong Wang, Zhengzhuo Xu, and Chun Yuan 2022 European Conference on Computer Vision [Paper]

Active Colorization for Cartoon Line Drawings Shu-Yu Chen, Jia-Qi Zhang, Lin Gao, Yue He, Shihong Xia, Min Shi, and Fang-Lue Zhang 2022 IEEE Transactions on Visualization and Computer Graphics [Paper]

Attention-Aware Anime Line Drawing Colorization Yu Cao, Hao Tian, and P. Y. Mok 2023 IEEE International Conference on Multimedia & Expo [Paper]

Self-driven Dual-path Learning for Reference-based Line Art Colorization under Limited Data Shukai Wu, Xiao Yan, Weiming Liu, Shuchang Xu, and Sanyuan Zhang 2023 IEEE Transactions on Circuits and Systems for Video Technology [Paper]

Unsupervised Deep Exemplar Colorization via Pyramid Dual Non-Local Attention Hanzhang Wang, Deming Zhai, Xianming Liu, Junjun Jiang, and Wen Gao 2023 IEEE Transactions on Image Processing [Paper]

Pik-Fix: Restoring and Colorizing Old Photos Runsheng Xu, Zhengzhong Tu, Yuanqi Du, Xiaoyu Dong, Jinlong Li, Zibo Meng, Jiaqi Ma, Alan Bovik, and Hongkai Yu 2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

AnimeDiffusion: Anime Diffusion Colorization Yu Cao, Xiangqiao Meng, P. Y. Mok, Tong-Yee Lee, Xueting Liu, and Ping Li 2024 IEEE Transactions on Visualization and Computer Graphics [Paper]

Scribble-hint Methods

Colorization using Optimization Anat Levin, Dani Lischinski, and Yair Weiss 2004 ACM Transactions on Graphics [Paper]

An Adaptive Edge Detection Based Colorization Algorithm and Its Applications Yi-Chin Huang, Yi-Shin Tung, Jun-Cheng Chen, Sung-Wen Wang, and Ja-Ling Wu 2005 ACM International Conference on Multimedia [Paper]

Fast Image and Video Colorization Using Chrominance Blending Liron Yatziv, and Guillermo Sapiro 2006 IEEE Transactions on Image Processing [Paper]

Manga Colorization Yingge Qu, Tien-Tsin Wong, and Pheng-Ann Heng 2006 ACM Transactions on Graphics [Paper]

Natural Image Colorization Qing Luan, Fang Wen, Daniel Cohen-Or, Lin Liang, Ying-Qing Xu, and Heung-Yeung Shum 2007 Eurographics Symposium on Rendering [Paper]

LazyBrush: Flexible Painting Tool for Hand-drawn Cartoons Daniel Sýkora, John Dingliana, and Steven Collins 2009 Computer Graphics Forum [Paper]

Scribbler: Controlling Deep Image Synthesis with Sketch and Color Patsorn Sangkloy, Jingwan Lu, Chen Fang, Fisher Yu, and James Hays 2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks Yifan Liu, Zengchang Qin, Zhenbo Luo, and Hua Wang 2017 Neurocomputing [Paper]

Outline Colorization through Tandem Adversarial Networks Kevin Frans 2017 Arxiv [Paper]

Real-Time User-Guided Image Colorization with Learned Deep Priors Richard Zhang, Jun-Yan Zhu, Phillip Isola, Xinyang Geng, Angela S. Lin, Tianhe Yu, and Alexei A. Efros 2017 ACM Transactions on Graphics [Paper]

User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks Yuanzheng Ci, Xinzhu Ma, Zhihui Wang, Haojie Li, and Zhongxuan Luo 2018 ACM International Conference on Multimedia [Paper]

Two-stage Sketch Colorization Lvmin Zhang, Chengze Li, Tien-Tsin Wong, Yi Ji, and Chunping Liu 2018 ACM Transactions on Graphics [Paper]

Interactive Deep Colorization and its Application for Image Compression Yi Xiao, Jin Wu, Jie Zhang, Peiyao Zhou, Yan Zheng, Chi-Sing Leung, and Ladislav Kavan 2020 IEEE Transactions on Visualization and Computer Graphics [Paper]

User-Guided Line Art Flat Filling with Split Filling Mechanism Lvmin Zhang, Chengze Li, Edgar Simo-Serra, Yi Ji, Tien-Tsin Wong, and Chunping Liu 2021 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Line Art Colorization with Concatenated Spatial Attention Mingcheng Yuan, and Edgar Simo-Serra 2021 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Deep Edge-Aware Interactive Colorization against Color-Bleeding Effects Eungyeup Kim, Sanghyeon Lee, Jeonghoon Park, Somi Choi, Choonghyun Seo, and Jaegul Choo 2021 IEEE International Conference on Computer Vision [Paper]

Dual Color Space Guided Sketch Colorization Zhi Dou, Ning Wang, Baopu Li, Zhihui Wang, Haojie Li, and Bin Liu 2021 IEEE Transactions on Image Processing [Paper]

Diffusart: Enhancing Line Art Colorization with Conditional Diffusion Models Hernan Carrillo, Michaël Clément, Aurélie Bugeau, and Edgar Simo-Serra 2023 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Guiding Users to Where to Give Color Hints for Efficient Interactive Sketch Colorization via Unsupervised Region Prioritization Youngin Cho, Junsoo Lee, Soyoung Yang, Juntae Kim, Yeojeong Park, Haneol Lee, Mohammad Azam Khan, Daesik Kim, and Jaegul Choo 2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

iColoriT: Towards Propagating Local Hints to the Right Region in Interactive Colorization by Leveraging Vision Transformer Jooyeol Yun, Sanghyeon Lee, Minho Park, and Jaegul Choo 2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

Text-based Methods

Language-Based Image Editing with Recurrent Attentive Models Jianbo Chen, Yelong Shen, Jianfeng Gao, Jingjing Liu, and Xiaodong Liu 2018 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation Hyojin Bahng, Seungjoo Yoo, Wonwoong Cho, David Keetae Park, Ziming Wu, Xiaojuan Ma, and Jaegul Choo 2018 European Conference on Computer Vision [Paper]

Learning to Color from Language Varun Manjunatha, Mohit Iyyer, Jordan Boyd-Graber, and Larry Davis 2018 Annual Conference of the North American Chapter of the Association for Computational Linguistics [Paper]

Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss Hyunsu Kim, Ho Young Jhoo, Eunhyeok Park, and Sungjoo Yoo 2019 IEEE International Conference on Computer Vision [Paper]

Language-based Colorization of Scene Sketches Changqing Zou, Haoran Mo, Chengying Gao, Ruofei Du, and Hongbo Fu 2019 ACM Transactions on Graphics [Paper]

Line Art Colorization Based on Explicit Region Segmentation Ruizhi Cao, Haoran Mo, and Chengying Gao 2021 Computer Graphics Forum [Paper]

L-CoDe: Language-based Colorization using Color-object Decoupled Conditions Shuchen Weng, Hao Wu, Zheng Chang, Jiajun Tang, Si Li, and Boxin Shi 2022 AAAI Conference on Artificial Intelligence [Paper]

L-CoDer: Language-based Colorization with Color-object Decoupling Transformer Zheng Chang, Shuchen Weng, Yu Li, Si Li, and Boxin Shi 2022 European Conference on Computer Vision [Paper]

L-CoIns: Language-based Colorization with Instance Awareness Zheng Chang, Shuchen Weng, Peixuan Zhang, Yu Li, Si Li, and Boxin Shi 2023 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

L-CAD: Language-based Colorization with Any-level Descriptions Zheng Chang, Shuchen Weng, Peixuan Zhang, Yu Li, Si Li, and Boxin Shi 2023 Advances in Neural Information Processing Systems [Paper]

Palette-based Methods

Affective Image Colorization Xiao-Hui Wang, Jia Jia, Han-Yu Liao, and Lian-Hong Cai 2012 Journal of Computer Science and Technology [Paper]

Palette-based Photo Recoloring Huiwen Chang, Ohad Fried, Yiming Liu, Stephen DiVerdi, and Adam Finkelstein 2015 ACM Transactions on Graphics [Paper]

Diverse Colorization

Automatic Image Colorization via Multimodal Predictions Guillaume Charpiat, Matthias Hofmann, and Bernhard Schölkopf 2008 European Conference on Computer Vision [Paper]

Pixel Recurrent Neural Networks Aaron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu 2016 International Conference on Machine Learning [Paper]

PixColor: Pixel Recursive Colorization Sergio Guadarrama, Ryan Dahl, David Bieber, Mohammad Norouzi, Jonathon Shlens, and Kevin Murphy 2017 British Machine Vision Conference [Paper]

Probabilistic Image Colorization Amelie Royer, Alexander Kolesnikov, and Christoph H. Lampert 2017 British Machine Vision Conference [Paper]

Multiple Hypothesis Colorization and Its Application to Image Compression Mohammad Haris Baig, and Lorenzo Torresani 2017 Computer Vision and Image Understanding [Paper]

Learning Diverse Image Colorization Aditya Deshpande, Jiajun Lu, Mao-Chuang Yeh, Min Jin Chong, and David Forsyth 2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Unsupervised Diverse Colorization via Generative Adversarial Networks Yun Cao, Zhiming Zhou, Weinan Zhang, and Yong Yu 2017 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases [Paper]

Structural Consistency and Controllability for Diverse Colorization Safa Messaoud, David Forsyth, and Alexander G. Schwing 2018 European Conference on Computer Vision [Paper]

Towards Vivid and Diverse Image Colorization with Generative Color Prior Yanze Wu, Xintao Wang, Yu Li, Honglun Zhang, Xun Zhao, and Ying Shan 2021 IEEE International Conference on Computer Vision [Paper]

Video Colorization Methods

Fast Image and Video Colorization Using Chrominance Blending Liron Yatziv, and Guillermo Sapiro 2006 IEEE Transactions on Image Processing [Paper]

Colorization of Grayscale Images and Videos Using A Semiautomatic Approach Vivek George Jacob, and Sumana Gupta 2009 IEEE International Conference on Image Processing [Paper]

Video Colorization Using Parallel Optimization in Feature Space Bin Sheng, Hanqiu Sun, Marcus Magnor, and Ping Li 2014 IEEE Transactions on Circuits and Systems for Video Technology [Paper]

Approximate Nearest Neighbor Fields in Video Nir Ben-Zrihem, and Lihi Zelnik-Manor 2015 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Blind Video Temporal Consistency Nicolas Bonneel, James Tompkin, Kalyan Sunkavalli, Deqing Sun, Sylvain Paris, and Hanspeter Pfister 2015 ACM Transactions on Graphics [Paper]

Robust and Automatic Video Colorization via Multiframe Reordering Refinement Sifeng Xia, Jiaying Liu, Yuming Fang, Wenhan Yang, and Zongming Guo 2016 IEEE International Conference on Image Processing [Paper]

Video Propagation Networks Varun Jampani, Raghudeep Gadde, and Peter V. Gehler 2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Spatiotemporal Colorization of Video Using 3D Steerable Pyramids Somdyuti Paul, Saumik Bhattacharya, and Sumana Gupta 2017 IEEE Transactions on Circuits and Systems for Video Technology [Paper]

Deep Video Color Propagation Simone Meyer, Victor Cornillère, Abdelaziz Djelouah, Christopher Schroers, and Markus Gross 2018 British Machine Vision Conference [Paper]

Learning Blind Video Temporal Consistency Wei-Sheng Lai, Jia-Bin Huang, Oliver Wang, Eli Shechtman, Ersin Yumer, and Ming-Hsuan Yang 2018 European Conference on Computer Vision [Paper]

Switchable Temporal Propagation Network Sifei Liu, Guangyu Zhong, Shalini De Mello, Jinwei Gu, Varun Jampani, Ming-Hsuan Yang, and Jan Kautz 2018 European Conference on Computer Vision [Paper]

Tracking Emerges by Colorizing Videos Carl Vondrick, Abhinav Shrivastava, Alireza Fathi, Sergio Guadarrama, and Kevin Murphy 2018 European Conference on Computer Vision [Paper]

Automatic Temporally Coherent Video Colorization Harrish Thasarathan, Kamyar Nazeri, and Mehran Ebrahimi 2019 Conference on Computer and Robot Vision [Paper]

Deep Exemplar-based Video Colorization Bo Zhang, Mingming He, Jing Liao, Pedro V. Sander, Lu Yuan, Amine Bermak, and Dong Chen 2019 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Fully Automatic Video Colorization with Self-Regularization and Diversity Chenyang Lei, and Qifeng Chen 2019 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

DeepRemaster: Temporal Source-Reference Attention Networks for Comprehensive Video Enhancement Satoshi Iizuka, and Edgar Simo-Serra 2019 ACM Transactions on Graphics [Paper]

Blind Video Temporal Consistency via Deep Video Prior Chenyang Lei, Yazhou Xing, and Qifeng Chen 2020 Advances in Neural Information Processing Systems [Paper]

Reference-Based Video Colorization with Spatiotemporal Correspondence Naofumi Akimoto, Akio Hayakawa, Andrew Shin, and Takuya Narihira 2020 Arxiv [Paper]

The Animation Transformer: Visual Correspondence via Segment Matching Evan Casey, Víctor Pérez, and Zhuoru Li 2021 IEEE International Conference on Computer Vision [Paper]

Temporally Consistent Video Colorization with Deep Feature Propagation and Self-regularization Learning Yihao Liu, Hengyuan Zhao, Kelvin C.K. Chan, Xintao Wang, Chen Change Loy, Yu Qiao, and Chao Dong 2021 Arxiv [Paper]

Line Art Correlation Matching Feature Transfer Network for Automatic Animation Colorization Qian Zhang, Bo Wang, Wei Wen, Hai Li, and Junhui Liu 2021 IEEE Winter Conference on Applications of Computer Vision [Paper]

BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization Yixin Yang, Zhongzheng Peng, Xiaoyu Du, Zhulin Tao, Jinhui Tang, and Jinshan Pan 2022 Arxiv [Paper]

Reference-Based Deep Line Art Video Colorization Min Shi, Jia-Qi Zhang, Shu-Yu Chen, Lin Gao, Yu-Kun Lai, and Fang-Lue Zhang 2022 IEEE Transactions on Visualization and Computer Graphics [Paper]

Exemplar-based Video Colorization with Long-term Spatiotemporal Dependency Siqi Chen, Xueming Li, Xianlin Zhang, Mingdao Wang, Yu Zhang, Jiatong Han, and Yue Zhang 2023 Arxiv [Paper]

SVCNet: Scribble-based Video Colorization Network with Temporal Aggregation Yuzhi Zhao, Lai-Man Po, Kangcheng Liu, Xuehui Wang, Wing-Yin Yu, Pengfei Xian, Yujia Zhang, and Mengyang Liu 2023 IEEE Transactions on Image Processing [Paper]

Video Colorization with Pre-trained Text-to-Image Diffusion Models Hanyuan Liu, Minshan Xie, Jinbo Xing, Chengze Li, and Tien-Tsin Wong 2023 Arxiv [Paper]

Domain-Specific Colorization Methods

Infrared Colorization Using Deep Convolutional Neural Networks Matthias Limmer, and Hendrik P.A. Lensch 2016 IEEE International Conference on Machine Learning and Applications [Paper]

Infrared Image Colorization based on a Triplet DCGAN Architecture Patricia L. Suárez, Angel D. Sappa, and Boris X. Vintimilla 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

(DE)2CO: Deep Depth Colorization Fabio Maria Carlucci, Paolo Russo, and Barbara Caputo 2018 IEEE Robotics and Automation Letters [Paper]

Colorizing Near Infrared Images through a Cyclic Adversarial Approach of Unpaired Samples Armin Mehri, and Angel D. Sappa 2019 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Adversarial Colorization Of Icons Based On Structure And Color Conditions Tsai-Ho Sun, Chien-Hsun Lai, Sai-Keung Wong, and Yu-Shuen Wang 2019 ACM International Conference on Multimedia [Paper]

Colorization of Depth Map via Disentanglement Chung-Sheng Lai, Zunzhi You, Ching-Chun Huang, Yi-Hsuan Tsai, and Wei-Chen Chiu 2020 European Conference on Computer Vision [Paper]

Point2color: 3D Point Cloud Colorization Using a Conditional Generative Network and Differentiable Rendering for Airborne LiDAR Takayuki Shinohara, Haoyi Xiu, and Masashi Matsuoka 2021 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Underwater Image Color Correction Using Ensemble Colorization Network Arpit Pipara, Urvi Oza, and Srimanta Mandal 2021 IEEE International Conference on Computer Vision Workshops [Paper]

Style-Structure Disentangled Features and Normalizing Flows for Diverse Icon Colorization Yuan–kui Li, Yun–Hsuan Lien, and Yu–Shuen Wang 2022 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Generative Colorization of Structured MobileWeb Pages Kotaro Kikuchi, Naoto Inoue, Mayu Otani, Edgar Simo-Serra, and Kota Yamaguchi 2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

Unconditional Colorization

Consider Colorization as A Vision Task

Representation Learning

Colorful Image Colorization Richard Zhang, Phillip Isola, and Alexei A. Efros 2016 European Conference on Computer Vision [Paper]

Learning Representations for Automatic Colorization Gustav Larsson, Michael Maire, and Gregory Shakhnarovich 2016 European Conference on Computer Vision [Paper]

Colorization as a Proxy Task for Visual Understanding Gustav Larsson, Michael Maire, and Gregory Shakhnarovich 2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Image-to-Image Translation

Generalized Deep Image to Image Regression Venkataraman Santhanam, Vlad I. Morariu, and Larry S. Davis 2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros 2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Image Restoration and Enhancement

SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution Jiangning Zhang, Chao Xu, Jian Li, Yue Han, Yabiao Wang, Ying Tai, and Yong Liu 2022 AAAI Conference on Artificial Intelligence [Paper]

BIGPrior: Toward Decoupling Learned Prior Hallucination and Data Fidelity in Image Restoration Majed El Helou, and Sabine Süsstrunk 2022 IEEE Transactions on Image Processing [Paper]

Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation Xingang Pan , Xiaohang Zhan , Bo Dai , Dahua Lin, Chen Change Loy, and Ping Luo 2022 IEEE Transactions on Pattern Analysis and Machine Intelligence [Paper]

Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model Yinhuai Wang, Jiwen Yu, and Jian Zhang 2023 International Conference on Learning Representations [Paper]

GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond Kelvin C.K. Chan, Xiangyu Xu, Xintao Wang, Jinwei Gu, and Chen Change Loy 2023 IEEE Transactions on Pattern Analysis and Machine Intelligence [Paper]

Semantic Colorization

Global Level

Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa 2016 ACM Transactions on Graphics [Paper]

ChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution Patricia Vitoria, Lara Raad, and Coloma Ballester 2020 IEEE Winter Conference on Applications of Computer Vision [Paper]

Broad Colorization Yuxi Jin, Bin Sheng, Ping Li, and C. L. Philip Chen 2021 IEEE Transactions on Neural Networks and Learning Systems [Paper]

Disentangled Image Colorization via Global Anchors Menghan Xia, Wenbo Hu, Tien-Tsin Wong, and Jue Wang 2022 ACM Transactions on Graphics [Paper]

DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders Xiaoyang Kang, Tao Yang, Wenqi Ouyang, Peiran Ren, Lingzhi Li, and Xuansong Xie 2023 IEEE International Conference on Computer Vision [Paper]

Instance Level

Instance-aware Image Colorization Jheng-Wei Su, Hung-Kuo Chu, and Jia-Bin Huang 2020 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Collaborative Image and Object Level Features for Image Colourisation Rita Pucci, Christian Micheloni, and Niki Martinel 2021 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Pixel Level

Pixel-level Semantics Guided Image Colorization Jiaojiao Zhao, Li Liu, Cees G.M. Snoek, Jungong Han, and Ling Shao 2018 British Machine Vision Conference [Paper]

Image Colorization By Capsule Networks Gökhan Özbulak 2019 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Pixelated Semantic Colorization Jiaojiao Zhao, Jungong Han, Ling Shao, and Cees G. M. Snoek 2020 International Journal of Computer Vision [Paper]

Network Structure

CNN-based Structure

Deep Colorization Zezhou Cheng, Qingxiong Yang, and Bin Sheng 2015 IEEE International Conference on Computer Vision [Paper]

Learning Large-Scale Automatic Image Colorization Aditya Deshpande, Jason Rock, and David Forsyth 2015 IEEE International Conference on Computer Vision [Paper]

Automatic Cartoon Colorization Based on Convolutional Neural Network Domonkos Varga, Csaba Attila Szabó, and Tamás Szirányi 2017 International Workshop on Content-Based Multimedia Indexing [Paper]

Deep Koalarization: Image Colorization using CNNs and Inception-Resnet-v2 Federico Baldassarre, Diego González Morín, and Lucas Rodés-Guirao 2017 Arxiv [Paper]

Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System Xuan Dong, Weixin Li, Xiaojie Wang, and Yunhong Wang 2019 AAAI Conference on Artificial Intelligence [Paper]

A Colorization Framework for Monochrome-Color Dual-Lens Systems Using a Deep Convolutional Network Xuan Dong, Weixin Li, Xiaoyan Hu, Xiaojie Wang, and Yunhong Wang 2022 IEEE Transactions on Visualization and Computer Graphics [Paper]

GAN-based Structure

cGAN-based Manga Colorization Using a Single Training Image Paulina Hensman, and Kiyoharu Aizawa 2017 IAPR International Conference on Document Analysis and Recognition [Paper]

Image Colorization using Generative Adversarial Networks Kamyar Nazeri, Eric Ng, and Mehran Ebrahimi 2018 International Conference on Articulated Motion and Deformable Objects [Paper]

ColoringWith Limited Data: Few-Shot Colorization via Memory Augmented Networks Seungjoo Yoo, Hyojin Bahng, Sunghyo Chung, Junsoo Lee, Jaehyuk Chang, and Jaegul Choo 2019 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Image Colorization Using Generative Adversarial Networks and Transfer Learning Leila Kiani, Masoud Saeed, and Hossein Nezamabadi-pour 2020 International Conference on Machine Vision and Image Processing [Paper]

Focusing on Persons: Colorizing Old Images Learning from Modern Historical Movies Xin Jin, Zhonglan Li, Ke Liu, Dongqing Zou, Xiaodong Li, Xingfan Zhu, Ziyin Zhou, Qilong Sun, and Qingyu Liu 2021 ACM International Conference on Multimedia [Paper]

Exploring Sketch-based Character Design Guided by Automatic Colorization Rawan Alghofaili, Matthew Fisher, Richard Zhang, Michal Lukáč, and Lap-Fai Yu 2021 Graphics Interface [Paper]

SCGAN: Saliency Map-Guided Colorization With Generative Adversarial Network Yuzhi Zhao, Lai-Man Po, Kwok-Wai Cheung, Wing-Yin Yu, and Yasar Abbas Ur Rehman 2021 IEEE Transactions on Circuits and Systems for Video Technology [Paper]

BigColor: Colorization using a Generative Color Prior for Natural Images Geonung Kim, Kyoungkook Kang, Seongtae Kim, Hwayoon Lee, Sehoon Kim, Jonghyun Kim, Seung-Hwan Baek, and Sunghyun Cho 2022 European Conference on Computer Vision [Paper]

Bridging the Domain Gap towards Generalization in Automatic Colorization Hyejin Lee, Daehee Kim, Daeun Lee, Jinkyu Kim, and Jaekoo Lee 2022 European Conference on Computer Vision [Paper]

PalGAN: Image Colorization with Palette Generative Adversarial Networks Yi Wang, Menghan Xia, Lu Qi, Jing Shao, and Yu Qiao 2022 European Conference on Computer Vision [Paper]

Flow-based Structure

Guided Image Generation with Conditional Invertible Neural Networks Lynton Ardizzone, Carsten Lüth, Jakob Kruse, Carsten Rother, and Ullrich Köthe 2019 Arxiv [Paper]

Transformer-based Structure

Colorization Transformer Manoj Kumar, Dirk Weissenborn, and Nal Kalchbrenner 2021 International Conference on Learning Representations [Paper]

ColorFormer: Image Colorization via Color Memory assisted Hybrid-attention Transformer Xiaozhong Ji, Boyuan Jiang, Donghao Luo, Guangpin Tao, Wenqing Chu, Zhifeng Xie, Chengjie Wang, and Ying Tai 2022 European Conference on Computer Vision [Paper]

CT2: Colorization Transformer via Color Tokens Shuchen Weng, Jimeng Sun, Yu Li, Si Li, and Boxin Shi 2022 European Conference on Computer Vision [Paper]

UniColor: A Unified Framework for Multi-Modal Colorization with Transformer Zhitong Huang, Nanxuan Zhao, and Jing Liao 2022 ACM Transactions on Graphics [Paper]

Diffusion-based Structure

Palette: Image-to-Image Diffusion Models Chitwan Saharia, William Chan, Huiwen Chang, Chris A. Lee, Jonathan Ho, Tim Salimans, David J. Fleet, and Mohammad Norouzi 2022 ACM SIGGRAPH [Paper]

Improved Diffusion-based Image Colorization via Piggybacked Models Hanyuan Liu, Jinbo Xing, Minshan Xie, Chengze Li, and Tien-Tsin Wong 2023 Arxiv [Paper]

Diffusing Colors: Image Colorization with Text Guided Diffusion Nir Zabari, PictureAharon Azulay, PictureAlexey Gorkor, PictureTavi Halperin and PictureOhad Fried 2023 ACM SIGGRAPH [Paper]