This project is associated with our survey paper, which comprehensively reviews the advancement of colorization technology in the past two decades using our proposed taxonomy.

Computer-aided Colorization State-of-the-science: A Survey
Yu Cao, Xin Duan, Xiangqiao Meng, P. Y. Mok, Ping Li, and Tong-Yee Lee
This work is submitted.

You are welcome to promote papers via pull request.
The process to submit a pull request:

• a. Fork the project into your own repository.
• b. Add the Title, Author, Year Full name of Journal or Conference, Paper link in README.md with the below format:

**Title** <br>
*Author* <br>
Year Full name of Journal or Conference 
[[Paper](Paper link)]

• c. Submit the pull request to this branch.

Related Surveys

Image Colorization: A Survey and Dataset
Saeed Anwar, Muhammad Tahir, Chongyi Li, Ajmal Mian, Fahad Shahbaz Khan, and Abdul Wahab Muzaffar
2020 Arxiv [Paper]

Deep Learning for Image Colorization: Current and Future Prospects
Shanshan Huang, Xin Jin, Qian Jiang, and Li Liu
2022 Engineering Applications of Artificial Intelligence [Paper]

A Review of Image and Video Colorization: From Analogies to Deep Learning
Shu-Yu Chen, Jia-Qi Zhang, You-You Zhao, Paul L. Rosin, Yu-Kun Lai, and Lin Gao
2022 Visual Informatics [Paper]

Conditional Colorization

Reference-based Methods

Transferring Color to Greyscale Images
Tomihisa Welsh, Michael Ashikhmin, and Klaus Mueller
2002 ACM Transactions on Graphics [Paper]

Local Color Transfer via Probabilistic Segmentation by Expectation-Maximization
Yu-Wing Tai, Jiaya Jia, and Chi-Keung Tang
2005 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Colorization by Example
Revital Ironi, Daniel Cohen-Or, and Dani Lischinski
2005 Eurographics Symposium on Rendering [Paper]

Automatic Image Colorization via Multimodal Predictions
Guillaume Charpiat, Matthias Hofmann, and Bernhard Schölkopf
2008 European Conference on Computer Vision [Paper]

Intrinsic Colorization
Xiaopei Liu, Liang Wan, Yingge Qu, Tien-Tsin Wong, Stephen Lin, Chi-Sing Leung, and Pheng-Ann Heng
2008 ACM Transactions on Graphics [Paper]

Automatic colorization of grayscale images using multiple images on the Web
Yuji Morimoto, Yuichi Taguchi, and Takeshi Naemura
2009 ACM SIGGRAPH Talks [Paper]

Semantic Colorization with Internet Images
Alex Yong-Sang Chia, Shaojie Zhuo, Raj Kumar Gupta, Yu-Wing Tai, Siu-Yeung Cho, Ping Tan, and Stephen Lin
2011 ACM Transactions on Graphics [Paper]

Image Colorization Using Similar Images
Raj Kumar Gupta, Alex Yong-Sang Chia, Deepu Rajan, Ee Sin Ng, and Huang Zhiyong
2012 ACM International Conference on Multimedia [Paper]

Variational Exemplar-Based Image Colorization
Aurélie Bugeau, Vinh-Thong Ta, and Nicolas Papadakis
2014 IEEE Transactions on Image Processing [Paper]

Twin Deep Convolutional Neural Network for Example-based Image Colorization
Domonkos Varga, and Tamás Szirányi
2017 Computer Analysis of Images and Patterns [Paper]

Comicolorization: Semi-Automatic Manga Colorization
Chie Furusawa, Kazuyuki Hiroshiba, Keisuke Ogaki, and Yuri Odagiri
2017 ACM SIGGRAPH Asia Technical Briefs [Paper]

TextureGAN: Controlling Deep Image Synthesis with Texture Patches
Wenqi Xian, Patsorn Sangkloy, Varun Agrawal, Amit Raj, Jingwan Lu, Chen Fang, Fisher Yu, and James Hays
2018 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Deep Exemplar-based Colorization
Mingming He, Dongdong Chen, Jing Liao, Pedro V. Sander, and Lu Yuan
2018 ACM Transactions on Graphics [Paper]

Example-Based Colourization Via Dense Encoding Pyramids
Chufeng Xiao, Chu Han, Zhuming Zhang, Jing Qin, Tien-Tsin Wong, Guoqiang Han, and Shengfeng He
2019 Computer Graphics Forum [Paper]

Automatic Example-Based Image Colorization Using Location-Aware Cross-Scale Matching
Bo Li, Yu-Kun Lai, Matthew John, and Paul L. Rosin
2019 IEEE Transactions on Image Processing [Paper]

Colorization of Line Drawings with Empty Pupils
K. Akita, Y. Morimoto, and R. Tsuruno
2020 Computer Graphics Forum [Paper]

Reference-Based Sketch Image Colorization using Augmented-Self Reference and Dense Semantic Correspondence
Junsoo Lee, Eungyeup Kim, Yunsung Lee, Dongjun Kim, Jaehyuk Chang, and Jaegul Choo
2020 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Stylization-Based Architecture for Fast Deep Exemplar Colorization
Zhongyou Xu, Tingting Wang, Faming Fang, Yun Sheng, and Guixu Zhang
2020 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Deep-Eyes: Fully Automatic Anime Character Colorization with Painting of Details on Empty Pupils
K. Akita, Y. Morimoto, and R. Tsuruno
2020 Eurographics [Paper]

Gray2ColorNet: Transfer More Colors from Reference Image
Peng Lu, Jinbei Yu, Xujun Peng, Zhaoran Zhao, and Xiaojie Wang
2020 ACM International Conference on Multimedia [Paper]

Manga Filling Style Conversion with Screentone Variational Autoencoder
Minshan Xie, Chengze Li, Xueting Liu, and Tien-Tsin Wong
2020 ACM Transactions on Graphics [Paper]

A Superpixel-Based Variational Model for Image Colorization
Faming Fang, Tingting Wang, Tieyong Zeng, and Guixu Zhang
2020 IEEE Transactions on Visualization and Computer Graphics [Paper]

Line Art Colorization Based on Explicit Region Segmentation
Ruizhi Cao, Haoran Mo, and Chengying Gao
2021 Computer Graphics Forum [Paper]

Color2Embed: Fast Exemplar-Based Image Colorization using Color Embeddings
Hengyuan Zhao, Wenhao Wu, Yihao Liu, and Dongliang He
2021 Arxiv [Paper]

Yes, “Attention Is All You Need”, for Exemplar based Colorization
Wang Yin, Peng Lu, Zhaoran Zhao, and Xujun Peng
2021 ACM International Conference on Multimedia [Paper]

Globally and Locally Semantic Colorization via Exemplar-Based Broad-GAN
Haoxuan Li, Bin Sheng, Ping Li, Riaz Ali, and C. L. Philip Chen
2021 IEEE Transactions on Image Processing [Paper]

Super-Attention for Exemplar-Based Image Colorization
Hernan Carrillo, Michaël Clément, and Aurélie Bugeau
2022 Asian Conference on Computer Vision [Paper]

Reference-Guided Structure-Aware Deep Sketch Colorization for Cartoons
Xueting Liu, Wenliang Wu, Chengze Li, Yifan Li, and Huisi Wu
2022 Computational Visual Media [Paper]

Eliminating Gradient Conflict in Reference-based Line-Art Colorization
Zekun Li, Zhengyang Geng, Zhao Kang, Wenyu Chen, and Yibo Yang
2022 European Conference on Computer Vision [Paper]

Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization
Yunpeng Bai, Chao Dong, Zenghao Chai, Andong Wang, Zhengzhuo Xu, and Chun Yuan
2022 European Conference on Computer Vision [Paper]

Active Colorization for Cartoon Line Drawings
Shu-Yu Chen, Jia-Qi Zhang, Lin Gao, Yue He, Shihong Xia, Min Shi, and Fang-Lue Zhang
2022 IEEE Transactions on Visualization and Computer Graphics [Paper]

Attention-Aware Anime Line Drawing Colorization
Yu Cao, Hao Tian, and P. Y. Mok
2023 IEEE International Conference on Multimedia & Expo [Paper]

Self-driven Dual-path Learning for Reference-based Line Art Colorization under Limited Data
Shukai Wu, Xiao Yan, Weiming Liu, Shuchang Xu, and Sanyuan Zhang
2023 IEEE Transactions on Circuits and Systems for Video Technology [Paper]

Unsupervised Deep Exemplar Colorization via Pyramid Dual Non-Local Attention
Hanzhang Wang, Deming Zhai, Xianming Liu, Junjun Jiang, and Wen Gao
2023 IEEE Transactions on Image Processing [Paper]

Pik-Fix: Restoring and Colorizing Old Photos
Runsheng Xu, Zhengzhong Tu, Yuanqi Du, Xiaoyu Dong, Jinlong Li, Zibo Meng, Jiaqi Ma, Alan Bovik, and Hongkai Yu
2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

AnimeDiffusion: Anime Diffusion Colorization
Yu Cao, Xiangqiao Meng, P. Y. Mok, Tong-Yee Lee, Xueting Liu, and Ping Li
2024 IEEE Transactions on Visualization and Computer Graphics [Paper]

Scribble-hint Methods

Colorization using Optimization
Anat Levin, Dani Lischinski, and Yair Weiss
2004 ACM Transactions on Graphics [Paper]

An Adaptive Edge Detection Based Colorization Algorithm and Its Applications
Yi-Chin Huang, Yi-Shin Tung, Jun-Cheng Chen, Sung-Wen Wang, and Ja-Ling Wu
2005 ACM International Conference on Multimedia [Paper]

Fast Image and Video Colorization Using Chrominance Blending
Liron Yatziv, and Guillermo Sapiro
2006 IEEE Transactions on Image Processing [Paper]

Manga Colorization
Yingge Qu, Tien-Tsin Wong, and Pheng-Ann Heng
2006 ACM Transactions on Graphics [Paper]

Natural Image Colorization
Qing Luan, Fang Wen, Daniel Cohen-Or, Lin Liang, Ying-Qing Xu, and Heung-Yeung Shum
2007 Eurographics Symposium on Rendering [Paper]

LazyBrush: Flexible Painting Tool for Hand-drawn Cartoons
Daniel Sýkora, John Dingliana, and Steven Collins
2009 Computer Graphics Forum [Paper]

Scribbler: Controlling Deep Image Synthesis with Sketch and Color
Patsorn Sangkloy, Jingwan Lu, Chen Fang, Fisher Yu, and James Hays
2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks
Yifan Liu, Zengchang Qin, Zhenbo Luo, and Hua Wang
2017 Neurocomputing [Paper]

Outline Colorization through Tandem Adversarial Networks
Kevin Frans
2017 Arxiv [Paper]

Real-Time User-Guided Image Colorization with Learned Deep Priors
Richard Zhang, Jun-Yan Zhu, Phillip Isola, Xinyang Geng, Angela S. Lin, Tianhe Yu, and Alexei A. Efros
2017 ACM Transactions on Graphics [Paper]

User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks
Yuanzheng Ci, Xinzhu Ma, Zhihui Wang, Haojie Li, and Zhongxuan Luo
2018 ACM International Conference on Multimedia [Paper]

Two-stage Sketch Colorization
Lvmin Zhang, Chengze Li, Tien-Tsin Wong, Yi Ji, and Chunping Liu
2018 ACM Transactions on Graphics [Paper]

Interactive Deep Colorization and its Application for Image Compression
Yi Xiao, Jin Wu, Jie Zhang, Peiyao Zhou, Yan Zheng, Chi-Sing Leung, and Ladislav Kavan
2020 IEEE Transactions on Visualization and Computer Graphics [Paper]

User-Guided Line Art Flat Filling with Split Filling Mechanism
Lvmin Zhang, Chengze Li, Edgar Simo-Serra, Yi Ji, Tien-Tsin Wong, and Chunping Liu
2021 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Line Art Colorization with Concatenated Spatial Attention
Mingcheng Yuan, and Edgar Simo-Serra
2021 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Deep Edge-Aware Interactive Colorization against Color-Bleeding Effects
Eungyeup Kim, Sanghyeon Lee, Jeonghoon Park, Somi Choi, Choonghyun Seo, and Jaegul Choo
2021 IEEE International Conference on Computer Vision [Paper]

Dual Color Space Guided Sketch Colorization
Zhi Dou, Ning Wang, Baopu Li, Zhihui Wang, Haojie Li, and Bin Liu
2021 IEEE Transactions on Image Processing [Paper]

Diffusart: Enhancing Line Art Colorization with Conditional Diffusion Models
Hernan Carrillo, Michaël Clément, Aurélie Bugeau, and Edgar Simo-Serra
2023 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Guiding Users to Where to Give Color Hints for Efficient Interactive Sketch Colorization via Unsupervised Region Prioritization
Youngin Cho, Junsoo Lee, Soyoung Yang, Juntae Kim, Yeojeong Park, Haneol Lee, Mohammad Azam Khan, Daesik Kim, and Jaegul Choo
2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

iColoriT: Towards Propagating Local Hints to the Right Region in Interactive Colorization by Leveraging Vision Transformer
Jooyeol Yun, Sanghyeon Lee, Minho Park, and Jaegul Choo
2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

Text-based Methods

Language-Based Image Editing with Recurrent Attentive Models
Jianbo Chen, Yelong Shen, Jianfeng Gao, Jingjing Liu, and Xiaodong Liu
2018 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation
Hyojin Bahng, Seungjoo Yoo, Wonwoong Cho, David Keetae Park, Ziming Wu, Xiaojuan Ma, and Jaegul Choo
2018 European Conference on Computer Vision [Paper]

Learning to Color from Language
Varun Manjunatha, Mohit Iyyer, Jordan Boyd-Graber, and Larry Davis
2018 Annual Conference of the North American Chapter of the Association for Computational Linguistics [Paper]

Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss
Hyunsu Kim, Ho Young Jhoo, Eunhyeok Park, and Sungjoo Yoo
2019 IEEE International Conference on Computer Vision [Paper]

Language-based Colorization of Scene Sketches
Changqing Zou, Haoran Mo, Chengying Gao, Ruofei Du, and Hongbo Fu
2019 ACM Transactions on Graphics [Paper]

Line Art Colorization Based on Explicit Region Segmentation
Ruizhi Cao, Haoran Mo, and Chengying Gao
2021 Computer Graphics Forum [Paper]

L-CoDe: Language-based Colorization using Color-object Decoupled Conditions
Shuchen Weng, Hao Wu, Zheng Chang, Jiajun Tang, Si Li, and Boxin Shi
2022 AAAI Conference on Artificial Intelligence [Paper]

L-CoDer: Language-based Colorization with Color-object Decoupling Transformer
Zheng Chang, Shuchen Weng, Yu Li, Si Li, and Boxin Shi
2022 European Conference on Computer Vision [Paper]

L-CoIns: Language-based Colorization with Instance Awareness
Zheng Chang, Shuchen Weng, Peixuan Zhang, Yu Li, Si Li, and Boxin Shi
2023 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

L-CAD: Language-based Colorization with Any-level Descriptions
Zheng Chang, Shuchen Weng, Peixuan Zhang, Yu Li, Si Li, and Boxin Shi
2023 Advances in Neural Information Processing Systems [Paper]

Palette-based Methods

Affective Image Colorization
Xiao-Hui Wang, Jia Jia, Han-Yu Liao, and Lian-Hong Cai
2012 Journal of Computer Science and Technology [Paper]

Palette-based Photo Recoloring
Huiwen Chang, Ohad Fried, Yiming Liu, Stephen DiVerdi, and Adam Finkelstein
2015 ACM Transactions on Graphics [Paper]

Diverse Colorization

Automatic Image Colorization via Multimodal Predictions
Guillaume Charpiat, Matthias Hofmann, and Bernhard Schölkopf
2008 European Conference on Computer Vision [Paper]

Pixel Recurrent Neural Networks
Aaron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu
2016 International Conference on Machine Learning [Paper]

PixColor: Pixel Recursive Colorization
Sergio Guadarrama, Ryan Dahl, David Bieber, Mohammad Norouzi, Jonathon Shlens, and Kevin Murphy
2017 British Machine Vision Conference [Paper]

Probabilistic Image Colorization
Amelie Royer, Alexander Kolesnikov, and Christoph H. Lampert
2017 British Machine Vision Conference [Paper]

Multiple Hypothesis Colorization and Its Application to Image Compression
Mohammad Haris Baig, and Lorenzo Torresani
2017 Computer Vision and Image Understanding [Paper]

Learning Diverse Image Colorization
Aditya Deshpande, Jiajun Lu, Mao-Chuang Yeh, Min Jin Chong, and David Forsyth
2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Unsupervised Diverse Colorization via Generative Adversarial Networks
Yun Cao, Zhiming Zhou, Weinan Zhang, and Yong Yu
2017 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases [Paper]

Structural Consistency and Controllability for Diverse Colorization
Safa Messaoud, David Forsyth, and Alexander G. Schwing
2018 European Conference on Computer Vision [Paper]

Towards Vivid and Diverse Image Colorization with Generative Color Prior
Yanze Wu, Xintao Wang, Yu Li, Honglun Zhang, Xun Zhao, and Ying Shan
2021 IEEE International Conference on Computer Vision [Paper]

Video Colorization Methods

Fast Image and Video Colorization Using Chrominance Blending
Liron Yatziv, and Guillermo Sapiro
2006 IEEE Transactions on Image Processing [Paper]

Colorization of Grayscale Images and Videos Using A Semiautomatic Approach
Vivek George Jacob, and Sumana Gupta
2009 IEEE International Conference on Image Processing [Paper]

Video Colorization Using Parallel Optimization in Feature Space
Bin Sheng, Hanqiu Sun, Marcus Magnor, and Ping Li
2014 IEEE Transactions on Circuits and Systems for Video Technology [Paper]

Approximate Nearest Neighbor Fields in Video
Nir Ben-Zrihem, and Lihi Zelnik-Manor
2015 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Blind Video Temporal Consistency
Nicolas Bonneel, James Tompkin, Kalyan Sunkavalli, Deqing Sun, Sylvain Paris, and Hanspeter Pfister
2015 ACM Transactions on Graphics [Paper]

Robust and Automatic Video Colorization via Multiframe Reordering Refinement
Sifeng Xia, Jiaying Liu, Yuming Fang, Wenhan Yang, and Zongming Guo
2016 IEEE International Conference on Image Processing [Paper]

Video Propagation Networks
Varun Jampani, Raghudeep Gadde, and Peter V. Gehler
2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Spatiotemporal Colorization of Video Using 3D Steerable Pyramids
Somdyuti Paul, Saumik Bhattacharya, and Sumana Gupta
2017 IEEE Transactions on Circuits and Systems for Video Technology [Paper]

Deep Video Color Propagation
Simone Meyer, Victor Cornillère, Abdelaziz Djelouah, Christopher Schroers, and Markus Gross
2018 British Machine Vision Conference [Paper]

Learning Blind Video Temporal Consistency
Wei-Sheng Lai, Jia-Bin Huang, Oliver Wang, Eli Shechtman, Ersin Yumer, and Ming-Hsuan Yang
2018 European Conference on Computer Vision [Paper]

Switchable Temporal Propagation Network
Sifei Liu, Guangyu Zhong, Shalini De Mello, Jinwei Gu, Varun Jampani, Ming-Hsuan Yang, and Jan Kautz
2018 European Conference on Computer Vision [Paper]

Tracking Emerges by Colorizing Videos
Carl Vondrick, Abhinav Shrivastava, Alireza Fathi, Sergio Guadarrama, and Kevin Murphy
2018 European Conference on Computer Vision [Paper]

Automatic Temporally Coherent Video Colorization
Harrish Thasarathan, Kamyar Nazeri, and Mehran Ebrahimi
2019 Conference on Computer and Robot Vision [Paper]

Deep Exemplar-based Video Colorization
Bo Zhang, Mingming He, Jing Liao, Pedro V. Sander, Lu Yuan, Amine Bermak, and Dong Chen
2019 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Fully Automatic Video Colorization with Self-Regularization and Diversity
Chenyang Lei, and Qifeng Chen
2019 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

DeepRemaster: Temporal Source-Reference Attention Networks for Comprehensive Video Enhancement
Satoshi Iizuka, and Edgar Simo-Serra
2019 ACM Transactions on Graphics [Paper]

Blind Video Temporal Consistency via Deep Video Prior
Chenyang Lei, Yazhou Xing, and Qifeng Chen
2020 Advances in Neural Information Processing Systems [Paper]

Reference-Based Video Colorization with Spatiotemporal Correspondence
Naofumi Akimoto, Akio Hayakawa, Andrew Shin, and Takuya Narihira
2020 Arxiv [Paper]

The Animation Transformer: Visual Correspondence via Segment Matching
Evan Casey, Víctor Pérez, and Zhuoru Li
2021 IEEE International Conference on Computer Vision [Paper]

Temporally Consistent Video Colorization with Deep Feature Propagation and Self-regularization Learning
Yihao Liu, Hengyuan Zhao, Kelvin C.K. Chan, Xintao Wang, Chen Change Loy, Yu Qiao, and Chao Dong
2021 Arxiv [Paper]

Line Art Correlation Matching Feature Transfer Network for Automatic Animation Colorization
Qian Zhang, Bo Wang, Wei Wen, Hai Li, and Junhui Liu
2021 IEEE Winter Conference on Applications of Computer Vision [Paper]

BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization
Yixin Yang, Zhongzheng Peng, Xiaoyu Du, Zhulin Tao, Jinhui Tang, and Jinshan Pan
2022 Arxiv [Paper]

Reference-Based Deep Line Art Video Colorization
Min Shi, Jia-Qi Zhang, Shu-Yu Chen, Lin Gao, Yu-Kun Lai, and Fang-Lue Zhang
2022 IEEE Transactions on Visualization and Computer Graphics [Paper]

Exemplar-based Video Colorization with Long-term Spatiotemporal Dependency
Siqi Chen, Xueming Li, Xianlin Zhang, Mingdao Wang, Yu Zhang, Jiatong Han, and Yue Zhang
2023 Arxiv [Paper]

SVCNet: Scribble-based Video Colorization Network with Temporal Aggregation
Yuzhi Zhao, Lai-Man Po, Kangcheng Liu, Xuehui Wang, Wing-Yin Yu, Pengfei Xian, Yujia Zhang, and Mengyang Liu
2023 IEEE Transactions on Image Processing [Paper]

Video Colorization with Pre-trained Text-to-Image Diffusion Models
Hanyuan Liu, Minshan Xie, Jinbo Xing, Chengze Li, and Tien-Tsin Wong
2023 Arxiv [Paper]

Domain-Specific Colorization Methods

Infrared Colorization Using Deep Convolutional Neural Networks
Matthias Limmer, and Hendrik P.A. Lensch
2016 IEEE International Conference on Machine Learning and Applications [Paper]

Infrared Image Colorization based on a Triplet DCGAN Architecture
Patricia L. Suárez, Angel D. Sappa, and Boris X. Vintimilla
2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

(DE)2CO: Deep Depth Colorization
Fabio Maria Carlucci, Paolo Russo, and Barbara Caputo
2018 IEEE Robotics and Automation Letters [Paper]

Colorizing Near Infrared Images through a Cyclic Adversarial Approach of Unpaired Samples
Armin Mehri, and Angel D. Sappa
2019 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Adversarial Colorization Of Icons Based On Structure And Color Conditions
Tsai-Ho Sun, Chien-Hsun Lai, Sai-Keung Wong, and Yu-Shuen Wang
2019 ACM International Conference on Multimedia [Paper]

Colorization of Depth Map via Disentanglement
Chung-Sheng Lai, Zunzhi You, Ching-Chun Huang, Yi-Hsuan Tsai, and Wei-Chen Chiu
2020 European Conference on Computer Vision [Paper]

Point2color: 3D Point Cloud Colorization Using a Conditional Generative Network and Differentiable Rendering for Airborne LiDAR
Takayuki Shinohara, Haoyi Xiu, and Masashi Matsuoka
2021 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Underwater Image Color Correction Using Ensemble Colorization Network
Arpit Pipara, Urvi Oza, and Srimanta Mandal
2021 IEEE International Conference on Computer Vision Workshops [Paper]

Style-Structure Disentangled Features and Normalizing Flows for Diverse Icon Colorization
Yuan–kui Li, Yun–Hsuan Lien, and Yu–Shuen Wang
2022 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Generative Colorization of Structured MobileWeb Pages
Kotaro Kikuchi, Naoto Inoue, Mayu Otani, Edgar Simo-Serra, and Kota Yamaguchi
2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

Unconditional Colorization

Consider Colorization as A Vision Task

Representation Learning

Colorful Image Colorization
Richard Zhang, Phillip Isola, and Alexei A. Efros
2016 European Conference on Computer Vision [Paper]

Learning Representations for Automatic Colorization
Gustav Larsson, Michael Maire, and Gregory Shakhnarovich
2016 European Conference on Computer Vision [Paper]

Colorization as a Proxy Task for Visual Understanding
Gustav Larsson, Michael Maire, and Gregory Shakhnarovich
2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Image-to-Image Translation

Generalized Deep Image to Image Regression
Venkataraman Santhanam, Vlad I. Morariu, and Larry S. Davis
2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Image-to-Image Translation with Conditional Adversarial Networks
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros
2017 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Image Restoration and Enhancement

SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution
Jiangning Zhang, Chao Xu, Jian Li, Yue Han, Yabiao Wang, Ying Tai, and Yong Liu
2022 AAAI Conference on Artificial Intelligence [Paper]

BIGPrior: Toward Decoupling Learned Prior Hallucination and Data Fidelity in Image Restoration
Majed El Helou, and Sabine Süsstrunk
2022 IEEE Transactions on Image Processing [Paper]

Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Xingang Pan , Xiaohang Zhan , Bo Dai , Dahua Lin, Chen Change Loy, and Ping Luo
2022 IEEE Transactions on Pattern Analysis and Machine Intelligence [Paper]

Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model
Yinhuai Wang, Jiwen Yu, and Jian Zhang
2023 International Conference on Learning Representations [Paper]

GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond
Kelvin C.K. Chan, Xiangyu Xu, Xintao Wang, Jinwei Gu, and Chen Change Loy
2023 IEEE Transactions on Pattern Analysis and Machine Intelligence [Paper]

Semantic Colorization

Global Level

Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification
Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa
2016 ACM Transactions on Graphics [Paper]

ChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution
Patricia Vitoria, Lara Raad, and Coloma Ballester
2020 IEEE Winter Conference on Applications of Computer Vision [Paper]

Broad Colorization
Yuxi Jin, Bin Sheng, Ping Li, and C. L. Philip Chen
2021 IEEE Transactions on Neural Networks and Learning Systems [Paper]

Disentangled Image Colorization via Global Anchors
Menghan Xia, Wenbo Hu, Tien-Tsin Wong, and Jue Wang
2022 ACM Transactions on Graphics [Paper]

DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders
Xiaoyang Kang, Tao Yang, Wenqi Ouyang, Peiran Ren, Lingzhi Li, and Xuansong Xie
2023 IEEE International Conference on Computer Vision [Paper]

Instance Level

Instance-aware Image Colorization
Jheng-Wei Su, Hung-Kuo Chu, and Jia-Bin Huang
2020 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Collaborative Image and Object Level Features for Image Colourisation
Rita Pucci, Christian Micheloni, and Niki Martinel
2021 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

L-CoIns: Language-based Colorization with Instance Awareness
Zheng Chang, Shuchen Weng, Peixuan Zhang, Yu Li, Si Li, and Boxin Shi
2023 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Pixel Level

Pixel-level Semantics Guided Image Colorization
Jiaojiao Zhao, Li Liu, Cees G.M. Snoek, Jungong Han, and Ling Shao
2018 British Machine Vision Conference [Paper]

Image Colorization By Capsule Networks
Gökhan Özbulak
2019 IEEE Conference on Computer Vision and Pattern Recognition Workshops [Paper]

Pixelated Semantic Colorization
Jiaojiao Zhao, Jungong Han, Ling Shao, and Cees G. M. Snoek
2020 International Journal of Computer Vision [Paper]

Network Structure

CNN-based Structure

Deep Colorization
Zezhou Cheng, Qingxiong Yang, and Bin Sheng
2015 IEEE International Conference on Computer Vision [Paper]

Learning Large-Scale Automatic Image Colorization
Aditya Deshpande, Jason Rock, and David Forsyth
2015 IEEE International Conference on Computer Vision [Paper]

Automatic Cartoon Colorization Based on Convolutional Neural Network
Domonkos Varga, Csaba Attila Szabó, and Tamás Szirányi
2017 International Workshop on Content-Based Multimedia Indexing [Paper]

Deep Koalarization: Image Colorization using CNNs and Inception-Resnet-v2
Federico Baldassarre, Diego González Morín, and Lucas Rodés-Guirao
2017 Arxiv [Paper]

Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System
Xuan Dong, Weixin Li, Xiaojie Wang, and Yunhong Wang
2019 AAAI Conference on Artificial Intelligence [Paper]

A Colorization Framework for Monochrome-Color Dual-Lens Systems Using a Deep Convolutional Network
Xuan Dong, Weixin Li, Xiaoyan Hu, Xiaojie Wang, and Yunhong Wang
2022 IEEE Transactions on Visualization and Computer Graphics [Paper]

GAN-based Structure

cGAN-based Manga Colorization Using a Single Training Image
Paulina Hensman, and Kiyoharu Aizawa
2017 IAPR International Conference on Document Analysis and Recognition [Paper]

Image Colorization using Generative Adversarial Networks
Kamyar Nazeri, Eric Ng, and Mehran Ebrahimi
2018 International Conference on Articulated Motion and Deformable Objects [Paper]

ColoringWith Limited Data: Few-Shot Colorization via Memory Augmented Networks
Seungjoo Yoo, Hyojin Bahng, Sunghyo Chung, Junsoo Lee, Jaehyuk Chang, and Jaegul Choo
2019 IEEE Conference on Computer Vision and Pattern Recognition [Paper]

Image Colorization Using Generative Adversarial Networks and Transfer Learning
Leila Kiani, Masoud Saeed, and Hossein Nezamabadi-pour
2020 International Conference on Machine Vision and Image Processing [Paper]

Focusing on Persons: Colorizing Old Images Learning from Modern Historical Movies
Xin Jin, Zhonglan Li, Ke Liu, Dongqing Zou, Xiaodong Li, Xingfan Zhu, Ziyin Zhou, Qilong Sun, and Qingyu Liu
2021 ACM International Conference on Multimedia [Paper]

Exploring Sketch-based Character Design Guided by Automatic Colorization
Rawan Alghofaili, Matthew Fisher, Richard Zhang, Michal Lukáč, and Lap-Fai Yu
2021 Graphics Interface [Paper]

SCGAN: Saliency Map-Guided Colorization With Generative Adversarial Network
Yuzhi Zhao, Lai-Man Po, Kwok-Wai Cheung, Wing-Yin Yu, and Yasar Abbas Ur Rehman
2021 IEEE Transactions on Circuits and Systems for Video Technology [Paper]

BigColor: Colorization using a Generative Color Prior for Natural Images
Geonung Kim, Kyoungkook Kang, Seongtae Kim, Hwayoon Lee, Sehoon Kim, Jonghyun Kim, Seung-Hwan Baek, and Sunghyun Cho
2022 European Conference on Computer Vision [Paper]

Bridging the Domain Gap towards Generalization in Automatic Colorization
Hyejin Lee, Daehee Kim, Daeun Lee, Jinkyu Kim, and Jaekoo Lee
2022 European Conference on Computer Vision [Paper]

PalGAN: Image Colorization with Palette Generative Adversarial Networks
Yi Wang, Menghan Xia, Lu Qi, Jing Shao, and Yu Qiao
2022 European Conference on Computer Vision [Paper]

Flow-based Structure

Guided Image Generation with Conditional Invertible Neural Networks
Lynton Ardizzone, Carsten Lüth, Jakob Kruse, Carsten Rother, and Ullrich Köthe
2019 Arxiv [Paper]

Transformer-based Structure

Colorization Transformer
Manoj Kumar, Dirk Weissenborn, and Nal Kalchbrenner
2021 International Conference on Learning Representations [Paper]

ColorFormer: Image Colorization via Color Memory assisted Hybrid-attention Transformer
Xiaozhong Ji, Boyuan Jiang, Donghao Luo, Guangpin Tao, Wenqing Chu, Zhifeng Xie, Chengjie Wang, and Ying Tai
2022 European Conference on Computer Vision [Paper]

CT2: Colorization Transformer via Color Tokens
Shuchen Weng, Jimeng Sun, Yu Li, Si Li, and Boxin Shi
2022 European Conference on Computer Vision [Paper]

UniColor: A Unified Framework for Multi-Modal Colorization with Transformer
Zhitong Huang, Nanxuan Zhao, and Jing Liao
2022 ACM Transactions on Graphics [Paper]

DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders
Xiaoyang Kang, Tao Yang, Wenqi Ouyang, Peiran Ren, Lingzhi Li, and Xuansong Xie
2023 IEEE International Conference on Computer Vision [Paper]

iColoriT: Towards Propagating Local Hints to the Right Region in Interactive Colorization by Leveraging Vision Transformer
Jooyeol Yun, Sanghyeon Lee, Minho Park, and Jaegul Choo
2023 IEEE Winter Conference on Applications of Computer Vision [Paper]

Diffusion-based Structure

Palette: Image-to-Image Diffusion Models
Chitwan Saharia, William Chan, Huiwen Chang, Chris A. Lee, Jonathan Ho, Tim Salimans, David J. Fleet, and Mohammad Norouzi
2022 ACM SIGGRAPH [Paper]

Improved Diffusion-based Image Colorization via Piggybacked Models
Hanyuan Liu, Jinbo Xing, Minshan Xie, Chengze Li, and Tien-Tsin Wong
2023 Arxiv [Paper]

Diffusing Colors: Image Colorization with Text Guided Diffusion
Nir Zabari, PictureAharon Azulay, PictureAlexey Gorkor, PictureTavi Halperin and PictureOhad Fried
2023 ACM SIGGRAPH [Paper]