Awesome
Awesome Artistic Typography
Welcome to Awesome-Artistic-Typography! This is a comprehensive list of artistic typography, including methods and datasets introduced for text stylization and semantic typography tasks. Further information are available in paper: Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generation.
<p align="center"> <img src="asset/cover/controllable.png" width="240px" height='160px'/> <img src="asset/cover/compact.png" width="240px" height='160px'/> </p> <p align="center"> <img src="asset/cover/anything to glyph.png" width="120px" height='120px'/> <img src="asset/cover/with decor.png" width="120px" height='120px'/> <img src="asset/cover/wordart-designer.png" width="120px" height='120px'/> <img src="asset/cover/ds-fusion.png" width="120px" height='120px'/> </p> <p align="center"> (Source: <a href="https://openaccess.thecvf.com/content_ICCV_2019/html/Yang_Controllable_Artistic_Text_Style_Transfer_via_Shape-Matching_GAN_ICCV_2019_paper.html">Shape-Matching GAN</a>, <a href="https://dl.acm.org/doi/abs/10.1145/2897824.2925887">Zou et al.</a>, <a href="https://dl.acm.org/doi/abs/10.1145/3610548.3618208">Anything to Glyph</a>, <a href="http://openaccess.thecvf.com/content_CVPR_2019/html/Wang_Typography_With_Decor_Intelligent_Text_Style_Transfer_CVPR_2019_paper.html"> Typography With Decor </a>, <a href="https://arxiv.org/abs/2310.18332">Wordart Designer</a> and <a href="https://openaccess.thecvf.com/content/ICCV2023/html/Tanveer_DS-Fusion_Artistic_Typography_via_Discriminated_and_Stylized_Diffusion_ICCV_2023_paper.html">DS-Fusion</a>) </p>Table of Contents
Artistic Text Stylization
Static Artistic Text Stylization
Text effect transfer
<p align="center"> <img src="asset/3.1.1.png" width="480px"/> </p> <p align="center"> (Source: <a href="https://ojs.aaai.org/index.php/AAAI/article/view/3919">TET-GAN</a>) </p>Title | Method | Feature | Code | Pub. & Date |
---|---|---|---|---|
Artistic Text Effect Transfer with Conditonal Generative Adversarial Network | GAN-based | simplified TET-GAN | - | CACML, 2022 |
Text Style Transfer With Decorative Elements | GAN-based | decor transfer on Chinese characters | - | MIPR, 2021 |
Typography with decor: Intelligent text style transfer | GAN-based | decorative element (decor) transfer | code | CVPR, 2019 |
TET-GAN: Text effects transfer via stylization and destylization | GAN-based | style-glyph disentanglement | code | AAAI, 2019 |
A Common Framework for Interactive Texture Transfer | GAN-based | versatile interactive texture transfer | code | CVPR, 2018 |
Awesome typography: StatisticsBased Text Effects Transfer | patch-based | distribution-aware text effect prior | code | CVPR, 2017 |
Texture transfer based on continuous structure of texture patches for design of artistic Shodo fonts | stroke-based | Ink texture synthesis along strokes | - | SIGGRAPH Asia, 2010 |
Arbitrary style transfer on text
<p align="center"> <img src="asset/3.1.2.png" width="480px"/> </p> <p align="center"> (Source: <a href="https://dl.acm.org/doi/abs/10.1145/3240508.3240580">UT-Effect</a>) </p>Title | Method | Feature | Code | Pub. & Date |
---|---|---|---|---|
Anything to glyph: Artistic font synthesis via text-to-image diffusion model | diffusion-based | place objects according to the glyph | - | SIGGRAPH Asia, 2023 |
Intelligent Typography: Artistic Text Style Transfer for Complex Texture and Structure | GAN-based | coarse-to-fine complex style transfer | code | TMM, 2023 |
An Art Font Generation Technique using Pix2Pix-based Networks | GAN-based | train a network to generate data | - | BNCSS, 2023 |
Style transfer network for complex multi-stroke text | GAN-based | clean edges by erosion and dilation | - | MS, 2023 |
Improving Font Effect Generation based on Pyramid Style Feature | GAN-based | clean edges by erosion and dilation | - | IJPE, 2020 |
Controllable Artistic Text Style Transfer via Shape-Matching GAN | GAN-based | one-shot learning; style degree control | code | ICCV, 2019 |
Context-Aware Unsupervised Text Stylization | patch-based | structure transfer & texture transfer | - | ACM MM, 2018 |
Joint artistic style and font style transfer
<p align="center"> <img src="asset/3.1.3.png" width="480px"/> </p> <p align="center"> (Source: <a href="https://ojs.aaai.org/index.php/AAAI/article/view/5535">FET-GAN</a>) </p>Dynamic Artistic Text Stylization
<p align="center"> <img src="asset/3.2.png" width="960px"/> </p> <p align="center"> (Source: <a href="https://openaccess.thecvf.com/content_CVPR_2019/html/Men_DynTypo_Example-Based_Dynamic_Text_Effects_Transfer_CVPR_2019_paper.html">DynTypo</a>) </p>Dynamic text effect transfer
Title | Method | Feature | Code | Pub. & Date |
---|---|---|---|---|
Dynamic Texture Transfer using PatchMatch and Transformers | patch & transformer-based | long-distance dependency modeling | - | Feb, 2024 |
DynTypo: Example-based Dynamic Text Effects Transfer | patch-based | global NNF search across frames | code | CVPR, 2019 |
Arbitrary dynamic style transfer on text
Title | Method | Feature | Code | Pub. & Date |
---|---|---|---|---|
Shape-Matching GAN++: Scale Controllable Dynamic Artistic Text Style Transfer | GAN-based | spatial-temporal structural mappings | - | TPAMI, 2021 |
Semantic Typography
Static Semantic Typography
Character-level semantic typography
<p align="center"> <img src="asset/4.1.1.png" width="960px"/> </p> <p align="center"> (Source: <a href="https://onlinelibrary.wiley.com/doi/abs/10.1111/cgf.12785">Zhang et al.</a>ļ¼<a href="https://arxiv.org/abs/1903.07820">Trick or treat</a>ļ¼<a href="https://dl.acm.org/doi/abs/10.1145/3592123">Iluz et al.</a>, and <a href="https://openaccess.thecvf.com/content/ICCV2023/html/Tanveer_DS-Fusion_Artistic_Typography_via_Discriminated_and_Stylized_Diffusion_ICCV_2023_paper.html)">DS-Fusion</a>) </p>Title | Method | Feature | Code | Pub. & Date |
---|---|---|---|---|
WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models | LLM and diffusion-based | user-controllable artistic design | - | Nov, 2023 |
Ds-fusion: Artistic typography via discriminated and stylized diffusion | diffusion-based | raster semantic feature enhancement | code | ICCV, 2023 |
Word-as-image for semantic typography | diffusion-based | vector glyph shape deformation | code | ACM TOG, 2023 |
Trick or treat: Thematic reinforcement for artistic typography | retrieval-based | unsupervised autoencoder matching | code | Mar, 2019 |
Synthesizing Ornamental Typefaces | retrieval-based | joint semantic and shape matching | - | CGF, 2017 |
Word-level semantic typography
<p align="center"> <img src="asset/4.1.2.png" width="960px"/> </p> <p align="center"> (Source: <a href="https://dl.acm.org/doi/abs/10.1145/1268517.1268527">Xu et al.</a>ļ¼<a href="https://dl.acm.org/doi/abs/10.1145/2897824.2925887">Zou et al.</a>, and <a href="https://dl.acm.org/doi/abs/10.1145/3539610">Zhang et al.</a>) </p>Title | Method | Feature | Code | Pub. & Date |
---|---|---|---|---|
Creating Word Paintings Jointly Considering Semantics, Attention, and Aesthetics | vector field & SVM-based | visual saliency for aesthetic optimization | - | ACM TAP, 2022 |
Legible compact calligrams | warp-based | legibility enhanced calligram | - | ACM TOG, 2016 |
PicWords: Render a picture by packing keywords | warp-based | keyword semantic priority ranking | code | TMM, 2014 |
Digital Micrography | vector field-based | adaptive text layout synthesis | - | ACM TOG, 2011 |
Structure-based ASCII Art | structure-based | structural ASCII art generation | - | ACM SIGGRAPH, 2010 |
Calligraphic packing | warp-based | shape adaptive text warping | - | GL, 2007 |
Kinetic Typography
<p align="center"> <img src="asset/4.2.png" width="960px"/> </p> <p align="center"> (Source: <a href="https://arxiv.org/abs/2404.11614">Dynamic Typography</a>) </p>Title | Method | Feature | Code | Pub. & Date |
---|---|---|---|---|
Dynamic Typography: Bringing Text to Life via Video Diffusion Prior | diffusion-based | character deformation and animation | code | Apr, 2024 |
Creating emordle: Animating word cloud for emotion expression | frame-based | emotional word cloud animation | - | TVCG, 2023 |
Datasets
Name | Type | Images | Feature | Download | Pub. & Date |
---|---|---|---|---|---|
AnyWord-3M | visual text | 3,034,486 | text images from several datasets 1.6 million in Chinese, 1.39 million in English, and 10k images in other languages. | ModelScope | 2024 |
LAION-Glyph | visual text | ā¼10,000,000 | mages with rich visual text content | Github | 2023 |
MARIO-10M | visual text | 10,061,720 | 9,194,613, 343,423 and 523,684 text images from natural images, posters, and book covers, respectively. | Github | 2023 |
TextLogo3K | text logo | 3,470 | text logo images extracted from poster/covers of movies, TV series and comics. | Google Drive | 2022 |
SSAF-CN<br><br>SSAF-EN | text effects | 97,200<br><br>2,600 | 00 text effects rendered on 972 Chinese characters.<br><br>100 text effects rendered on 26 English letters. | Google Drive<br>Baidu Pan (code: 4jom) | 2022 |
Imgur5K | handwriting | 135,375 | 135,375 handwritten English words from 5,305 images | Github | 2021 |
TE141K-E<br><br>TE141K-C<br><br>TE141K-S | text effects | 66,196<br><br>54,405<br><br>20,480 | 64 text effects on 52 English letters of 19 fonts.<br><br>65 text effects rendered on 775 Chinese characters, 52 English letters and 10 Arabic numerals.<br><br>20 text effects rendered on 56 special symbols, and 968 letters in Japanese, Russian, etc. | Google Drive<br>Baidu Pan (code: knzy) | 2020 |
TextEffects-Decor | text effects | 59,280 | 64 text effects with decorative elements rendered on 52 English letters of 19 fonts. | Google Drive | 2019 |
TET-GAN | text effects | 53,568 | 64 text effects rendered on 775 Chinese characters, 52 English letters and 10 Arabic numerals. | Google Drive<br>Baidu Pan | 2019 |
AGIS-Net-C<br><br>AGIS-Net-P | joint font & text effects | 1,571,940<br><br>256,410 | synthetic artistic Chinese characters<br><br>professional-designed artistic Chinese characters. | Dropbox<br>MEGA | 2019 |
MC-GAN-Gray<br><br>MC-GAN-Color | joint font & text effects | 260,000<br><br>520,000 | gray-scale english letter <br><br>colorful english letter | Github | 2018 |