Khattat: Enhancing Readability and Concept Representation of Semantic Typography
Designing expressive typography that visually conveys a word's meaning while maintaining readability is a complex task, known as semantic typography. It involves selecting an idea, choosing an appropriate font, and balancing creativity with legibility. We introduce an end-to-end system that automates this process. First, a Large Language Model (LLM) generates imagery ideas for the word, useful for abstract concepts like "freedom." Then, the FontCLIP pre-trained model automatically selects a suitable font based on its semantic understanding of font attributes. The system identifies optimal regions of the word for morphing and iteratively transforms them using a pre-trained diffusion model. A key feature is our OCR-based loss function, which enhances readability and enables simultaneous stylization of multiple characters. We compare our method with other baselines, demonstrating great readability enhancement and versatility across multiple languages and writing scripts.
WOS:001544980800014
Egyptian Knowledge Bank (EKB)
Mohamed bin Zayed University of Artificial Intelligence MBZUAI
Mohamed bin Zayed University of Artificial Intelligence MBZUAI
Mohamed bin Zayed University of Artificial Intelligence MBZUAI
Egyptian Knowledge Bank (EKB)
École Polytechnique Fédérale de Lausanne
2025-05-12
Cham
978-3-031-92807-9
978-3-031-92808-6
Part V
Lecture Notes in Computer Science; 15627
0302-9743
1611-3349
278
295
REVIEWED
EPFL
| Event name | Event acronym | Event place | Event date |
ECCV 2024 | Milan, Italy | 2024-09-29 - 2024-10-04 | |