Inferensys

Glossary

Unicode Common Locale Data Repository (CLDR)

The largest standard repository of locale data, providing building blocks for software to format dates, times, numbers, and sort text according to the conventions of hundreds of languages and regions.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
LOCALE DATA STANDARD

What is Unicode Common Locale Data Repository (CLDR)?

The Unicode Common Locale Data Repository (CLDR) is the largest and most comprehensive standard repository of locale-specific data, providing the essential building blocks for software to format dates, times, numbers, and sort text according to the linguistic and cultural conventions of hundreds of languages and regions.

The Unicode Common Locale Data Repository (CLDR) is a standardized, XML-based repository of locale data maintained by the Unicode Consortium. It provides the canonical building blocks for internationalization (i18n) , supplying algorithms and locale-specific patterns for formatting dates, times, time zones, numbers, currencies, and measurement units, as well as rules for pluralization, sorting, and character transliteration.

Major operating systems, programming language standard libraries, and cloud platforms rely on CLDR to power locale-aware formatting. By abstracting regional conventions into a structured dataset, CLDR allows software to dynamically adapt to a user's locale without hard-coding regional logic, ensuring that a single codebase can correctly display data for users in Tokyo, Berlin, or Cairo.

ANATOMY OF A LOCALE REPOSITORY

Core Components of CLDR

The Unicode Common Locale Data Repository (CLDR) is not a monolithic file but a structured, modular database. It provides the definitive building blocks required to format software interfaces for any language or region on Earth.

01

Locale Identifiers

The fundamental key for accessing locale-specific data. A Unicode locale identifier uses a standardized syntax (e.g., en_US, fr_CA, zh_Hant_HK) composed of language, script, and region subtags. This system allows for precise targeting, distinguishing between language variants like European Portuguese (pt_PT) and Brazilian Portuguese (pt_BR).

02

Date & Time Patterns

Provides the abstract syntax for formatting temporal data. CLDR defines patterns using LDML (Locale Data Markup Language) date format patterns, such as yyyy-MM-dd or EEEE, MMMM d, y. It handles complexities like the choice between Gregorian, Buddhist, or Hijri calendars, and specifies the correct names for days of the week and months in context.

03

Number & Currency Formatting

Defines the rules for numeric presentation beyond simple translation. This includes the correct decimal separator (. vs ,), grouping separators, and percent sign placement. Crucially, it specifies currency codes and their formatting conventions, ensuring that JPY 1,000 is displayed correctly for a Japanese locale.

04

Plural Rules & Selection

Encodes the complex grammatical logic for pluralization. CLDR defines CLDR Plural Rules (ordinal and cardinal) for each language, moving beyond simple singular/plural logic. It handles categories like zero, one, two, few, and many, which are essential for generating grammatically correct strings in languages like Arabic or Russian.

05

Collation & Sorting

Specifies the culturally correct algorithm for sorting text. The Unicode Collation Algorithm (UCA) is parameterized by CLDR data to handle language-specific sorting rules. For example, it ensures that in a Swedish phonebook, the letter 'V' and 'W' are sorted as distinct letters, while in German, 'ß' is sorted as 'ss'.

06

Measurement Systems & Units

Provides the localized display names for standardized units. CLDR maps raw measurement codes to their correctly translated and formatted labels. This ensures that a weather app displays temperature in Celsius for a German locale and Fahrenheit for a US locale, and correctly formats units of length, speed, and volume.

CLDR EXPLAINED

Frequently Asked Questions

Clear, technical answers to the most common questions about the Unicode Common Locale Data Repository and its role in global software development.

The Unicode Common Locale Data Repository (CLDR) is the largest and most comprehensive standard repository of locale-specific data, providing the foundational building blocks for software to format dates, times, numbers, currencies, and sort text according to the linguistic and cultural conventions of hundreds of languages and regions. Maintained by the Unicode Consortium, it is the de facto standard for internationalization (i18n), supplying the core data used by major operating systems, programming language standard libraries (like ICU4C, ICU4J, and Intl in JavaScript), and cloud platforms. The repository includes patterns for displaying calendar dates, time zones, plural rules, currency symbols, measurement units, and character sorting algorithms (collation). By centralizing this complex, constantly evolving data, the CLDR eliminates the need for every software development team to independently research and maintain locale-specific formatting rules, ensuring consistent behavior across the global software ecosystem.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.