CLDR 32 Release Note
Overview
Unicode CLDR 32 provides an update to the key building blocks for software supporting the world's languages. This data is used by all major software systems for their software internationalization and localization, adapting software to the conventions of different languages for such common software tasks.
Improvements in this release include:
Major contributions of main locale data for Chakma (ccp), Sindhi (sd), Odia (or), Kabyle (kab), Pashto (ps), Turkmen (tk), Norwegian Nynorsk (nn), Assamese (as), and others. See Growth.
Inclusion of four locales in common (from seed): Wolof, Tatar, Tajik, Chakma
Major additions for Emoji
Emoji names and keywords updates for Unicode 10.0 (Emoji 5)
Emoji keywords now in UCA order for consistency.
English name and keywords updates as per Emoji Subcommittee
Emoji collation update: emoji are now sorted between regular symbols and currency symbols. (Previously in v31, emoji were after all other characters.)
Import of draft subdivision names and language groups from wikidata. (See Known issues section blow)
Rule-based number formats for Indian English, Akan, Hindi (oblique), Cherokee; revisions to some others.
New numeric exemplars. For example, in zh: [\- , . % ‰ + 0 1 2 3 4 5 6 7 8 9 〇 一 七 三 九 二 五 八 六 四]
New “disjunctive” list style (eg “a, b, or c”)
New availableFormats items for day periods (skeleton “Bhm” → pattern “h:mm B” → “1:30 in the afternoon”)
Many fixes and small additions to certain preexisting data: day periods, date/time formats, Chinese collation / transliteration, transforms
Chinese stroke collation was reverted to the data from CLDR 29. See Migration.
For information on structural changes, see Spec Modifications.
Charts
The charts have been updated for the v32 data, and there are two new charts:
Language Groups — showing the new language groups
Locale Coverage — showing the data coverage of locales, by Modern, Moderate, Basic, and Core.
Survey Tool
The Moderate level has been changed to align with content language requirements.
A new Survey Tool Ref site is avaialbe for use as v32 release data reference: http://cldr-ref.unicode.org/cldr-apps/
For changes that may affect migration to this version, see Migration.
Other data additions and changes
The following summarizes some of the other changes in non-locale data.
Added CNH currency, Masaram Gondi numbering system (gonm).
charts/32/delta/supplemental-data.html
Added currency CNH
Added currency changes from STD to STN, and PHP based on iso-4217 amendment.
Addition of some language codes, 202 macroregion, scripts, variants
Changes to WZoneMapping mapping
Some additional transforms.
For language distance/matching, en-GB is now the best choice from the GB cluster. Eg, en-SA is closer to en-GB instead of enON
Various updates / additions of language/territory data, GDP data
Language Groups added
Addition of plural or ordinal rules for for io, sd, or, ps, sd, tk. pt-PT now behaves differently.
Added plural ranges for ak, as, io, or, ps, sd, tk.
Added containment for 202
Added explicit currency info for CNH, DKK, NOK, SEK
Changed week data (min days, first day, preferred hours) for RU, NZ, GL
Added day periods for ccp, cy
charts/32/delta/transforms.html
Transform additions / fixes for blt→blt_FONIPA, cy→cy_FONIPA, de→ASCII, Hani→Latn, ...
[32.0.1] Moved several BGN transforms from status “provisional” to status “contributed”. [#10728]
For more information, see detailed delta charts.
Growth
The following gives the total overview of the change in data items in CLDR. Most of the increase in data was from the addition of new locales, more emoji names and keywords across many locales, and the import of draft wikidata subdivision names. The following table shows the increase in total CLDR data items (including locale-based and non-locale-based) compared to the last release.
* The measurement of the number of items is reflects the different ways that the information is represented. A single data field (element or attribute value) may result in multiple data items. For example, plural rules may be shared by multiple languages, and a single data field contains all the languages to which those rules apply. Sometimes a changed item appears as a deletion+addition, and sequences of items (such as sort order) are not counted as different even if the order changes.
The following chart shows the increase in locale-based data over time.
For more details, see the Delta Data charts.
There is a new chart that shows the current coverage levels for CLDR locales. The locales that are not as complete are marked 'seed', and available in a separate CLDR source directory.
Migration
Plural rules
The plural rules for pt_PT changed to be different than pt (=pt_BR). The "one" case is now only the integer 1.
Timezones
Persian (fa) localized GMT hour pattern contains bidi control character LRM before signs.
Currencies
The new code for STN (SAO TOME AND PRINCIPE) has been released, and will be valid as of 2018-09-01. It is included in the release with that effective date. However, it was too late to provide names for the locales.
Language/Region data
The UN code 202 (Sub-Saharan Africa) was added late in the process, and doesn't have names (except in English).
Other
Chakma is the first CLDR locale that uses completely supplemental (non-BMP) characters, which may expose some bugs in implementations.
Chinese stroke collation was reverted to the data from CLDR 29 as a short-term fix for problems introduced in CLDR 30 that resulted in missing entries for several basic characters. A complete fix for the underlying problem is targeted for CLDR 33. See #10497, #10642.
Known Issues
New macroregions
The UN code 202 (Sub-Saharan Africa) was added late in the process, and doesn't have names (except in English).
The UN is now including Sark (680) which didn't get into the release.
“Week of” structure
The structure and intended usage for the “week x of y” patterns is still being refined and may change. This applies especially to dateFormatItems such as the following:
<dateFormatItem id="MMMMW" count=...>'week' W 'of' MMM</dateFormatItem>
<dateFormatItem id="yw" count=...>'week' w 'of' y</dateFormatItem>
Areas of discussion include the use of the count attribute and the use of ordinal vs. cardinal numbers. For more information see [#9801].
Subdivision Names
The draft subdivision names were imported from wikidata. Names that had characters outside of the language's exemplars were excluded for now. Names that would cause collisions were allowed, but marked with superscripted numbers. The goal is to clean up these names over time.
German AM/PM [reverted in CLDR 32.0.1]
Acknowledgments
Many people have made significant contributions to CLDR and LDML; see the Acknowledgments page for a full listing.
Key to Header Links
The Unicode Terms of Use apply to CLDR data; in particular, see Exhibit 1.
For web pages with different views of CLDR data, see http://cldr.unicode.org/index/charts.