I18n:Updating Unicode version: Difference between revisions

Revision as of 21:32, 1 March 2012

This document describes the process of updating the files in the Mozilla codebase that are generated from Unicode data files.

Download the latest version of UnicodeData.txt from the Unicode website. The current version can be found at http://www.unicode.org/Public/UNIDATA/UnicodeData.txt.
Copy this file to intl/unicharutil/tools/UnicodeData-Latest.txt in the mozilla source tree
Until bug 210501 is fixed you will have to edit UnicodeData-Latest.txt by hand and delete all the lines for codepoints above FFFF
Run perl gencasetable.pl in intl/unichar/tools. This creates a new version of intl/unicharutil/src/casetable.h

Download the latest version of UnicodeData.txt from the Unicode website. The current version can be found at http://www.unicode.org/Public/UNIDATA/UnicodeData.txt.
Copy this file to intl/unicharutil/tools/UnicodeData-Latest.txt in the mozilla source tree
Run perl gentransliterate.pl in intl/unichar/tools. This creates a new version of intl/unicharutil/tables/transliterate.properties

Download the latest version of UnicodeData.txt from the Unicode website. The current version can be found at http://www.unicode.org/Public/UNIDATA/UnicodeData.txt.
Copy this file to intl/unicharutils/util/UnicodeData-Latest.txt in the mozilla source tree
Run perl genbidicattable.pl in intl/unicharutils/util. This creates a new version of intl/unicharutils/util/bidicattable.h
The previous step will probably issue warnings like the following:

WARNING, Unicode Database now contain characters which we have not considered.
change this program !!!
Problem- U+010900 - U+010907 range

In this case, you will need to edit @range in genbidicattable.pl to include the new ranges

Download the latest version of UnicodeData.txt from the Unicode website. The current version can be found at http://www.unicode.org/Public/UNIDATA/UnicodeData.txt.
Copy this file to intl/unicharutil/tools/UnicodeData-Latest.txt in the mozilla source tree
Download the latest version of DerivedCoreProperties.txt from the Unicode website. The current version can be found at http://www.unicode.org/Public/UNIDATA/DerivedCoreProperties.txt.
Copy this file to intl/unicharutil/tools/DerivedCoreProperties.txt in the mozilla source tree
Run perl genignorable.pl | perl ccmapbin.pl - gIgnorableCCMapExt ignorable in intl/unicharutil/tools. This creates a new version of gfx/thebes/src/ignorable.x-ccmap

Punctuation marks: See bug 375291 for more.

@@ Line 9: / Line 9: @@
 #'''Until {{Bug|210501}} is fixed''' you will have to edit UnicodeData-Latest.txt by hand and delete all the lines for codepoints above FFFF
 #Run <tt>perl gencasetable.pl</tt> in intl/unichar/tools. This creates a new version of intl/unicharutil/src/casetable.h
-== Character properties ==
-#Download the latest version of UnicodeData.txt from the Unicode website. The current version can be found at http://www.unicode.org/Public/UNIDATA/UnicodeData.txt.
-#Copy this file to intl/unicharutil/tools/UnicodeData-Latest.txt in the mozilla source tree
-#Run <tt>perl gencattable.pl</tt> in intl/unichar/tools.  This creates a new version of intl/unicharutil/src/cattable.h
-#The previous step will probably issue warnings like the following:
- WARNING, Unicode Database now contain characters which we have not considered.
- change this program !!!
- Problem- U+010900 - U+010907 range
-In this case, you will need to edit <tt>@range</tt> in gencattable.pl to include the new ranges
 == Normalization ==