summaryrefslogtreecommitdiffstats
path: root/util/unicode
Commit message (Collapse)AuthorAgeFilesLines
* Fix the code after merge: DerivedNormalizationProps has two or more columnsThiago Macieira2010-03-051-1/+1
|
* add some usefull definitions to qunicodetables_p.hRitt Konstantin2010-03-051-2/+3
| | | | | | | | | | * CURRENT_VERSION macro in qunicodetables.cpp was renamed to UNICODE_DATA_VERSION and it's definition was moved to qunicodetables_p.h * LAST_UNICODE_CHAR macro in qchar.cpp was renamed to UNICODE_LAST_CODEPOINT and it's definition was moved to qunicodetables_p.h Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* finish last commitRitt Konstantin2010-03-051-3/+4
| | | | | | | don't skip non-starters in composition exclusions code; warn & exit instead Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* prefer DerivedNormalizationProps.txt over CompositionExclusions.txtRitt Konstantin2010-03-052-208/+28
| | | | | | | | | | | | | | | | | | | 1) http://www.unicode.org/reports/tr44/ :2.1 > Implementations should simply use the derived properties, > and should not try to rederive them from lists of simple > properties and collections of rules, because of the chances > for error and divergence when doing so. 2) DerivedNormalizationProps.txt file also provides additional info that can be used for Normalization Form Quick Check algorithm implementation some later Note: this commit *must not* change anything in the (re)generated data; any change in generated data will point to the data inconsistency between CompositionExclusions.txt, DerivedNormalizationProps.txt and UnicodeData.txt files Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* improve error reporting a bit moreRitt Konstantin2010-03-051-1/+8
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* improve error reportingRitt Konstantin2010-03-051-0/+8
| | | | | | | | warn on upperCaseDiff/lowerCaseDiff/titleCaseDiff/caseFoldDiff 's value exceeds signed short bounds Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* fix incorect conditionRitt Konstantin2010-03-051-1/+1
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* check if string to int conversions were done w/o errorsRitt Konstantin2010-03-051-3/+18
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* improve error reporting for unassigned grapheme/word/sentence break classesRitt Konstantin2010-03-051-8/+18
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* avoid using of qunicodetables_p.h in generatorRitt Konstantin2010-03-051-1/+3
| | | | | | | we can do that after last changes Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* use QHash for line break mapRitt Konstantin2010-03-051-45/+74
| | | | | | | | to be consistent with other maps this also improves perfomance a bit Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* use QHash for age mapRitt Konstantin2010-03-051-26/+29
| | | | | | | to be consistent with other maps Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* minor clean-upsRitt Konstantin2010-03-051-42/+44
| | | | | | | | | | no changes in behavior in our case `c->cat != QChar::NoCategory` logically equals to `c->name` and the latter expression used in other maps Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* generate specialCaseMap as set of human-readable code-sequencesRitt Konstantin2010-03-051-3/+3
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* make sure that the sequences in specialCaseMap are uniqueRitt Konstantin2010-03-051-1/+1
| | | | | | | | | there is was a bug caused appending the same sequence again and again... this fix also reduces count of unique unicode properties (and blocks) Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* Unicode character property 'General_Category=Cn' was erroneously ignoredRitt Konstantin2010-03-051-1/+1
| | | | | | | | | | | | | causing two related bugs in QChar::category() and QChar::isPrint(). As described in tr44, 4.2.8 Default Values General_Category character property should be setted to Cn for all codepoints omitted in UCD. Instead they was mapped to QChar::NoCategory (=0) which have no equivalent in Unicode specs and as result was ignored in filtering by binary mask. Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* fix some 0x10000 codepoint -related issuesRitt Konstantin2010-03-051-10/+8
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* minor cleanups and styling fixes for generator and generated codeRitt Konstantin2010-03-051-92/+98
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* apply some (forgotten) changes to generator as they were applied to the dataRitt Konstantin2010-03-051-3/+9
| | | | | | | | b6542eb2 - Thierry Bastian) fix to exported symbol 2e429e40 - Lars Knoll) N'Ko support Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* adjust unicode tables generator to work better under winRitt Konstantin2010-03-052-0/+2
| | | | | | | | | * protect data-files from crlf line-endings since generator asserts on windows because of crlf line endings * assume generator is a console app Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* Add the Unicode normalisation properties.Thiago Macieira2010-02-241-0/+2650
| | | | | | Source: http://unicode.org/Public/5.0.0/ucd/DerivedNormalizationProps.txt Reviewed-by: Trust Me
* Update copyright year to 2010Jason McDonald2010-01-063-4/+4
| | | | Reviewed-by: Trust Me
* Update license headers embedded in code.Jason McDonald2009-09-091-0/+1
| | | | Reviewed-by: Trust Me
* Update license headers again.Jason McDonald2009-09-093-16/+15
| | | | Reviewed-by: Trust Me
* Add missing license headersJason McDonald2009-09-031-0/+41
| | | | Reviewed-by: Trust Me
* Update tech preview license header.Jason McDonald2009-08-312-39/+39
| | | | Reviewed-by: Trust Me
* Update license headers.Jason McDonald2009-08-112-25/+25
| | | | Reviewed-by: Trust Me
* Fixed the build on Windows after regenerating the unicode tables.Denis Dzyubenko2009-07-011-2/+2
| | | | Reviewed-by: trustme
* Fixed the license header that the unicode table generated uses.Denis Dzyubenko2009-07-011-8/+85
| | | | | | | Also made sure that the generated code will not have trailing whitespaces. Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* operator==() for Unicode properties was omitting one property, which ↵Chusslove Illich (Часлав Илић)2009-07-011-0/+1
| | | | | | | resulted in wrong choice of unique properties for characters 451-45f. Reviewed-By: Thiago Macieira <thiago.macieira@nokia.com> Reviewed-By: Denis Dzyubenko <denis.dzyubenko@nokia.com>
* Update license headers as requested by the marketing department.Jason McDonald2009-06-162-4/+4
| | | | Reviewed-by: Trust Me
* Long live Qt 4.5!Lars Knoll2009-03-2326-0/+61755
generated by cgit v0.12 at 2024-09-29 03:37:21 (GMT)