summaryrefslogtreecommitdiffstats
path: root/util/unicode
Commit message (Collapse)AuthorAgeFilesLines
* UCD 5.0: Apply Unicode Corrigendum #6Konstantin Ritt2012-06-132-25/+14
| | | | | | | | | | | | | | http://unicode.org/versions/corrigendum6.html: > in Unicode 5.0, the list of characters with the Bidi_Mirrored property > was made consistent for brackets and quotation marks, in preparation for > new constraints on bidi mirroring. However, after publication of > Unicode 5.0.0 it was discovered that this change adversely affected > several quotation mark characters in deployed data. Task-number: QTBUG-25169 Change-Id: I2cd6a70a69f4b2c37a3f191e05233854a16f10d1 Reviewed-by: Lars Knoll <lars.knoll@nokia.com>
* Update year in Nokia copyright messages.Jason McDonald2012-01-113-4/+4
| | | | | | | | | Simple search and replace. This commit doesn't touch 3rd-party files, nor translations (where the change is not so simple and will be handled in a separate commit). Change-Id: I4e48513b8078a44a8cd272326685b25338890148 Reviewed-by: Rohan McGovern <rohan.mcgovern@nokia.com>
* Add spaces for string concatenation to work around C++11 source incompatibility.hjk2011-11-221-2/+2
| | | | | Reviewed-by: Oswald Buddenhagen <oswald.buddenhagen@nokia.com> Task-number: QTBUG-22847
* Update licenseheader text in source files for qt4.8Jyri Tahtela2011-05-133-69/+69
| | | | | | | Updated version of LGPL and FDL licenseheaders. Apply release phase licenseheaders for all source files. Reviewed-by: Trust Me
* Merge remote branch 'origin/4.7' into qt-master-from-4.7Olivier Goffart2011-01-173-4/+4
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: examples/webkit/imageanalyzer/imageanalyzer.h examples/webkit/imageanalyzer/mainwindow.h mkspecs/unsupported/qws/linux-x86-openkode-g++/qplatformdefs.h src/corelib/io/qfsfileengine_iterator_unix.cpp src/corelib/io/qfsfileengine_iterator_win.cpp src/corelib/kernel/qcoreapplication.cpp src/network/access/qnetworkaccessdatabackend.cpp src/plugins/bearer/connman/qconnmanservice_linux.cpp src/plugins/platforms/openvglite/qwindowsurface_vglite.h src/s60installs/bwins/QtCoreu.def src/s60installs/eabi/QtCoreu.def src/s60installs/s60installs.pro tools/assistant/tools/assistant/helpviewer_qwv.h tools/qdoc3/test/qt-html-templates.qdocconf
| * Update copyright year to 2011.Jason McDonald2011-01-103-4/+4
| | | | | | | | Reviewed-by: Trust Me
* | make the ArabicShaping parser a bit stricterKonstantin Ritt2010-11-291-13/+56
| | | | | | | | | | | | | | | | | | warn and halt if unassigned or unhandled joining value was met. this doesn't affect on the generated tables but makes the upgrading to the newer UCD versions a bit easier but safer in general. Merge-request: 946 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* | fix a typo in the code rangeKonstantin Ritt2010-11-291-3/+7
| | | | | | | | | | | | | | and add the curly braces to satisfy the coding style Merge-request: 946 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* | define a constant for the expected Properties struct sizeKonstantin Ritt2010-11-291-2/+3
|/ | | | | Merge-request: 946 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* Compile in C++0x modeThiago Macieira2010-09-211-1/+1
|
* minor clean-upsRitt Konstantin2010-09-211-26/+21
| | | | | improve readability nicer output
* minor improvements for data parsersRitt Konstantin2010-09-211-61/+77
| | | | | improve readability of upperCase/lowerCase/titleCase/caseFolded code paths; additional tests make some parsers more consistent; minor speed-up
* tiny clean-up for generated dataRitt Konstantin2010-09-211-2/+4
|
* move QUnicodeTables:: script() and lineBreakClass() implementationsRitt Konstantin2010-09-211-0/+18
| | | | from qchar.cpp to qunicodetables.cpp
* Fix the code after merge: DerivedNormalizationProps has two or more columnsThiago Macieira2010-03-051-1/+1
|
* add some usefull definitions to qunicodetables_p.hRitt Konstantin2010-03-051-2/+3
| | | | | | | | | | * CURRENT_VERSION macro in qunicodetables.cpp was renamed to UNICODE_DATA_VERSION and it's definition was moved to qunicodetables_p.h * LAST_UNICODE_CHAR macro in qchar.cpp was renamed to UNICODE_LAST_CODEPOINT and it's definition was moved to qunicodetables_p.h Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* finish last commitRitt Konstantin2010-03-051-3/+4
| | | | | | | don't skip non-starters in composition exclusions code; warn & exit instead Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* prefer DerivedNormalizationProps.txt over CompositionExclusions.txtRitt Konstantin2010-03-052-208/+28
| | | | | | | | | | | | | | | | | | | 1) http://www.unicode.org/reports/tr44/ :2.1 > Implementations should simply use the derived properties, > and should not try to rederive them from lists of simple > properties and collections of rules, because of the chances > for error and divergence when doing so. 2) DerivedNormalizationProps.txt file also provides additional info that can be used for Normalization Form Quick Check algorithm implementation some later Note: this commit *must not* change anything in the (re)generated data; any change in generated data will point to the data inconsistency between CompositionExclusions.txt, DerivedNormalizationProps.txt and UnicodeData.txt files Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* improve error reporting a bit moreRitt Konstantin2010-03-051-1/+8
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* improve error reportingRitt Konstantin2010-03-051-0/+8
| | | | | | | | warn on upperCaseDiff/lowerCaseDiff/titleCaseDiff/caseFoldDiff 's value exceeds signed short bounds Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* fix incorect conditionRitt Konstantin2010-03-051-1/+1
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* check if string to int conversions were done w/o errorsRitt Konstantin2010-03-051-3/+18
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* improve error reporting for unassigned grapheme/word/sentence break classesRitt Konstantin2010-03-051-8/+18
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* avoid using of qunicodetables_p.h in generatorRitt Konstantin2010-03-051-1/+3
| | | | | | | we can do that after last changes Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* use QHash for line break mapRitt Konstantin2010-03-051-45/+74
| | | | | | | | to be consistent with other maps this also improves perfomance a bit Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* use QHash for age mapRitt Konstantin2010-03-051-26/+29
| | | | | | | to be consistent with other maps Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* minor clean-upsRitt Konstantin2010-03-051-42/+44
| | | | | | | | | | no changes in behavior in our case `c->cat != QChar::NoCategory` logically equals to `c->name` and the latter expression used in other maps Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* generate specialCaseMap as set of human-readable code-sequencesRitt Konstantin2010-03-051-3/+3
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* make sure that the sequences in specialCaseMap are uniqueRitt Konstantin2010-03-051-1/+1
| | | | | | | | | there is was a bug caused appending the same sequence again and again... this fix also reduces count of unique unicode properties (and blocks) Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* Unicode character property 'General_Category=Cn' was erroneously ignoredRitt Konstantin2010-03-051-1/+1
| | | | | | | | | | | | | causing two related bugs in QChar::category() and QChar::isPrint(). As described in tr44, 4.2.8 Default Values General_Category character property should be setted to Cn for all codepoints omitted in UCD. Instead they was mapped to QChar::NoCategory (=0) which have no equivalent in Unicode specs and as result was ignored in filtering by binary mask. Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* fix some 0x10000 codepoint -related issuesRitt Konstantin2010-03-051-10/+8
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* minor cleanups and styling fixes for generator and generated codeRitt Konstantin2010-03-051-92/+98
| | | | | Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* apply some (forgotten) changes to generator as they were applied to the dataRitt Konstantin2010-03-051-3/+9
| | | | | | | | b6542eb2 - Thierry Bastian) fix to exported symbol 2e429e40 - Lars Knoll) N'Ko support Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* adjust unicode tables generator to work better under winRitt Konstantin2010-03-052-0/+2
| | | | | | | | | * protect data-files from crlf line-endings since generator asserts on windows because of crlf line endings * assume generator is a console app Merge-request: 480 Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* Add the Unicode normalisation properties.Thiago Macieira2010-02-241-0/+2650
| | | | | | Source: http://unicode.org/Public/5.0.0/ucd/DerivedNormalizationProps.txt Reviewed-by: Trust Me
* Update copyright year to 2010Jason McDonald2010-01-063-4/+4
| | | | Reviewed-by: Trust Me
* Update license headers embedded in code.Jason McDonald2009-09-091-0/+1
| | | | Reviewed-by: Trust Me
* Update license headers again.Jason McDonald2009-09-093-16/+15
| | | | Reviewed-by: Trust Me
* Add missing license headersJason McDonald2009-09-031-0/+41
| | | | Reviewed-by: Trust Me
* Update tech preview license header.Jason McDonald2009-08-312-39/+39
| | | | Reviewed-by: Trust Me
* Update license headers.Jason McDonald2009-08-112-25/+25
| | | | Reviewed-by: Trust Me
* Fixed the build on Windows after regenerating the unicode tables.Denis Dzyubenko2009-07-011-2/+2
| | | | Reviewed-by: trustme
* Fixed the license header that the unicode table generated uses.Denis Dzyubenko2009-07-011-8/+85
| | | | | | | Also made sure that the generated code will not have trailing whitespaces. Reviewed-by: Thiago Macieira <thiago.macieira@nokia.com>
* operator==() for Unicode properties was omitting one property, which ↵Chusslove Illich (Часлав Илић)2009-07-011-0/+1
| | | | | | | resulted in wrong choice of unique properties for characters 451-45f. Reviewed-By: Thiago Macieira <thiago.macieira@nokia.com> Reviewed-By: Denis Dzyubenko <denis.dzyubenko@nokia.com>
* Update license headers as requested by the marketing department.Jason McDonald2009-06-162-4/+4
| | | | Reviewed-by: Trust Me
* Long live Qt 4.5!Lars Knoll2009-03-2326-0/+61755