summaryrefslogtreecommitdiffstats
path: root/Tools/unicode/makeunicodedata.py
Commit message (Collapse)AuthorAgeFilesLines
* Update some www.unicode.org URLs to use HTTPS. (GH-18912)Benjamin Peterson2020-03-111-2/+2
|
* closes bpo-39926: Update Unicode to 13.0.0. (GH-18910)Benjamin Peterson2020-03-111-4/+5
|
* bpo-37760: Convert from length-18 lists to a dataclass, in makeunicodedata. ↵Greg Price2019-09-121-62/+88
| | | | | | | | | (GH-15265) Now the fields have names! Much easier to keep straight as a reader than the elements of an 18-tuple. Runs about 10-15% slower: from 10.8s to 12.3s, on my laptop. Fortunately that's perfectly fine for this maintenance script.
* bpo-37760: Avoid cluttering work tree with downloaded Unicode files. (GH-15128)Greg Price2019-08-151-2/+5
|
* bpo-37760: Factor out standard range-expanding logic in makeunicodedata. ↵Greg Price2019-08-141-33/+35
| | | | | | | | (GH-15248) Much like the lower-level logic in commit ef2af1ad4, we had 4 copies of this logic, written in a couple of different ways. They're all implementing the same standard, so write it just once.
* bpo-37760: Constant-fold some old options in makeunicodedata. (GH-15129)Greg Price2019-08-131-24/+20
| | | | | | | | The `expand` option was introduced in 2000 in commit fad27aee1. It appears to have been always set since it was committed, and what it does is tell the code to do something essential. So, just always do that, and cut the option. Also cut the `linebreakprops` option, which isn't consulted anymore.
* bpo-37760: Factor out the basic UCD parsing logic of makeunicodedata. (GH-15130)Greg Price2019-08-131-133/+109
| | | | | | There were 10 copies of this, and almost as many distinct versions of exactly how it was written. They're all implementing the same standard. Pull them out to the top, so the more interesting logic that remains becomes easier to read.
* Clean up and reduce visual clutter in the makeunicode.py script. (GH-7558)Stefan Behnel2019-06-011-263/+275
|
* closes bpo-36861: Update Unicode database to 12.1.0. (GH-13214)Benjamin Peterson2019-05-091-1/+1
| | | Adds ㋿.
* bpo-36642: make unicodedata const (GH-12855)Inada Naoki2019-04-161-1/+1
|
* closes bpo-33376: Update to Unicode 12.0.0. (GH-12256)Benjamin Peterson2019-03-101-1/+1
|
* update to Unicode 11.0.0 (closes bpo-33778) (GH-7439)Benjamin Peterson2018-06-071-20/+19
| | | Also, standardize indentation of generated tables.
* bpo-30736: upgrade to Unicode 10.0 (#2344)Benjamin Peterson2017-06-231-4/+5
| | | Straightforward. While we're at it, though, strip trailing whitespace from generated tables.
* bpo-30296 Remove unnecessary tuples, lists, sets, and dicts (#1489)Jon Dufresne2017-05-181-1/+1
| | | | | | | | * Replaced list(<generator expression>) with list comprehension * Replaced dict(<generator expression>) with dict comprehension * Replaced set(<list literal>) with set literal * Replaced builtin func(<list comprehension>) with func(<generator expression>) when supported (e.g. any(), all(), tuple(), min(), & max())
* Unicode 9.0.0Benjamin Peterson2016-09-151-3/+8
| | | | | Not completely mechanical since support for East Asian Width changes—emoji codepoints became Wide—had to be added to unicodedata.
* upgrade to Unicode 8.0.0Benjamin Peterson2015-06-271-3/+4
|
* Merge: #18176: Change generic UCD PropList link to version specific link.R David Murray2014-10-101-1/+1
|\
| * #18176: Change generic UCD PropList link to version specific link.R David Murray2014-10-101-1/+1
| |
* | Merge: #18176: fix another reference and add it to the makeunicodedata comment.R David Murray2014-10-091-0/+1
|\ \ | |/
| * #18176: fix another reference and add it to the makeunicodedata comment.R David Murray2014-10-091-0/+1
| |
* | Merge: #18176: updated stdtypes UCD link, added reminder to makeunicodedata.R David Murray2014-10-091-0/+4
|\ \ | |/
| * #18176: updated stdtypes UCD link, added reminder to makeunicodedata.R David Murray2014-10-091-0/+4
| | | | | | | | Patch by Alexander Belopolsky.
* | upgrade to unicode 7.0.0Benjamin Peterson2014-07-061-1/+1
|/
* upgrade unicode db to 6.3.0 (closes #19221)Benjamin Peterson2013-10-101-2/+2
|
* #18803: merge with 3.3.Ezio Melotti2013-08-251-1/+1
|\
| * #18803: fix more typos. Patch by Févry Thibault.Ezio Melotti2013-08-251-1/+1
| |
* | Issue #18722: Remove uses of the "register" keyword in C code.Antoine Pitrou2013-08-131-2/+2
| |
* | upgrade to UCD 6.2Benjamin Peterson2012-09-291-1/+1
|/
* Some cleanup in the Tools directory.Florent Xicluna2012-07-071-1/+0
|
* update to Unicode 6.1Benjamin Peterson2012-02-211-4/+5
|
* delta encoding of upper/lower/title makes a glorious return (#12736)Benjamin Peterson2012-01-161-0/+7
|
* add str.casefold() (closes #13752)Benjamin Peterson2012-01-141-15/+35
|
* use full unicode mappings for upper/lower/title case (#12736)Benjamin Peterson2012-01-111-32/+69
| | | | Also broaden the category of characters that count as lowercase/uppercase.
* #12753: Add support for Unicode name aliases and named sequences.Ezio Melotti2011-10-211-2/+100
|
* Fix ResourceWarnings in makeunicodedata.py.Ezio Melotti2011-09-301-81/+88
|
* #11565: Merge with 3.1.Ezio Melotti2011-03-161-1/+1
|\
| * #11565: Fix several typos. Patch by Piotr Kasprzyk.Ezio Melotti2011-03-161-1/+1
| |
* | Issue #10459: Update CJK character names to Unicode 6.0.Martin v. Löwis2010-11-221-2/+19
| |
* | Upgrade to Unicode 6.0.0.Martin v. Löwis2010-10-111-58/+77
| | | | | | | | | | | | | | | | makeunicodedata.py: download all data files from unicode.org, switch to extracting Unihan data from zip file. Read linebreakprops and derivednormalizationprops even for old versions, even though they are not used in delta records. test:unicode.py: U+11000 is now assigned, use U+14000 instead.
* | #9210: remove --with-wctype-functions configure option.Amaury Forgeot d'Arc2010-09-121-4/+0
| | | | | | | | | | | | | | | | The internal unicode database is now always used. (after 5 years: see http://mail.python.org/pipermail/python-dev/2004-December/050193.html )
* | #5127: Even on narrow unicode builds, the C functions that access the UnicodeAmaury Forgeot d'Arc2010-08-181-37/+4
| | | | | | | | | | | | | | | | | | | | Database (Py_UNICODE_TOLOWER, Py_UNICODE_ISDECIMAL, and others) now accept and return characters from the full Unicode range (Py_UCS4). The differences from Python code are few: - unicodedata.numeric(), unicodedata.decimal() and unicodedata.digit() now return the correct value for large code points - repr() may consider more characters as printable.
* | Merged revisions 79494,79496 via svnmerge fromFlorent Xicluna2010-03-301-5/+24
| | | | | | | | | | | | | | | | | | | | | | | | | | | | svn+ssh://pythondev@svn.python.org/python/trunk ........ r79494 | florent.xicluna | 2010-03-30 10:24:06 +0200 (mar, 30 mar 2010) | 2 lines #7643: Unicode codepoints VT (0x0B) and FF (0x0C) are linebreaks according to Unicode Standard Annex #14. ........ r79496 | florent.xicluna | 2010-03-30 18:29:03 +0200 (mar, 30 mar 2010) | 2 lines Highlight the change of behavior related to r79494. Now VT and FF are linebreaks. ........
* | Merged revisions 78982,78986 via svnmerge fromFlorent Xicluna2010-03-191-4/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | svn+ssh://pythondev@svn.python.org/python/trunk ........ r78982 | florent.xicluna | 2010-03-15 15:00:58 +0100 (lun, 15 mar 2010) | 2 lines Remove py3k deprecation warnings from these Unicode tools. ........ r78986 | florent.xicluna | 2010-03-15 19:08:58 +0100 (lun, 15 mar 2010) | 3 lines Issue #7783 and #7787: open_urlresource invalidates the outdated files from the local cache. Use this feature to fix test_normalization. ........
* | Fixed a failure in test_bigmem.Florent Xicluna2010-03-191-1/+1
| | | | | | | | | | | | | | | | | | | | | | Merged revision 79059 via svnmerge from svn+ssh://pythondev@svn.python.org/python/trunk ........ r79059 | florent.xicluna | 2010-03-18 22:50:06 +0100 (jeu, 18 mar 2010) | 2 lines Issue #8024: Update the Unicode database to 5.2 ........
* | Revert Unicode UCD 5.2 upgrade in 3.x. It broke repr() for unicode objects, ↵Florent Xicluna2010-03-191-1/+1
| | | | | | | | and gave failures in test_bigmem. Revert 79062, 79065 and 79083.
* | Missing update from previous changeset r79062.Florent Xicluna2010-03-181-1/+1
| |
* | Merged revisions 75396 via svnmerge fromAmaury Forgeot d'Arc2009-10-131-0/+5
| | | | | | | | | | | | | | | | | | | | | | svn+ssh://pythondev@svn.python.org/python/trunk ........ r75396 | amaury.forgeotdarc | 2009-10-13 23:29:34 +0200 (mar., 13 oct. 2009) | 3 lines #7112: Fix compilation warning in unicodetype_db.h makeunicodedata now generates double literals ........
* | Merged revisions 75272-75273 via svnmerge fromAmaury Forgeot d'Arc2009-10-061-7/+121
|/ | | | | | | | | | | | | | | | | svn+ssh://pythondev@svn.python.org/python/trunk ........ r75272 | amaury.forgeotdarc | 2009-10-06 21:56:32 +0200 (mar., 06 oct. 2009) | 5 lines #1571184: makeunicodedata.py now generates the functions _PyUnicode_ToNumeric, _PyUnicode_IsLinebreak and _PyUnicode_IsWhitespace. It now also parses the Unihan.txt for numeric values. ........ r75273 | amaury.forgeotdarc | 2009-10-06 22:02:09 +0200 (mar., 06 oct. 2009) | 2 lines Add Anders Chrigstrom to Misc/ACKS for his work on unicodedata. ........
* Merged revisions 72054 via svnmerge fromAntoine Pitrou2009-04-271-5/+32
| | | | | | | | | | | | svn+ssh://pythondev@svn.python.org/python/trunk ........ r72054 | antoine.pitrou | 2009-04-27 23:53:26 +0200 (lun., 27 avril 2009) | 5 lines Issue #1734234: Massively speedup `unicodedata.normalize()` when the string is already in normalized form, by performing a quick check beforehand. Original patch by Rauli Ruohonen. ........
* Merged revisions 71894 via svnmerge fromWalter Dörwald2009-04-251-22/+21
| | | | | | | | | | | | svn+ssh://pythondev@svn.python.org/python/trunk ........ r71894 | walter.doerwald | 2009-04-25 16:03:16 +0200 (Sa, 25 Apr 2009) | 4 lines Issue #5828 (Invalid behavior of unicode.lower): Fixed bogus logic in makeunicodedata.py and regenerated the Unicode database (This fixes u'\u1d79'.lower() == '\x00'). ........
generated by cgit v0.12 at 2025-01-19 02:23:40 (GMT)