summaryrefslogtreecommitdiffstats
path: root/Tools/unicode
Commit message (Collapse)AuthorAgeFilesLines
* bpo-40328: Add tool for generating cjk mapping headers (GH-19602)Dong-hee Na2020-04-299-0/+51008
|
* Update some www.unicode.org URLs to use HTTPS. (GH-18912)Benjamin Peterson2020-03-111-2/+2
|
* closes bpo-39926: Update Unicode to 13.0.0. (GH-18910)Benjamin Peterson2020-03-111-4/+5
|
* bpo-37760: Convert from length-18 lists to a dataclass, in makeunicodedata. ↵Greg Price2019-09-121-62/+88
| | | | | | | | | (GH-15265) Now the fields have names! Much easier to keep straight as a reader than the elements of an 18-tuple. Runs about 10-15% slower: from 10.8s to 12.3s, on my laptop. Fortunately that's perfectly fine for this maintenance script.
* bpo-37758: Cut always-constant conditionals on sys.maxunicode. (GH-15302)Greg Price2019-09-091-4/+1
| | | | | | | | | Since PEP 393 in Python 3.3, this value is always 0x10ffff, the maximum codepoint in Unicode; there's no longer such a thing as a UCS-2 build of Python, which couldn't properly represent some characters. There are a couple of spots left where we still condition on the value of this constant. Take them out.
* bpo-37760: Avoid cluttering work tree with downloaded Unicode files. (GH-15128)Greg Price2019-08-151-2/+5
|
* bpo-37760: Factor out standard range-expanding logic in makeunicodedata. ↵Greg Price2019-08-141-33/+35
| | | | | | | | (GH-15248) Much like the lower-level logic in commit ef2af1ad4, we had 4 copies of this logic, written in a couple of different ways. They're all implementing the same standard, so write it just once.
* bpo-37760: Constant-fold some old options in makeunicodedata. (GH-15129)Greg Price2019-08-131-24/+20
| | | | | | | | The `expand` option was introduced in 2000 in commit fad27aee1. It appears to have been always set since it was committed, and what it does is tell the code to do something essential. So, just always do that, and cut the option. Also cut the `linebreakprops` option, which isn't consulted anymore.
* bpo-37760: Factor out the basic UCD parsing logic of makeunicodedata. (GH-15130)Greg Price2019-08-131-133/+109
| | | | | | There were 10 copies of this, and almost as many distinct versions of exactly how it was written. They're all implementing the same standard. Pull them out to the top, so the more interesting logic that remains becomes easier to read.
* Clean up and reduce visual clutter in the makeunicode.py script. (GH-7558)Stefan Behnel2019-06-011-263/+275
|
* closes bpo-36861: Update Unicode database to 12.1.0. (GH-13214)Benjamin Peterson2019-05-091-1/+1
| | | Adds ㋿.
* bpo-36642: make unicodedata const (GH-12855)Inada Naoki2019-04-161-1/+1
|
* bpo-22831: Use "with" to avoid possible fd leaks in tools (part 2). (GH-10927)Serhiy Storchaka2019-03-302-12/+10
|
* closes bpo-33376: Update to Unicode 12.0.0. (GH-12256)Benjamin Peterson2019-03-101-1/+1
|
* update to Unicode 11.0.0 (closes bpo-33778) (GH-7439)Benjamin Peterson2018-06-071-20/+19
| | | Also, standardize indentation of generated tables.
* bpo-30736: upgrade to Unicode 10.0 (#2344)Benjamin Peterson2017-06-231-4/+5
| | | Straightforward. While we're at it, though, strip trailing whitespace from generated tables.
* bpo-27425: Be more explicit in .gitattributes (GH-840)Zachary Ware2017-06-101-7/+7
| | | Updates checked-in line endings on several files.
* bpo-30296 Remove unnecessary tuples, lists, sets, and dicts (#1489)Jon Dufresne2017-05-181-1/+1
| | | | | | | | * Replaced list(<generator expression>) with list comprehension * Replaced dict(<generator expression>) with dict comprehension * Replaced set(<list literal>) with set literal * Replaced builtin func(<list comprehension>) with func(<generator expression>) when supported (e.g. any(), all(), tuple(), min(), & max())
* Unicode 9.0.0Benjamin Peterson2016-09-151-3/+8
| | | | | Not completely mechanical since support for East Asian Width changes—emoji codepoints became Wide—had to be added to unicodedata.
* #27364: fix "incorrect" uses of escape character in the stdlib.R David Murray2016-09-081-5/+5
| | | | | | | And most of the tools. Patch by Emanual Barry, reviewed by me, Serhiy Storchaka, and Martin Panter.
* upgrade to Unicode 8.0.0Benjamin Peterson2015-06-271-3/+4
|
* Issue #16261: Converted some bare except statements to except statementsSerhiy Storchaka2015-05-201-1/+1
| | | | with specified exception type. Original patch by Ramchandra Apte.
* Closes #17202: Merge with 3.4Zachary Ware2015-04-131-7/+7
|\
| * Issue #17202: Add .bat to .hgeol to force them to CRLF.Zachary Ware2015-04-131-7/+7
| | | | | | | | | | Using LF can a script to fail if it tries to use a label that is split across 512 byte blocks. Who knows why.
* | Issue #23181: More "codepoint" -> "code point".Serhiy Storchaka2015-01-181-1/+1
|\ \ | |/
| * Issue #23181: More "codepoint" -> "code point".Serhiy Storchaka2015-01-181-1/+1
| |
* | Merge: #18176: Change generic UCD PropList link to version specific link.R David Murray2014-10-101-1/+1
|\ \ | |/
| * #18176: Change generic UCD PropList link to version specific link.R David Murray2014-10-101-1/+1
| |
* | Merge: #18176: fix another reference and add it to the makeunicodedata comment.R David Murray2014-10-091-0/+1
|\ \ | |/
| * #18176: fix another reference and add it to the makeunicodedata comment.R David Murray2014-10-091-0/+1
| |
* | Merge: #18176: updated stdtypes UCD link, added reminder to makeunicodedata.R David Murray2014-10-091-0/+4
|\ \ | |/
| * #18176: updated stdtypes UCD link, added reminder to makeunicodedata.R David Murray2014-10-091-0/+4
| | | | | | | | Patch by Alexander Belopolsky.
* | upgrade to unicode 7.0.0Benjamin Peterson2014-07-061-1/+1
|/
* Issue #19936: Added executable bits or shebang lines to Python scripts whichSerhiy Storchaka2014-01-161-0/+0
|\ | | | | | | | | | | | | requires them. Disable executable bits and shebang lines in test and benchmark files in order to prevent using a random system python, and in source files of modules which don't provide command line interface. Fixed shebang lines in the unittestgui and checkpip scripts.
| * Issue #19936: Added executable bits or shebang lines to Python scripts whichSerhiy Storchaka2014-01-161-0/+0
| | | | | | | | | | | | | | requires them. Disable executable bits and shebang lines in test and benchmark files in order to prevent using a random system python, and in source files of modules which don't provide command line interface. Fixed shebang line to use python3 executable in the unittestgui script.
* | #1097797: add the original mapping fileAndrew Kuchling2013-11-111-0/+258
| |
* | Fix some PEP8-formatting problems in the generated codeAndrew Kuchling2013-11-111-9/+9
| |
* | upgrade unicode db to 6.3.0 (closes #19221)Benjamin Peterson2013-10-101-2/+2
| |
* | #18803: merge with 3.3.Ezio Melotti2013-08-251-1/+1
|\ \ | |/
| * #18803: fix more typos. Patch by Févry Thibault.Ezio Melotti2013-08-251-1/+1
| |
* | Issue #18722: Remove uses of the "register" keyword in C code.Antoine Pitrou2013-08-131-2/+2
| |
* | Issue #15239: Make mkstringprep.py work again on Python 3.Serhiy Storchaka2013-06-091-17/+23
|\ \ | |/
| * Issue #15239: Make mkstringprep.py work again on Python 3.Serhiy Storchaka2013-06-091-17/+23
| |
* | Issue #15378: Fix Tools/unicode/comparecodecs.py. Patch by Serhiy Storchaka.Antoine Pitrou2012-10-171-1/+1
|\ \ | |/
| * Issue #15378: Fix Tools/unicode/comparecodecs.py. Patch by Serhiy Storchaka.Antoine Pitrou2012-10-171-1/+1
| |\
| | * Issue #15378: Fix Tools/unicode/comparecodecs.py. Patch by Serhiy Storchaka.Antoine Pitrou2012-10-171-1/+1
| | |
* | | upgrade to UCD 6.2Benjamin Peterson2012-09-291-1/+1
|/ /
* | Some cleanup in the Tools directory.Florent Xicluna2012-07-071-1/+0
| |
* | Issue #14874: Restore charmap decoding speed to pre-PEP 393 levels.Antoine Pitrou2012-06-161-3/+6
| | | | | | | | Patch by Serhiy Storchaka.
* | update to Unicode 6.1Benjamin Peterson2012-02-211-4/+5
| |
generated by cgit v0.12 at 2024-11-25 07:31:25 (GMT)