summaryrefslogtreecommitdiffstats
path: root/tests/utf.test
Commit message (Collapse)AuthorAgeFilesLines
...
| * | | Fix [ed29806baf]: Tcl_UtfToUniChar reads more than TCL_UTF_MAX bytesjan.nijtmans2020-05-131-134/+77
| |\ \ \
| | * \ \ Merge testcase cleanup. Make Tcl_UtfPrev() behave the same for any ↵jan.nijtmans2020-05-121-19/+18
| | |\ \ \ | | |/ / / | |/| | | | | | | | TCL_UTF_MAX value, since we didn't figure out yet how it should behave for TCL_UTF_MAX>3.
| | * | | Fix "knownBug" utf-4.11. Turns out a few other testcases where still not ↵jan.nijtmans2020-05-121-174/+54
| | | | | | | | | | | | | | | | | | | | correct, now they are. Make next/prev behavior the same for all TCL_UTF_MAX values, since the exact behavior for TCL_UTF_MAX>3 should be worked out further for Tcl 8.7 first, then everything agreed upon can be backported.
| | * | | Merge 8.6. Mark testcase utf-4.11 as "knownBug": this one still doesn't give ↵jan.nijtmans2020-05-111-100/+112
| | |\ \ \ | | | | | | | | | | | | | | | | | | the right answer. Add testcase 4.14 with similar corner-case, this one is OK.
| | * | | | Change order of some testcases, matching 8.6jan.nijtmans2020-05-071-12/+12
| | | | | |
| * | | | | Merge 8.5jan.nijtmans2020-05-121-66/+59
| |\ \ \ \ \ | | |_|/ / / | |/| | / / | | | |/ / | | |/| |
| | * | | Unsplit some test-cases and renumber, for testcase which give the same ↵jan.nijtmans2020-05-121-100/+46
| | | | | | | | | | | | | | | | | | | | results for different TCL_UTF_MAX values.
* | | | | Merge 8.6jan.nijtmans2020-05-111-32/+29
|\ \ \ \ \ | |/ / / /
| * | | | Tweak the Tcl_UtfPrev() implementation for TCL_UTF_MAX=4. This fixes 10 ↵jan.nijtmans2020-05-111-34/+28
| | | | | | | | | | | | | | | | | | | | testcases in 4 groups (utf-7.10, utf-7.15, utf-7.40 and utf-7.48) , where Tcl_UtfPrev() didn't jump to the beginning of the UTF-8 character, even though there was no limitation which prevented that. So, this is actually a bug-fix for the TIP #389 implementation.
* | | | | Merge 8.6jan.nijtmans2020-05-111-1/+1
|\ \ \ \ \ | |/ / / /
| * | | | occurance -> occurrence.jan.nijtmans2020-05-111-1/+1
| | | | |
* | | | | Merge 8.6jan.nijtmans2020-05-101-74/+81
|\ \ \ \ \ | |/ / / /
| * | | | Tweak Invalid() function: No need for "return 0" twice in the function. jan.nijtmans2020-05-101-7/+7
| | | | | | | | | | | | | | | For start bytes F0-F4, case TCL_UTF_MAX=4, Tcl_UtfToUniChar() reads 3 bytes but only advances 1 byte. So Tcl_UtfCharComplete() must make sure 3 bytes are available, not 1. Adapt Tcl_UtfCharComplete() accordingly. No change for TCL_UTF_MAX=[3|6]
| * | | | Rebase to latest core-8-6-branch.jan.nijtmans2020-05-081-12/+3
| |\ \ \ \ | | | |/ / | | |/| |
| | * | | Merge 8.6jan.nijtmans2020-05-071-21/+33
| | |\ \ \
| | * \ \ \ merge 8.6dgp2020-05-071-2/+8
| | |\ \ \ \
| | * \ \ \ \ Merge 8.6. Some more tweaks to Tcl_UtfPrev(), so it cannot jump back 4 bytes ↵jan.nijtmans2020-05-071-543/+515
| | |\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | in "utf16" build any more.
| | * | | | | | Add 4 test-cases that could fool Tcl_UtfPrev (but ... actually they don't).jan.nijtmans2020-05-051-0/+12
| | | | | | | | | | | | | | | | | | | | | | | | Make sure that Tcl_UtfPrev() never reads more than 3 trail bytes (or 4 when TCL_UTF_MAX > 4). Those are the same limits as for Tcl_UtfNext() and Tcl_UtfToUniChar()
| | * | | | | | Merge 8.6jan.nijtmans2020-05-051-23/+23
| | |\ \ \ \ \ \
| | * | | | | | | More progress/simplificationjan.nijtmans2020-05-041-21/+12
| | | | | | | | |
| | * | | | | | | Merge 8.6jan.nijtmans2020-05-041-7/+7
| | |\ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ Merge 8.6jan.nijtmans2020-05-041-27/+35
| | |\ \ \ \ \ \ \ \
| | * | | | | | | | | Seems almost correct. Still problem with "string index" for TCL_UTF_MAX>3jan.nijtmans2020-05-021-59/+56
| | | | | | | | | | |
| | * | | | | | | | | More fixes for [ed29806baf]. Not working yet. WIPjan.nijtmans2020-05-021-22/+23
| | | | | | | | | | |
* | | | | | | | | | | Merge 8.6jan.nijtmans2020-05-081-5/+23
|\ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / /
| * | | | | | | | | | Merge 8.5jan.nijtmans2020-05-081-5/+23
| |\ \ \ \ \ \ \ \ \ \ | | | |_|_|_|_|_|_|/ / | | |/| | | | | | | |
| | * | | | | | | | | More test-case cleanup. Enhance "testutfnext", so it can detect whether ↵jan.nijtmans2020-05-081-87/+105
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | bytes after the string-end are read. The command will return -1 in that case. No need for additional arguments any more.
* | | | | | | | | | | Merge 8.6jan.nijtmans2020-05-081-2/+2
|\ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / /
| * | | | | | | | | | More testcases that can run without "testbytestring" constraints.jan.nijtmans2020-05-081-36/+36
| | |_|_|_|_|_|_|/ / | |/| | | | | | | |
* | | | | | | | | | Merge 8.6dgp2020-05-071-19/+31
|\ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / /
| * | | | | | | | | close forkdgp2020-05-071-5/+5
| |\ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ Merge 8.5jan.nijtmans2020-05-071-20/+20
| | |\ \ \ \ \ \ \ \ \
| * | \ \ \ \ \ \ \ \ \ merge 8.5dgp2020-05-071-17/+26
| |\ \ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / / / | |/| | / / / / / / / / | | | |/ / / / / / / / | | |/| | | | | | | |
| | * | | | | | | | | close forkdgp2020-05-071-16/+16
| | |\ \ \ \ \ \ \ \ \ | | | |/ / / / / / / /
| | | * | | | | | | | Simplify test-cases which don't need the "testbytestring" command to run ↵jan.nijtmans2020-05-071-16/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | without it. e.g. [testbytestring \xC2\xA2] is the same as just \xA2.
| | * | | | | | | | | Same trouble with Tcl_UtfToUniCharDstring. Test and fix.dgp2020-05-071-1/+10
| | |/ / / / / / / /
| * | | | | | | | | merge 8.5dgp2020-05-071-0/+3
| |\ \ \ \ \ \ \ \ \ | | |/ / / / / / / / | | | | | | | | / / | | |_|_|_|_|_|/ / | |/| | | | | | |
| | * | | | | | | Test demonstrating bug in ticket [b2816a3afe].dgp2020-05-071-0/+3
| | | | | | | | |
* | | | | | | | | Merge 8.6jan.nijtmans2020-05-071-35/+29
|\ \ \ \ \ \ \ \ \ | |/ / / / / / / /
| * | | | | | | | For TCL_UTF_MAX==4: Make sure that Tcl_UtfNext()/Tcl_UtfPrev() never move ↵jan.nijtmans2020-05-071-80/+81
| | |_|_|_|_|/ / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | more than 3 bytes. This is more consistant with what Tcl 8.7 does too. For TCL_UTF_MAX==6: Make sure that Tcl_UtfNext()/Tcl_UtfPrev() never move more than 4 bytes. For TCL_UTF_MAX==3: No change. Introduce ucs2_utf16 test constraint, since many test results now become the same for ucs2 and utf16.
| * | | | | | | Merge 8.5jan.nijtmans2020-05-061-510/+504
| |\ \ \ \ \ \ \ | | |/ / / / / /
| | * | | | | | Backport testutfprev/testutfnex testcase improvements from 8.7. This makes ↵jan.nijtmans2020-05-061-510/+504
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | testdescriptions/testresults more equal among branches, so the real differences are more visible.
* | | | | | | | Merge 8.6jan.nijtmans2020-05-061-8/+6
|\ \ \ \ \ \ \ \ | |/ / / / / / /
| * | | | | | | Merge 8.5.jan.nijtmans2020-05-061-11/+9
| |\ \ \ \ \ \ \ | | |/ / / / / / | | | | | | / / | | |_|_|_|/ / | |/| | | | | Make testcases utf-7.20.[01] content the same as in core-8-5-branch, core-8-branch and trunk (0xF4 -> 0xF2)
| | * | | | | 3 testcases don't need pairsTo4bytes, fullutf is enough, since the ↵jan.nijtmans2020-05-061-5/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | dubble-surrogate-backslash syntac has no relation to the internal byte format.
* | | | | | | Fix Tcl_UtfPrev() such that it can never go back more than TCL_UTF_MAX ↵jan.nijtmans2020-05-051-13/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | bytes. Already done correctly on core-8-6-branch, but this was never forwarded to core-8-branch.
* | | | | | | Merge 8.6jan.nijtmans2020-05-051-54/+51
|\ \ \ \ \ \ \ | |/ / / / / /
| * | | | | | Merge 8.5jan.nijtmans2020-05-051-26/+35
| |\ \ \ \ \ \ | | |/ / / / / | | | | | / / | | |_|_|/ / | |/| | | |
| | * | | | Properly protect "Invalid" function against lead bytes 0x80-0xBF. This fixes ↵jan.nijtmans2020-05-051-25/+34
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | "knownBug" testcase utf-6.93.1. Rename tip389 selector to utf16, since that's what it actually is, in contrast to ucs2 and ucs4.
| | * | | | Test-case cleanup. Increase timeout a little bit in main.test, making Travis ↵jan.nijtmans2020-05-041-41/+50
| | | | | | | | | | | | | | | | | | | | | | | | build errors because of this less likely.