summaryrefslogtreecommitdiffstats
path: root/Lib/lib2to3
Commit message (Collapse)AuthorAgeFilesLines
* bpo-36541: Add lib2to3 grammar PEP-570 pos-only arg parsing (GH-23759)Miss Islington (bot)2020-12-142-6/+77
| | | | | | | | | | | | Add positional only args support to lib2to3 pgen2. This adds 3.8's PEP-570 support to lib2to3's pgen2. lib2to3, while being deprecated is still used by things to parse all versions of Python code today. We need it to support parsing modern 3.8 and 3.9 constructs. Also add tests for complex *expr and **expr's. (cherry picked from commit 42c9f0fd0a5e67d4ae0022bfd7370cb9725a5b01) Co-authored-by: Gregory P. Smith <greg@krypto.org>
* lib2to3: Support named assignment expressions (GH-12702)Miss Islington (bot)2020-04-025-6/+25
| | | | | | | | | | | | | | | There are two copies of the grammar -- the one used by Python itself as Grammar/Grammar, and the one used by lib2to3 which has necessarily diverged at Lib/lib2to3/Grammar.txt because it needs to support older syntax an we want it to be reasonable stable to avoid requiring fixer rewrites. This brings suport for syntax like `if x:= foo():` to match what the live Python grammar does. This should've been added at the time of the walrus operator itself, but lib2to3 being independent is often overlooked. So we do consider this a bugfix rather than enhancement. (cherry picked from commit 3c3aa4516c70753de06bb142b6793d01330fcf0f) Co-authored-by: Tim Hatch <tim@timhatch.com>
* bpo-38871: Fix lib2to3 for filter-based statements that contain lambda ↵Miss Islington (bot)2020-01-072-3/+12
| | | | | | | | | (GH-17780) Correctly parenthesize filter-based statements that contain lambda expressions in lib2to3. (cherry picked from commit b821173b5458d137c8d5edb6e9b4997aac800a38) Co-authored-by: Dong-hee Na <donghee.na92@gmail.com>
* bpo-33348: parse expressions after * and ** in lib2to3 (GH-6586)Miss Skeleton (bot)2019-10-245-11/+12
| | | | | | | | | | These are valid even in python 2.7 https://bugs.python.org/issue33348 Automerge-Triggered-By: @gpshead (cherry picked from commit 96b06aefe23521b61e4e9cdd44f5d30b00c7eb95) Co-authored-by: Zsolt Dollenstein <zsol.zsol@gmail.com>
* closes bpo-37675: Use pkgutil.iter_modules to find fixers in a package ↵Miss Islington (bot)2019-07-251-4/+4
| | | | | | | rather than listdir. (14942) (cherry picked from commit 93e8aa62cfd0a61efed4a61a2ffc2283ae986ef2) Co-authored-by: Benjamin Peterson <benjamin@python.org>
* Fix typos in docs and docstrings (GH-13745)Xtreak2019-06-021-1/+1
|
* bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)Anthony Sottile2019-05-301-1/+1
| | | https://bugs.python.org/issue5028
* bpo-5028: fix doc bug for tokenize (GH-11683)Andrew Carr2019-05-301-1/+1
| | | https://bugs.python.org/issue5028
* bpo-23896: Add a grammar where exec isn't a stmt (#13272)Batuhan Taşkaya2019-05-201-0/+3
| | | https://bugs.python.org/issue23896
* bpo-36766: Typos in docs and code comments (GH-13116)penguindustin2019-05-061-1/+1
|
* bpo-35312: Make lib2to3.pgen2.parse.ParseError round-trip pickle-able. ↵Anthony Sottile2018-11-272-0/+15
| | | | (GH-10710)
* bpo-35202: Remove unused imports in Lib directory. (GH-10446)Srinivas Thatiparthy (శ్రీనివాస్ తాటిపర్తి)2018-11-102-2/+0
|
* bpo-16965: 2to3 now rewrites execfile() to open with 'rb'. (GH-8569)Zackery Spytz2018-10-132-9/+10
|
* closes bpo-34515: Support non-ASCII identifiers in lib2to3. (GH-8950)Monson Shao2018-09-152-6/+15
|
* Revert "closes bpo-27494: Fix 2to3 handling of trailing comma after a ↵Serhiy Storchaka2018-07-316-36/+10
| | | | | | | | generator expression (GH-3771)" (#8241) This reverts commit af810b35b494ef1d255d4bf340b92a9dad446995. This is not valid syntax (see bpo-32012).
* bpo-21446: Update reload fixer to use importlib (GH-8391)Berker Peksag2018-07-232-9/+9
|
* bpo-34108: Fix double carriage return in 2to3 on Windows (#8271)Jason R. Coombs2018-07-132-1/+2
| | | | | * Add test capturing failure. * Honor newlines as present in the original file.
* bpo-31583: Fix 2to3 for using with --add-suffix option (GH-3758)Denis Osipov2018-04-181-1/+1
|
* bpo-11594: Ensure line-endings are respected when using 2to3 (GH-6483)Aaron Ang2018-04-173-18/+34
|
* [lib2to3] Make grammar pickling faster (#6491)Łukasz Langa2018-04-171-25/+2
| | | | | | | | | * Now uses pickle protocol 4 * Doesn't wrap the grammar's `__dict__` in ordered dictionaries anymore as dictionaries in Python 3.6+ are ordered by default This still produces deterministic pickles (that hash the same with MD5). Tested with different PYTHONHASHSEED values.
* Add support for all string literals to lib2to3 (#6457)Zsolt Dollenstein2018-04-162-52/+28
|
* Revert "bpo-30406: Make async and await proper keywords (#1669)" (GH-6143)Jelle Zijlstra2018-03-184-20/+94
| | | | | This reverts commit ac317700ce7439e38a8b420218d9a5035bba92ed. (Reverts only the lib2to3 part.)
* lib2to3: Add more tests (#6101)Łukasz Langa2018-03-131-0/+108
|
* bpo-33064: lib2to3: support trailing comma after *args and **kwargs (#6096)Łukasz Langa2018-03-132-26/+37
| | | | | | | New tests also added. I also made the comments in line with the builtin Grammar/Grammar. PEP 306 was withdrawn, Kees Blom's railroad program has been lost to the sands of time for at least 16 years now (I found a python-dev post from people looking for it).
* compare with difflib not diff(1) (GH-5450)Benjamin Peterson2018-01-301-13/+9
|
* closes bpo-30117: fix lib2to3 ParserIdempotency test (GH-1242)Eric Appelt2018-01-302-10/+15
| | | | | | | | | | | Fix two (in my opinion) spurious failure conditions in the lib2to3.tests.test_parser.TestParserIdempotency test_parser test. Use the same encoding found in the initial file to write a temp file for a diff. This retains the BOM if the encoding was initially utf-8-sig. If the file cannot be parsed using the normal grammar, try again with no print statement which should succeed for valid files using future print_function For case (1), the driver was correctly handling a BOM in a utf-8 file, but then the test was not writing a comparison file using 'utf-8-sig' to diff against, so the BOM got removed. I don't think that is the fault of the parser, and lib2to3 will retain the BOM. For case (2), lib2to3 pre-detects the use of from __future__ import print_function or allows the user to force this interpretation with a -p flag, and then selects a different grammar with the print statement removed. That makes the test cases unfair to this test as the driver itself doesn't know which grammar to use. As a minimal fix, the test will try using a grammar with the print statement, and if that fails fall back on a grammar without it. A more thorough handling of the idempotency test would to be to parse all files using both grammars and ignore if one of the two failed but otherwise check both. I didn't think this was necessary but can change.
* remove unused import (#5040)Benjamin Peterson2017-12-291-1/+0
|
* make PatternCompiler use the packaged grammar if possible (more bpo-24960) ↵Benjamin Peterson2017-12-291-7/+7
| | | | (#5034)
* correct wording (#4983)Benjamin Peterson2017-12-231-1/+1
|
* bpo-24960: use pkgutil.get_data in lib2to3 to read pickled grammar files (#4977)Benjamin Peterson2017-12-224-2/+42
| | | | | | This is more complicated than it should be because we need to preserve the useful mtime-based regeneration feature that lib2to3.pgen2.driver.load_grammar has. We only look for the pickled grammar file with pkgutil.get_data and only if the source file does not exist.
* bpo-32046: Update 2to3 when converts operator.isCallable(obj). (#4417)Dong-hee Na2017-11-282-6/+5
|
* bpo-30143: 2to3 now generates a code that uses abstract collection classes ↵Serhiy Storchaka2017-11-162-10/+10
| | | | | | (#1262) from collections.abc rather than collections.
* bpo-30406: Make async and await proper keywords (#1669)Jelle Zijlstra2017-10-064-94/+24
| | | Per PEP 492, 'async' and 'await' should become proper keywords in 3.7.
* closes bpo-27494: Fix 2to3 handling of trailing comma after a generator ↵Jakub Stasiak2017-10-056-10/+36
| | | | expression (#3771)
* bpo-29783: Replace codecs.open() with io.open() (#599)Victor Stinner2017-06-162-30/+11
|
* bpo-23894: make lib2to3 recognize f-strings (#1733)Łukasz Langa2017-05-222-1/+7
| | | | | | | Note: this doesn't unpack f-strings into the underlying JoinedStr AST. Ideally we'd fully implement JoinedStr here but given its additional complexity, I think this is worth bandaiding as is. This unblocks tools like https://github.com/google/yapf to format 3.6 syntax using f-strings.
* Make rb'' strings work in lib2to3 (#1724)Łukasz Langa2017-05-222-7/+37
| | | This partially solves bpo-23894.
* bpo-30144: Import collections ABC from collections.abc rather than ↵Serhiy Storchaka2017-04-241-2/+2
| | | | collections. (#1263)
* bpo-29869: Allow underscores in numeric literals in lib2to3. (GH-1119)Nevada Sanchez2017-04-132-8/+30
| | | | | * Allow underscores in numeric literals in lib2to3. * Stricter literal parsing for Python 3.6 in lib2to3.pgen2.tokenize. * Add test case for underscores in literals in Python 3.
* bpo-28837: Fix lib2to3 handling of map/zip/filter calls when followed with a ↵Stuart Berg2017-04-064-26/+109
| | | | 'trailer', e.g. zip()[x] (#24)
* bpo-29762: More use "raise from None". (#569)Serhiy Storchaka2017-04-053-4/+4
| | | This hides unwanted implementation details from tracebacks.
* bpo-29957: change LBYL key lookup to dict.setdefault (#938)Michael Selik2017-04-021-5/+0
| | | | | | | | | | | | | * change LBYL key lookup to dict.setdefault The ``results`` was constructed as a defaultdict and we could simply delete the check ``if key not in results``. However, I think it's safer to use dict.setdefault as I'm not sure whether the caller expects a regular dict or defaultdict. * add name to the acknowledgements file * use defaultdict to make the key-lookup cleaner
* bpo-29919: Remove unused imports found by pyflakes (#137)Victor Stinner2017-03-271-1/+1
| | | Make also minor PEP8 coding style fixes on modified imports.
* bpo-29776: Use decorator syntax for properties. (#585)Serhiy Storchaka2017-03-191-8/+8
|
* Remove unused imports.Serhiy Storchaka2016-12-162-2/+0
|
* merge 3.5Benjamin Peterson2016-12-061-1/+0
|\
| * rm unused importBenjamin Peterson2016-12-061-1/+0
| |
* | Issue #28394: Merge typo fixes from 3.5 into 3.6Martin Panter2016-10-101-1/+1
|\ \ | |/
| * Issue #28394: Spelling and typo fixes in code comments and changelogMartin Panter2016-10-101-1/+1
| | | | | | | | Includes patch by Ville Skyttä.
* | Remove the debug print that i accidentally left in.Gregory P. Smith ext:(%20%5BGoogle%20Inc.%5D)2016-09-111-1/+0
|\ \ | |/
generated by cgit v0.12 at 2025-08-09 17:39:57 (GMT)