From c45cf029380f1b95a9d208d7c63843ce8317ad7d Mon Sep 17 00:00:00 2001 From: Guido van Rossum Date: Fri, 10 Apr 1998 20:06:21 +0000 Subject: Added changes from 1.5 to 1.5.1. The sections are now in a more useful order: the most recent changes are listed first. --- Misc/NEWS | 2476 +++++++++++++++++++++++++++++++++++-------------------------- 1 file changed, 1418 insertions(+), 1058 deletions(-) diff --git a/Misc/NEWS b/Misc/NEWS index f9d1a51..f35e356 100644 --- a/Misc/NEWS +++ b/Misc/NEWS @@ -1,9 +1,9 @@ What's new in this release? =========================== -Below is a list of all relevant changes since the release 1.4. The -most recent changes (from 1.5a3 to 1.5a4, from 1.5a4 to 1.5b1, and -from 1.5b1 to 1.5b2) are listed in separate sections at the end. +Below is a list of all relevant changes since release 1.4. The +sections are now in a more useful order: the most recent changes are +listed first. A note on attributions: while I have sprinkled some names throughout here, I'm grateful to many more people who remain unnamed. You may @@ -13,966 +13,808 @@ credit, let me know and I'll add you to the list! ====================================================================== -From 1.4 to 1.5a3 + +From 1.5 to 1.5.1 ================= -Security --------- +General +------- -- If you are using the setuid script C wrapper (Misc/setuid-prog.c), -please use the new version. The old version has a huge security leak. +- The documentation is now unbundled. It has also been extensively +modified (mostly to implement a new and more uniform formatting +style). We figure that most people will prefer to download one of the +preformatted documentation sets (HTML, PostScript or PDF) and that +only a minority have a need for the LaTeX or FrameMaker sources. Of +course, the unbundled documentation sources still released -- just not +in the same archive file, and perhaps not on the same date. -Miscellaneous +- All bugs noted on the errors page (and many unnoted) are fixed. All +new bugs take their places. + +Syntax change ------------- -- Because of various (small) incompatible changes in the Python -bytecode interpreter, the magic number for .pyc files has changed -again. +- The raise statement can now be used without arguments, to re-raise +a previously set exception. This should be used after catching an +exception with an except clause only, either in the except clause or +later in the same function. -- The default module search path is now much saner. Both on Unix and -Windows, it is essentially derived from the path to the executable -(which can be overridden by setting the environment variable -$PYTHONHOME). The value of $PYTHONPATH on Windows is now inserted in -front of the default path, like in Unix (instead of overriding the -default path). On Windows, the directory containing the executable is -added to the end of the path. +Import and module handling +-------------------------- -- A new version of python-mode.el for Emacs has been included. Also, -a new file ccpy-style.el has been added to configure Emacs cc-mode for -the preferred style in Python C sources. +- The implementation of import has changed to use a mutex (when +threading is supported). This means that when two threads +simultaneously import the same module, the import statements are +serialized. Recursive imports are not affected. -- On Unix, when using sys.argv[0] to insert the script directory in -front of sys.path, expand a symbolic link. You can now install a -program in a private directory and have a symbolic link to it in a -public bin directory, and it will put the private directory in the -module search path. Note that the symlink is expanded in sys.path[0] -but not in sys.argv[0], so you can still tell the name by which you -were invoked. +- Rewrote the finalization code almost completely, to be much more +careful with the order in which modules are destroyed. Destructors +pwill now generally be able to reference built-in names such as None +without trouble. -- It is now recommended to use ``#!/usr/bin/env python'' instead of -``#!/usr/local/bin/python'' at the start of executable scripts, except -for CGI scripts. It has been determined that the use of /usr/bin/env -is more portable than that of /usr/local/bin/python -- scripts almost -never have to be edited when the Python interpreter lives in a -non-standard place. Note that this doesn't work for CGI scripts since -the python executable often doesn't live in the HTTP server's default -search path. +- On case-insensitive platforms such as Mac and Windows, require the +case of a module's filename, e.g. "SocketServer.py", to match the case +of the module name as specified in the import statement. This is an +experimental feature -- if it turns out to break in too many +situations, it will be removed (or disabled by default) in the future. +On Windows, it can be disabled on a per-case basis by setting the +environment variable PYTHONCASEOK (to any value). -- The silly -s command line option and the corresponding -PYTHONSUPPRESS environment variable (and the Py_SuppressPrint global -flag in the Python/C API) are gone. +- The code for figuring out the default path now distinguishes between +files, modules, executable files, and directories. When expecting a +module, we also look for the .pyc or .pyo file. -- Most problems on 64-bit platforms should now be fixed. Andrew -Kuchling helped. Some uncommon extension modules are still not -clean (image and audio ops?). +Parser/tokenizer changes +------------------------ -- Fixed a bug where multiple anonymous tuple arguments would be mixed up -when using the debugger or profiler (reported by Just van Rossum). -The simplest example is ``def f((a,b),(c,d)): print a,b,c,d''; this -would print the wrong value when run under the debugger or profiler. +- The tokenizer can now warn you when your source code mixes tabs and +spaces for indentation in a manner that depends on the worth of a tab +in spaces. Use "python -t" or "python -v" to enable this option. Use +"python -tt" to turn the warnings into errors. -- The hacks that the dictionary implementation used to speed up -repeated lookups of the same C string were removed; these were a -source of subtle problems and don't seem to serve much of a purpose -any longer. +- Return unsigned characters from tok_nextc(), so '\377' isn't +mistaken for an EOF character. -- All traces of support for the long dead access statement have been -removed from the sources. +- Fixed two pernicious bugs in the tokenizer that only affected AIX. +One was actually a general bug that was triggered by AIX's smaller I/O +buffer size. The other was a bug in the AIX optimizer's loop +unrolling code; swapping two statements made the problem go away. -- Plugged the two-byte memory leak in the tokenizer when reading an -interactive EOF. +Tools, demos and miscellaneous files +------------------------------------ -- There's a -O option to the interpreter that removes SET_LINENO -instructions and assert statements (see below); it uses and produces -.pyo files instead of .pyc files. The speedup is only a few percent -in most cases. The line numbers are still available in the .pyo file, -as a separate table (which is also available in .pyc files). However, -the removal of the SET_LINENO instructions means that the debugger -(pdb) can't set breakpoints on lines in -O mode. The traceback module -contains a function to extract a line number from the code object -referenced in a traceback object. In the future it should be possible -to write external bytecode optimizers that create better optimized -.pyo files, and there should be more control over optimization; -consider the -O option a "teaser". Without -O, the assert statement -actually generates code that first checks __debug__; if this variable -is false, the assertion is not checked. __debug__ is a built-in -variable whose value is initialized to track the -O flag (it's true -iff -O is not specified). With -O, no code is generated for assert -statements, nor for code of the form ``if __debug__: ''. -Sorry, no further constant folding happens. +- There's a new version of Misc/python-mode.el (the Emacs mode for +Python) which is much smarter about guessing the indentation style +used in a particular file. Lots of other cool features too! +- There are two new tools in Tools/scripts: tabnanny.py and +tabpolice.py, implementing two different ways of checking whether a +file uses indentation in a way that is sensitive to the interpretation +of a tab. The preferred module is tabnanny.py (by Tim Peters). -Performance ------------ +- Some new demo programs: -- It's much faster (almost twice for pystone.py -- see -Tools/scripts). See the entry on string interning below. + Demo/tkinter/guido/paint.py -- Dave Mitchell + Demo/sockets/unixserver.py -- Piet van Oostrum + -- Some speedup by using separate free lists for method objects (both -the C and the Python variety) and for floating point numbers. +- Much better freeze support. The freeze script can now freeze +hierarchical module names (with a corresponding change to import.c), +and has a few extra options (e.g. to suppress freezing specific +modules). It also does much more on Windows NT. -- Big speedup by allocating frame objects with a single malloc() call. -The Python/C API for frames is changed (you shouldn't be using this -anyway). +- Version 1.0 of the faq wizard is included (only very small changes +since version 0.9.0). -- Significant speedup by inlining some common opcodes for common operand -types (e.g. i+i, i-i, and list[i]). Fredrik Lundh. +- New feature for the ftpmirror script: when removing local files +(i.e., only when -r is used), do a recursive delete. -- Small speedup by reordering the method tables of some common -objects (e.g. list.append is now first). +Configuring and building Python +------------------------------- -- Big optimization to the read() method of file objects. A read() -without arguments now attempts to use fstat to allocate a buffer of -the right size; for pipes and sockets, it will fall back to doubling -the buffer size. While that the improvement is real on all systems, -it is most dramatic on Windows. +- Get rid of the check for -linet -- recent Sequent Dynix systems don't +need this any more and apparently it screws up their configuration. +- Some changes because gcc on SGI doesn't support '-all'. -Documentation -------------- +- Changed the build rules to use $(LIBRARY) instead of + -L.. -lpython$(VERSION) +since the latter trips up the SunOS 4.1.x linker (sigh). -- Many new pieces of library documentation were contributed, mostly by -Andrew Kuchling. Even cmath is now documented! There's also a -chapter of the library manual, "libundoc.tex", which provides a -listing of all undocumented modules, plus their status (e.g. internal, -obsolete, or in need of documentation). Also contributions by Sue -Williams, Skip Montanaro, and some module authors who succumbed to -pressure to document their own contributed modules :-). Note that -printing the documentation now kills fewer trees -- the margins have -been reduced. +- Fix the bug where the '# dgux is broken' comment in the Makefile +tripped over Make on some platforms. -- I have started documenting the Python/C API. Unfortunately this project -hasn't been completed yet. It will be complete before the final release of -Python 1.5, though. At the moment, it's better to read the LaTeX source -than to attempt to run it through LaTeX and print the resulting dvi file. +- Changes for AIX: install the python.exp file; properly use +$(srcdir); the makexp_aix script now removes C++ entries of the form +Class::method. -- The posix module (and hence os.py) now has doc strings! Thanks to Neil -Schemenauer. I received a few other contributions of doc strings. In most -other places, doc strings are still wishful thinking... +- Deleted some Makefile targets only used by the (long obsolete) +gMakefile hacks. +Extension modules +----------------- -Language changes ----------------- +- Performance and threading improvements to the socket and bsddb +modules, by Christopher Lindblad of Infoseek. -- Private variables with leading double underscore are now a permanent -feature of the language. (These were experimental in release 1.4. I have -favorable experience using them; I can't label them "experimental" -forever.) +- Added operator.__not__ and operator.not_. -- There's new string literal syntax for "raw strings". Prefixing a string -literal with the letter r (or R) disables all escape processing in the -string; for example, r'\n' is a two-character string consisting of a -backslash followed by the letter n. This combines with all forms of string -quotes; it is actually useful for triple quoted doc strings which might -contain references to \n or \t. An embedded quote prefixed with a -backslash does not terminate the string, but the backslash is still -included in the string; for example, r'\'' is a two-character string -consisting of a backslash and a quote. (Raw strings are also -affectionately known as Robin strings, after their inventor, Robin -Friedrich.) +- In the thread module, when a thread exits due to an unhandled +exception, don't store the exception information in sys.last_*; it +prevents proper calling of destructors of local variables. -- There's a simple assert statement, and a new exception -AssertionError. For example, ``assert foo > 0'' is equivalent to ``if -not foo > 0: raise AssertionError''. Sorry, the text of the asserted -condition is not available; it would be too complicated to generate -code for this (since the code is generated from a parse tree). -However, the text is displayed as part of the traceback! +- Fixed a number of small bugs in the cPickle module. -- The raise statement has a new feature: when using "raise SomeClass, -somevalue" where somevalue is not an instance of SomeClass, it -instantiates SomeClass(somevalue). In 1.5a4, if somevalue is an -instance of a *derived* class of SomeClass, the exception class raised -is set to somevalue.__class__, and SomeClass is ignored after that. +- Changed find() and rfind() in the strop module so that +find("x","",2) returns -1, matching the implementation in string.py. -- Duplicate keyword arguments are now detected at compile time; -f(a=1,a=2) is now a syntax error. +- In the time module, be more careful with the result of ctime(), and +test for HAVE_MKTIME before usinmg mktime(). +- Doc strings contributed by Mitch Chapman to the termios, pwd, gdbm +modules. -Changes to builtin features ---------------------------- +- Added the LOG_SYSLOG constant to the syslog module, if defined. -- There's a new exception FloatingPointError (used only by Lee Busby's -patches to catch floating point exceptions, at the moment). +Standard library modules +------------------------ -- The obsolete exception ConflictError (presumably used by the long -obsolete access statement) has been deleted. +- All standard library modules have been converted to an indentation +style using either only tabs or only spaces -- never a mixture -- if +they weren't already consistent according to tabnanny. -- There's a new function sys.exc_info() which returns the tuple -(sys.exc_type, sys.exc_value, sys.exc_traceback) in a thread-safe way. +- New standard library modules: -- There's a new variable sys.executable, pointing to the executable file -for the Python interpreter. + threading -- GvR and the thread-sig + Java style thread objects -- USE THIS!!! -- The sort() methods for lists no longer uses the C library qsort(); I -wrote my own quicksort implementation, with lots of help (in the form -of a kind of competition) from Tim Peters. This solves a bug in -dictionary comparisons on some Solaris versions when Python is built -with threads, and makes sorting lists even faster. + getpass -- Piers Lauder + simple utilities to prompt for a password and to + retrieve the current username -- The semantics of comparing two dictionaries have changed, to make -comparison of unequal dictionaries faster. A shorter dictionary is -always considered smaller than a larger dictionary. For dictionaries -of the same size, the smallest differing element determines the -outcome (which yields the same results as before in this case, without -explicit sorting). Thanks to Aaron Watters for suggesting something -like this. + imaplib -- Piers Lauder + interface for the IMAP4 protocol -- The semantics of try-except have changed subtly so that calling a -function in an exception handler that itself raises and catches an -exception no longer overwrites the sys.exc_* variables. This also -alleviates the problem that objects referenced in a stack frame that -caught an exception are kept alive until another exception is caught --- the sys.exc_* variables are restored to their previous value when -returning from a function that caught an exception. + poplib -- David Ascher, Piers Lauder + interface for the POP3 protocol -- There's a new "buffer" interface. Certain objects (e.g. strings and -arrays) now support the "buffer" protocol. Buffer objects are acceptable -whenever formerly a string was required for a write operation; mutable -buffer objects can be the target of a read operation using the call -f.readinto(buffer). A cool feature is that regular expression matching now -also work on array objects. Contribution by Jack Jansen. (Needs -documentation.) + smtplib -- Dragon De Monsyne + interface for the SMTP protocol -- String interning: dictionary lookups are faster when the lookup -string object is the same object as the key in the dictionary, not -just a string with the same value. This is done by having a pool of -"interned" strings. Most names generated by the interpreter are now -automatically interned, and there's a new built-in function intern(s) -that returns the interned version of a string. Interned strings are -not a different object type, and interning is totally optional, but by -interning most keys a speedup of about 15% was obtained for the -pystone benchmark. +- Some obsolete modules moved to a separate directory (Lib/lib-old) +which is *not* in the default module search path: -- Dictionary objects have several new methods; clear() and copy() have -the obvious semantics, while update(d) merges the contents of another -dictionary d into this one, overriding existing keys. The dictionary -implementation file is now called dictobject.c rather than the -confusing mappingobject.c. + Para + addpack + codehack + fmt + lockfile + newdir + ni + rand + tb -- The intrinsic function dir() is much smarter; it looks in __dict__, -__members__ and __methods__. +- New version of the PCRE code (Perl Compatible Regular Expressions -- +the re module and the supporting pcre extension) by Andrew Kuchling. +Incompatible new feature in re.sub(): the handling of escapes in the +replacement string has changed. -- The intrinsic functions int(), long() and float() can now take a -string argument and then do the same thing as string.atoi(), -string.atol(), and string.atof(). No second 'base' argument is -allowed, and complex() does not take a string (nobody cared enough). +- Interface change in copy.py: a __deepcopy__ method is now called +with the memo dictionary as an argument. -- When a module is deleted, its globals are now deleted in two phases. -In the first phase, all variables whose name begins with exactly one -underscore are replaced by None; in the second phase, all variables -are deleted. This makes it possible to have global objects whose -destructors depend on other globals. The deletion order within each -phase is still random. +- Feature change in the tokenize module: differentiate between NEWLINE +token (an official newline) and NL token (a newline that the grammar +ignores). -- It is no longer an error for a function to be called without a -global variable __builtins__ -- an empty directory will be provided -by default. +- Several bugfixes to the urllib module. It is now truly thread-safe, +and several bugs and a portability problem have been fixed. New +features, all due to Sjoerd Mullender: When creating a temporary file, +it gives it an appropriate suffix. Support the "data:" URL scheme. +The open() method uses the tempcache. -- Guido's corollary to the "Don Beaudry hook": it is now possible to -do metaprogramming by using an instance as a base class. Not for the -faint of heart; and undocumented as yet, but basically if a base class -is an instance, its class will be instantiated to create the new -class. Jim Fulton will love it -- it also works with instances of his -"extension classes", since it is triggered by the presence of a -__class__ attribute on the purported base class. See -Demo/metaclasses/index.html for an explanation and see that directory -for examples. +- New version of the xmllib module (this time with a test suite!) by +Sjoerd Mullender. -- Another change is that the Don Beaudry hook is now invoked when -*any* base class is special. (Up to 1.5a3, the *last* special base -class is used; in 1.5a4, the more rational choice of the *first* -special base class is used.) +- Added debugging code to the telnetlib module, to be able to trace +the actual traffic. -- New optional parameter to the readlines() method of file objects. -This indicates the number of bytes to read (the actual number of bytes -read will be somewhat larger due to buffering reading until the end of -the line). Some optimizations have also been made to speed it up (but -not as much as read()). +- In the rfc822 module, added support for deleting a header (still no +support for adding headers, though). Also fixed a bug where an +illegal address would cause a crash in getrouteaddr(), fixed a +sign reversal in mktime_tz(), and use the local timezone by default +(the latter two due to Bill van Melle). -- Complex numbers no longer have the ".conj" pseudo attribute; use -z.conjugate() instead, or complex(z.real, -z.imag). Complex numbers -now *do* support the __members__ and __methods__ special attributes. +- The normpath() function in the dospath and ntpath modules no longer +does case normalization -- for that, use the separate function +normcase() (which always existed); normcase() has been sped up and +fixed (it was the cause of a crash in Mark Hammond's installer in +certain locales). -- The complex() function now looks for a __complex__() method on class -instances before giving up. +- New command supported by the ftplib module: rmd(); also fixed some +minor bugs. -- Long integers now support arbitrary shift counts, so you can now -write 1L<<1000000, memory permitting. (Python 1.4 reports "outrageous -shift count for this.) +- The profile module now uses a different timer function by default -- +time.clock() is generally better than os.times(). This makes it work +better on Windows NT, too. -- The hex() and oct() functions have been changed so that for regular -integers, they never emit a minus sign. For example, on a 32-bit -machine, oct(-1) now returns '037777777777' and hex(-1) returns -'0xffffffff'. While this may seem inconsistent, it is much more -useful. (For long integers, a minus sign is used as before, to fit -the result in memory :-) +- The tempfile module now recovers when os.getcwd() raises an +exception. -- The hash() function computes better hashes for several data types, -including strings, floating point numbers, and complex numbers. +- Fixed some bugs in the random module; gauss() was subtly wrong, and +vonmisesvariate() should return a full circle. Courtesy Mike Miller, +Lambert Meertens (gauss()), and Magnus Kessler (vonmisesvariate()). +- Better default seed in the whrandom module, courtesy Andrew Kuchling. -New extension modules ---------------------- +- Fix slow close() in shelve module. -- New extension modules cStringIO.c and cPickle.c, written by Jim -Fulton and other folks at Digital Creations. These are much more -efficient than their Python counterparts StringIO.py and pickle.py, -but don't support subclassing. cPickle.c clocks up to 1000 times -faster than pickle.py; cStringIO.c's improvement is less dramatic but -still significant. +- The Unix mailbox class in the mailbox module is now more robust when +a line begins with the string "From " but is definitely not the start +of a new message. The pattern used can be changed by overriding a +method or class variable. -- New extension module zlibmodule.c, interfacing to the free zlib -library (gzip compatible compression). There's also a module gzip.py -which provides a higher level interface. Written by Andrew Kuchling -and Jeremy Hylton. +- Added a rmtree() function to the copy module. -- New module readline; see the "miscellaneous" section above. +- Fixed several typos in the pickle module. Also fixed problems when +unpickling in restricted execution environments. -- New Unix extension module resource.c, by Jeremy Hylton, provides -access to getrlimit(), getrusage(), setrusage(), getpagesize(), and -related symbolic constants. +- Added docstrings and fixed a typo in the py_compile and compileall +modules. At Mark Hammond's repeated request, py_compile now append a +newline to the source if it needs one. Both modules support an extra +parameter to specify the purported source filename (to be used in +error messages). -- New extension puremodule.c, by Barry Warsaw, which interfaces to the -Purify(TM) C API. See also the file Misc/PURIFY.README. It is also -possible to enable Purify by simply setting the PURIFY Makefile -variable in the Modules/Setup file. +- Some performance tweaks by Jeremy Hylton to the gzip module. +- Fixed a bug in the merge order of dictionaries in the ConfigParser +module. Courtesy Barry Warsaw. -Changes in extension modules ----------------------------- +- In the multifile module, support the optional second parameter to +seek() when possible. -- The struct extension module has several new features to control byte -order and word size. It supports reading and writing IEEE floats even -on platforms where this is not the native format. It uses uppercase -format codes for unsigned integers of various sizes (always using -Python long ints for 'I' and 'L'), 's' with a size prefix for strings, -and 'p' for "Pascal strings" (with a leading length byte, included in -the size; blame Hannu Krosing; new in 1.5a4). A prefix '>' forces -big-endian data and '<' forces little-endian data; these also select -standard data sizes and disable automatic alignment (use pad bytes as -needed). +- Several fixes to the gopherlib module by Lars Marius Garshol. Also, +urlparse now correctly handles Gopher URLs with query strings. -- The array module supports uppercase format codes for unsigned data -formats (like the struct module). +- Fixed a tiny bug in format_exception() in the traceback module. +Also rewrite tb_lineno() to be compatible with JPython (and not +disturb the current exception!); by Jim Hugunin. -- The fcntl extension module now exports the needed symbolic -constants. (Formerly these were in FCNTL.py which was not available -or correct for all platforms.) +- The httplib module is more robust when servers send a short response +-- courtesy Tim O'Malley. -- The extension modules dbm, gdbm and bsddb now check that the -database is still open before making any new calls. +Tkinter and friends +------------------- -- The dbhash module is no more. Use bsddb instead. (There's a third -party interface for the BSD 2.x code somewhere on the web; support for -bsddb will be deprecated.) +- Various typos and bugs fixed. -- The gdbm module now supports a sync() method. +- New module Tkdnd implements a drag-and-drop protocol (within one +application only). -- The socket module now has some new functions: getprotobyname(), and -the set {ntoh,hton}{s,l}(). +- The event_*() widget methods have been restructured slightly -- they +no longer use the default root. -- Various modules now export their type object: socket.SocketType, -array.ArrayType. +- The interfaces for the bind*() and unbind() widget methods have been +redesigned; the bind*() methods now return the name of the Tcl command +created for the callback, and this can be passed as a optional +argument to unbind() in order to delete the command (normally, such +commands are automatically unbound when the widget is destroyed, but +for some applications this isn't enough). -- The socket module's accept() method now returns unknown addresses as -a tuple rather than raising an exception. (This can happen in -promiscuous mode.) Theres' also a new function getprotobyname(). +- Variable objects now have trace methods to interface to Tcl's +variable tracing facilities. -- The pthread support for the thread module now works on most platforms. +- Image objects now have an optional keyword argument, 'master', to +specify a widget (tree) to which they belong. The image_names() and +image_types() calls are now also widget methods. -- STDWIN is now officially obsolete. Support for it will eventually -be removed from the distribution. +- There's a new global call, Tkinter.NoDefaultRoot(), which disables +all use of the default root by the Tkinter library. This is useful to +debug applications that are in the process of being converted from +relying on the default root to explicit specification of the root +widget. -- The binascii extension module is now hopefully fully debugged. -(XXX Oops -- Fredrik Lundh promised me a uuencode fix that I never -received.) +- The 'exit' command is deleted from the Tcl interpreter, since it +provided a loophole by which one could (accidentally) exit the Python +interpreter without invoking any cleanup code. -- audioop.c: added a ratecv() function; better handling of overflow in -add(). +- Tcl_Finalize() is now registered as a Python low-level exit handle, +so Tcl will be finalized when Python exits. -- posixmodule.c: now exports the O_* flags (O_APPEND etc.). On -Windows, also O_TEXT and O_BINARY. The 'error' variable (the -exception is raises) is renamed -- its string value is now "os.error", -so newbies don't believe they have to import posix (or nt) to catch -it when they see os.error reported as posix.error. The execve() -function now accepts any mapping object for the environment. +The Python/C API +---------------- -- A new version of the al (audio library) module for SGI was -contributed by Sjoerd Mullender. +- New function PyObject_Not(x) calculates (not x) according to Python's +standard rules (basically, it negates the outcome PyObject_IsTrue(x). -- The regex module has a new function get_syntax() which retrieves the -syntax setting set by set_syntax(). The code was also sanitized, -removing worries about unclean error handling. See also below for its -successor, re.py. +- New function _PyModule_Clear(), which clears a module's dictionary +carefully without removing the __builtins__ entry. This is implied +when a module object is deallocated (this used to clear the dictionary +completely). -- The "new" module (which creates new objects of various types) once -again has a fully functioning new.function() method. Dangerous as -ever! Also, new.code() has several new arguments. +- New function PyImport_ExecCodeModuleEx(), which extends +PyImport_ExecCodeModule() by adding an extra parameter to pass it the +true file. -- A problem has been fixed in the rotor module: on systems with signed -characters, rotor-encoded data was not portable when the key contained -8-bit characters. Also, setkey() now requires its argument rather -than having broken code to default it. +- New functions Py_GetPythonHome() and Py_SetPythonHome(), intended to +allow embedded applications to force a different value for PYTHONHOME. -- The sys.builtin_module_names variable is now a tuple. Another new -variables in sys is sys.executable (the full path to the Python -binary, if known). +- New global flag Py_FrozenFlag is set when this is a "frozen" Python +binary; it suppresses warnings about not being able to find the +standard library directories. -- The specs for time.strftime() have undergone some revisions. It -appears that not all format characters are supported in the same way -on all platforms. Rather than reimplement it, we note these -differences in the documentation, and emphasize the shared set of -features. There's also a thorough test set (that occasionally finds -problems in the C library implementation, e.g. on some Linuxes), -thanks to Skip Montanaro. +- New global flag Py_TabcheckFlag is incremented by the -t option and +causes the tokenizer to issue warnings or errors about inconsistent +mixing of tabs and spaces for indentation. -- The nis module seems broken when used with NIS+; unfortunately -nobody knows how to fix it. It should still work with old NIS. +Miscellaneous minor changes and bug fixes +----------------------------------------- +- Improved the error message when an attribute of an attribute-less +object is requested -- include the name of the attribute and the type +of the object in the message. -New library modules -------------------- +- Sped up int(), long(), float() a bit. -- New (still experimental) Perl-style regular expression module, -re.py, which uses a new interface for matching as well as a new -syntax; the new interface avoids the thread-unsafety of the regex -interface. This comes with a helper extension reopmodule.c and vastly -rewritten regexpr.c. Most work on this was done by Jeffrey Ollie, Tim -Peters, and Andrew Kuchling. See the documentation libre.tex. In -1.5, the old regex module is still fully supported; in the future, it -will become obsolete. +- Fixed a bug in list.sort() that would occasionally dump core. -- New module gzip.py; see zlib above. +- Fixed a bug in PyNumber_Power() that caused numeric arrays to fail +when taken tothe real power. -- New module keyword.py exports knowledge about Python's built-in -keywords. (New version by Ka-Ping Yee.) +- Fixed a number of bugs in the file reading code, at least one of +which could cause a core dump on NT, and one of which would +occasionally cause file.read() to return less than the full contents +of the file. -- New module pprint.py (with documentation) which supports -pretty-printing of lists, tuples, & dictionaries recursively. By Fred -Drake. +- Performance hack by Vladimir Marangozov for stack frame creation. -- New module code.py. The function code.compile_command() can -determine whether an interactively entered command is complete or not, -distinguishing incomplete from invalid input. (XXX Unfortunately, -this seems broken at this moment, and I don't have the time to fix -it. It's probably better to add an explicit interface to the parser -for this.) +- Make sure setvbuf() isn't used unless HAVE_SETVBUF is defined. -- There is now a library module xdrlib.py which can read and write the -XDR data format as used by Sun RPC, for example. It uses the struct -module. +====================================================================== -Changes in library modules --------------------------- -- Module codehack.py is now completely obsolete. +From 1.5b2 to 1.5 +================= -- The pickle.py module has been updated to make it compatible with the -new binary format that cPickle.c produces. By default it produces the -old all-ASCII format compatible with the old pickle.py, still much -faster than pickle.py; it will read both formats automatically. A few -other updates have been made. +- Newly documentated module: BaseHTTPServer.py, thanks to Greg Stein. -- A new helper module, copy_reg.py, is provided to register extensions -to the pickling code. +- Added doc strings to string.py, stropmodule.c, structmodule.c, +thanks to Charles Waldman. -- Revamped module tokenize.py is much more accurate and has an -interface that makes it a breeze to write code to colorize Python -source code. Contributed by Ka-Ping Yee. +- Many nits fixed in the manuals, thanks to Fred Drake and many others +(especially Rob Hooft and Andrew Kuchling). The HTML version now uses +HTML markup instead of inline GIF images for tables; only two images +are left (for obsure bits of math). The index of the HTML version has +also been much improved. Finally, it is once again possible to +generate an Emacs info file from the library manual (but I don't +commit to supporting this in future versions). -- In ihooks.py, ModuleLoader.load_module() now closes the file under -all circumstances. +- New module: telnetlib.py (a simple telnet client library). -- The tempfile.py module has a new class, TemporaryFile, which creates -an open temporary file that will be deleted automatically when -closed. This works on Windows and MacOS as well as on Unix. (Jim -Fulton.) +- New tool: Tools/versioncheck/, by Jack Jansen. -- Changes to the cgi.py module: Most imports are now done at the -top of the module, which provides a speedup when using ni (Jim -Fulton). The problem with file upload to a Windows platform is solved -by using the new tempfile.TemporaryFile class; temporary files are now -always opened in binary mode (Jim Fulton). The cgi.escape() function -now takes an optional flag argument that quotes '"' to '"'. It -is now possible to invoke cgi.py from a command line script, to test -cgi scripts more easily outside an http server. There's an optional -limit to the size of uploads to POST (Skip Montanaro). Added a -'strict_parsing' option to all parsing functions (Jim Fulton). The -function parse_qs() now uses urllib.unquote() on the name as well as -the value of fields (Clarence Gardner). The FieldStorage class now -has a __len__() method. +- Ported zlibmodule.c and bsddbmodule.c to NT; The project file for MS +DevStudio 5.0 now includes new subprojects to build the zlib and bsddb +extension modules. -- httplib.py: the socket object is no longer closed; all HTTP/1.* -responses are now accepted; and it is now thread-safe (by not using -the regex module). +- Many small changes again to Tkinter.py -- mostly bugfixes and adding +missing routines. Thanks to Greg McFarlane for reporting a bunch of +problems and proofreading my fixes. -- BaseHTTPModule.py: treat all HTTP/1.* versions the same. +- The re module and its documentation are up to date with the latest +version released to the string-sig (Dec. 22). -- The popen2.py module is now rewritten using a class, which makes -access to the standard error stream and the process id of the -subprocess possible. +- Stop test_grp.py from failing when the /etc/group file is empty +(yes, this happens!). -- Added timezone support to the rfc822.py module, in the form of a -getdate_tz() method and a parsedate_tz() function; also a mktime_tz(). -Also added recognition of some non-standard date formats, by Lars -Wirzenius, and RFC 850 dates (Chris Lawrence). +- Fix bug in integer conversion (mystrtoul.c) that caused +4294967296==0 to be true! -- mhlib.py: various enhancements, including almost compatible parsing -of message sequence specifiers without invoking a subprocess. Also -added a createmessage() method by Lars Wirzenius. +- The VC++ 4.2 project file should be complete again. -- The StringIO.StringIO class now supports readline(nbytes). (Lars -Wirzenius.) (Of course, you should be using cStringIO for performance.) +- In tempfile.py, use a better template on NT, and add a new optional +argument "suffix" with default "" to specify a specific extension for +the temporary filename (needed sometimes on NT but perhaps also handy +elsewhere). -- UserDict.py supports the new dictionary methods as well. +- Fixed some bugs in the FAQ wizard, and converted it to use re +instead of regex. -- Improvements for whrandom.py by Tim Peters: use 32-bit arithmetic to -speed it up, and replace 0 seed values by 1 to avoid degeneration. -A bug was fixed in the test for invalid arguments. +- Fixed a mysteriously undetected error in dlmodule.c (it was using a +totally bogus routine name to raise an exception). -- Module ftplib.py: added support for parsing a .netrc file (Fred -Drake). Also added an ntransfercmd() method to the FTP class, which -allows access to the expected size of a transfer when available, and a -parse150() function to the module which parses the corresponding 150 -response. +- Fixed bug in import.c which wasn't using the new "dos-8x3" name yet. -- urllib.py: the ftp cache is now limited to 10 entries. Added -quote_plus() and unquote_plus() functions which are like quote() and -unquote() but also replace spaces with '+' or vice versa, for -encoding/decoding CGI form arguments. Catch all errors from the ftp -module. HTTP requests now add the Host: header line. The proxy -variable names are now mapped to lower case, for Windows. The -spliturl() function no longer erroneously throws away all data past -the first newline. The basejoin() function now intereprets "../" -correctly. I *believe* that the problems with "exception raised in -__del__" under certain circumstances have been fixed (mostly by -changes elsewher in the interpreter). +- Hopefully harmless changes to the build process to support shared +libraries on DG/UX. This adds a target to create +libpython$(VERSION).so; however this target is *only* for DG/UX. -- In urlparse.py, there is a cache for results in urlparse.urlparse(); -its size limit is set to 20. Also, new URL schemes shttp, https, and -snews are "supported". +- Fixed a bug in the new format string error checking in getargs.c. -- shelve.py: use cPickle and cStringIO when available. Also added -a sync() method, which calls the database's sync() method if there is -one. +- A simple fix for infinite recursion when printing __builtins__: +reset '_' to None before printing and set it to the printed variable +*after* printing (and only when printing is successful). -- The mimetools.py module now uses the available Python modules for -decoding quoted-printable, uuencode and base64 formats, rather than -creating a subprocess. +- Fixed lib-tk/SimpleDialog.py to keep the dialog visible even if the +parent window is not (Skip Montanaro). -- The python debugger (pdb.py, and its base class bdb.py) now support -conditional breakpoints. See the docs. +- Fixed the two most annoying problems with ftp URLs in +urllib.urlopen(); an empty file now correctly raises an error, and it +is no longer required to explicitly close the returned "file" object +before opening another ftp URL to the same host and directory. -- The modules base64.py, uu.py and quopri.py can now be used as simple -command line utilities. -- Various small fixes to the nntplib.py module that I can't bother to -document in detail. +====================================================================== -- Sjoerd Mullender's mimify.py module now supports base64 encoding and -includes functions to handle the funny encoding you sometimes see in mail -headers. It is now documented. -- mailbox.py: Added BabylMailbox. Improved the way the mailbox is -gotten from the environment. +From 1.5b1 to 1.5b2 +=================== -- Many more modules now correctly open files in binary mode when this -is necessary on non-Unix platforms. +- Fixed a bug in cPickle.c that caused it to crash right away because +the version string had a different format. -- The copying functions in the undocumented module shutil.py are -smarter. +- Changes in pickle.py and cPickle.c: when unpickling an instance of a +class that doesn't define the __getinitargs__() method, the __init__() +constructor is no longer called. This makes a much larger group of +classes picklable by default, but may occasionally change semantics. +To force calling __init__() on unpickling, define a __getinitargs__() +method. Other changes too, in particular cPickle now handles classes +defined in packages correctly. The same change applies to copying +instances with copy.py. The cPickle.c changes and some pickle.py +changes are courtesy Jim Fulton. -- The Writer classes in the formatter.py module now have a flush() -method. - -- The sgmllib.py module accepts hyphens and periods in the middle of -attribute names. While this is against the SGML standard, there is -some HTML out there that uses this... +- Locale support in he "re" (Perl regular expressions) module. Use +the flag re.L (or re.LOCALE) to enable locale-specific matching +rules for \w and \b. The in-line syntax for this flag is (?L). -- The interface for the Python bytecode disassembler module, dis.py, -has been enhanced quite a bit. There's now one main function, -dis.dis(), which takes almost any kind of object (function, module, -class, instance, method, code object) and disassembles it; without -arguments it disassembles the last frame of the last traceback. The -other functions have changed slightly, too. +- The built-in function isinstance(x, y) now also succeeds when y is +a type object and type(x) is y. -- The imghdr.py module recognizes new image types: BMP, PNG. +- repr() and str() of class and instance objects now reflect the +package/module in which the class is defined. -- The string.py module has a new function replace(str, old, new, -[maxsplit]) which does substring replacements. It is actually -implemented in C in the strop module. The functions [r]find() an -[r]index() have an optional 4th argument indicating the end of the -substring to search, alsoo implemented by their strop counterparts. -(Remember, never import strop -- import string uses strop when -available with zero overhead.) +- Module "ni" has been removed. (If you really need it, it's been +renamed to "ni1". Let me know if this causes any problems for you. +Package authors are encouraged to write __init__.py files that +support both ni and 1.5 package support, so the same version can be +used with Python 1.4 as well as 1.5.) -- The string.join() function now accepts any sequence argument, not -just lists and tuples. +- The thread module is now automatically included when threads are +configured. (You must remove it from your existing Setup file, +since it is now in its own Setup.thread file.) -- The string.maketrans() requires its first two arguments to be -present. The old version didn't require them, but there's not much -point without them, and the documentation suggests that they are -required, so we fixed the code to match the documentation. +- New command line option "-x" to skip the first line of the script; +handy to make executable scripts on non-Unix platforms. -- The regsub.py module has a function clear_cache(), which clears its -internal cache of compiled regular expressions. Also, the cache now -takes the current syntax setting into account. (However, this module -is now obsolete -- use the sub() or subn() functions or methods in the -re module.) +- In importdl.c, add the RTLD_GLOBAL to the dlopen() flags. I +haven't checked how this affects things, but it should make symbols +in one shared library available to the next one. -- The undocumented module Complex.py has been removed, now that Python -has built-in complex numbers. A similar module remains as -Demo/classes/Complex.py, as an example. +- The Windows installer now installs in the "Program Files" folder on +the proper volume by default. +- The Windows configuration adds a new main program, "pythonw", and +registers a new extension, ".pyw" that invokes this. This is a +pstandard Python interpreter that does not pop up a console window; +handy for pure Tkinter applications. All output to the original +stdout and stderr is lost; reading from the original stdin yields +EOF. Also, both python.exe and pythonw.exe now have a pretty icon +(a green snake in a box, courtesy Mark Hammond). -Changes to the build process ----------------------------- +- Lots of improvements to emacs-mode.el again. See Barry's web page: +http://www.python.org/ftp/emacs/pmdetails.html. -- The way GNU readline is configured is totally different. The ---with-readline configure option is gone. It is now an extension -module, which may be loaded dynamically. You must enable it (and -specify the correct linraries to link with) in the Modules/Setup file. -Importing the module installs some hooks which enable command line -editing. When the interpreter shell is invoked interactively, it -attempts to import the readline module; when this fails, the default -input mechanism is used. The hook variables are PyOS_InputHook and -PyOS_ReadlineFunctionPointer. (Code contributed by Lee Busby, with -ideas from William Magro.) +- Lots of improvements and additions to the library reference manual; +many by Fred Drake. -- New build procedure: a single library, libpython1.5.a, is now built, -which contains absolutely everything except for a one-line main() -program (which calls Py_Main(argc, argv) to start the interpreter -shell). This makes life much simpler for applications that need to -embed Python. The serial number of the build is now included in the -version string (sys.version). +- Doc strings for the following modules: rfc822.py, posixpath.py, +ntpath.py, httplib.py. Thanks to Mitch Chapman and Charles Waldman. -- As far as I can tell, neither gcc -Wall nor the Microsoft compiler -emits a single warning any more when compiling Python. +- Some more regression testing. -- A number of new Makefile variables have been added for special -situations, e.g. LDLAST is appended to the link command. These are -used by editing the Makefile or passing them on the make command -line. +- An optional 4th (maxsplit) argument to strop.replace(). -- A set of patches from Lee Busby has been integrated that make it -possible to catch floating point exceptions. Use the configure option ---with-fpectl to enable the patches; the extension modules fpectl and -fpetest provide control to enable/disable and test the feature, -respectively. +- Fixed handling of maxsplit in string.splitfields(). -- The support for shared libraries under AIX is now simpler and more -robust. Thanks to Vladimir Marangozov for revamping his own patches! +- Tweaked os.environ so it can be pickled and copied. -- The Modules/makesetup script now reads a file Setup.local as well as -a file Setup. Most changes to the Setup script can be done by editing -Setup.local instead, which makes it easier to carry a particular setup -over from one release to the next. +- The portability problems caused by indented preprocessor commands +and C++ style comments should be gone now. -- The Modules/makesetup script now copies any "include" lines it -encounters verbatim into the output Makefile. It also recognizes .cxx -and .cpp as C++ source files. +- In random.py, added Pareto and Weibull distributions. -- The configure script is smarter about C compiler options; e.g. with -gcc it uses -O2 and -g when possible, and on some other platforms it -uses -Olimit 1500 to avoid a warning from the optimizer about the main -loop in ceval.c (which has more than 1000 basic blocks). +- The crypt module is now disabled in Modules/Setup.in by default; it +is rarely needed and causes errors on some systems where users often +don't know how to deal with those. -- The configure script now detects whether malloc(0) returns a NULL -pointer or a valid block (of length zero). This avoids the nonsense -of always adding one byte to all malloc() arguments on most platforms. +- Some improvements to the _tkinter build line suggested by Case Roole. -- The configure script has a new option, --with-dec-threads, to enable -DEC threads on DEC Alpha platforms. Also, --with-threads is now an -alias for --with-thread (this was the Most Common Typo in configure -arguments). +- A full suite of platform specific files for NetBSD 1.x, submitted by +Anders Andersen. -- Many changes in Doc/Makefile; amongst others, latex2html is now used -to generate HTML from all latex documents. +- New Solaris specific header STROPTS.py. +- Moved a confusing occurrence of *shared* from the comments in +Modules/Setup.in (people would enable this one instead of the real +one, and get disappointing results). -Change to the Python/C API --------------------------- +- Changed the default mode for directories to be group-writable when +the installation process creates them. -- Because some interfaces have changed, the PYTHON_API macro has been -bumped. Most extensions built for the old API version will still run, -but I can't guarantee this. Python prints a warning message on -version mismatches; it dumps core when the version mismatch causes a -serious problem :-) +- Check for pthread support in "-l_r" for FreeBSD/NetBSD, and support +shared libraries for both. -- I've completed the Grand Renaming, with the help of Roger Masse and -Barry Warsaw. This makes reading or debugging the code much easier. -Many other unrelated code reorganizations have also been carried out. -The allobjects.h header file is gone; instead, you would have to -include Python.h followed by rename2.h. But you're better off running -Tools/scripts/fixcid.py -s Misc/RENAME on your source, so you can omit -the rename2.h; it will disappear in the next release. +- Support FreeBSD and NetBSD in posixfile.py. -- Various and sundry small bugs in the "abstract" interfaces have been -fixed. Thanks to all the (involuntary) testers of the Python 1.4 -version! Some new functions have been added, e.g. PySequence_List(o), -equivalent to list(o) in Python. +- Support for the "event" command, new in Tk 4.2. By Case Roole. -- New API functions PyLong_FromUnsignedLong() and -PyLong_AsUnsignedLong(). +- Add Tix_SafeInit() support to tkappinit.c. -- The API functions in the file cgensupport.c are no longer -supported. This file has been moved to Modules and is only ever -compiled when the SGI specific 'gl' module is built. +- Various bugs fixed in "re.py" and "pcre.c". -- PyObject_Compare() can now raise an exception. Check with -PyErr_Occurred(). The comparison function in an object type may also -raise an exception. +- Fixed a bug (broken use of the syntax table) in the old "regexpr.c". -- The slice interface uses an upper bound of INT_MAX when no explicit -upper bound is given (e.x. for a[1:]). It used to ask the object for -its length and do the calculations. +- In frozenmain.c, stdin is made unbuffered too when PYTHONUNBUFFERED +is set. -- Support for multiple independent interpreters. See Doc/api.tex, -functions Py_NewInterpreter() and Py_EndInterpreter(). Since the -documentation is incomplete, also see the new Demo/pysvr example -(which shows how to use these in a threaded application) and the -source code. +- Provide default blocksize for retrbinary in ftplib.py (Skip +Montanaro). -- There is now a Py_Finalize() function which "de-initializes" -Python. It is possible to completely restart the interpreter -repeatedly by calling Py_Finalize() followed by Py_Initialize(). A -change of functionality in Py_Initialize() means that it is now a -fatal error to call it while the interpreter is already initialized. -The old, half-hearted Py_Cleanup() routine is gone. Use of Py_Exit() -is deprecated (it is nothing more than Py_Finalize() followed by -exit()). +- In NT, pick the username up from different places in user.py (Jeff +Bauer). -- There are no known memory leaks left. While Py_Finalize() doesn't -free *all* allocated memory (some of it is hard to track down), -repeated calls to Py_Finalize() and Py_Initialize() do not create -unaccessible heap blocks. +- Patch to urlparse.urljoin() for ".." and "..#1", Marc Lemburg. -- There is now explicit per-thread state. (Inspired by, but not the -same as, Greg Stein's free threading patches.) +- Many small improvements to Jeff Rush' OS/2 support. -- There is now better support for threading C applications. There are -now explicit APIs to manipulate the interpreter lock. Read the source -or the Demo/pysvr example; the new functions are -PyEval_{Acquire,Release}{Lock,Thread}(). +- ospath.py is gone; it's been obsolete for so many years now... -- The test macro DEBUG has changed to Py_DEBUG, to avoid interference -with other libraries' DEBUG macros. Likewise for any other test -macros that didn't yet start with Py_. +- The reference manual is now set up to prepare better HTML (still +using webmaker, alas). -- New wrappers around malloc() and friends: Py_Malloc() etc. call -malloc() and call PyErr_NoMemory() when it fails; PyMem_Malloc() call -just malloc(). Use of these wrappers could be essential if multiple -memory allocators exist (e.g. when using certain DLL setups under -Windows). (Idea by Jim Fulton.) +- Add special handling to /Tools/freeze for Python modules that are +imported implicitly by the Python runtime: 'site' and 'exceptions'. -- New C API PyImport_Import() which uses whatever __import__() hook -that is installed for the current execution environment. By Jim -Fulton. +- Tools/faqwiz 0.8.3 -- add an option to suppress URL processing +inside
, by "Scott".
 
-- It is now possible for an extension module's init function to fail
-non-fatally, by calling one of the PyErr_* functions and returning.
+- Added ConfigParser.py, a generic parser for sectioned configuration
+files.
 
-- The PyInt_AS_LONG() and PyFloat_AS_DOUBLE() macros now cast their
-argument to the proper type, like the similar PyString macros already
-did.  (Suggestion by Marc-Andre Lemburg.)  Similar for PyList_GET_SIZE
-and PyList_GET_ITEM.
+- In _localemodule.c, LC_MESSAGES is not always defined; put it
+between #ifdefs.
 
-- Some of the Py_Get* function, like Py_GetVersion() (but not yet
-Py_GetPath()) are now declared as returning a const char *.  (More
-should follow.)
+- Typo in resource.c: RUSAGE_CHILDERN -> RUSAGE_CHILDREN.
 
-- Changed the run-time library to check for exceptions after object
-comparisons.  PyObject_Compare() can now return an exception; use
-PyErr_Occurred() to check (there is *no* special return value).
+- Demo/scripts/newslist.py: Fix the way the version number is gotten
+out of the RCS revision.
 
-- PyFile_WriteString() and Py_Flushline() now return error indicators
-instead of clearing exceptions.  This fixes an obscure bug where using
-these would clear a pending exception, discovered by Just van Rossum.
+- PyArg_Parse[Tuple] now explicitly check for bad characters at the
+end of the format string.
 
-- There's a new function, PyArg_ParseTupleAndKeywords(), which parses
-an argument list including keyword arguments.  Contributed by Geoff
-Philbrick.
+- Revamped PC/example_nt to support VC++ 5.x.
 
-- PyArg_GetInt() is gone.
+- .sort() now uses a modified quicksort by Raymund Galvin,
+after studying the GNU libg++ quicksort.  This should be much faster
+if there are lots of duplicates, and otherwise at least as good.
 
-- It's no longer necessary to include graminit.h when calling one of
-the extended parser API functions.  The three public grammar start
-symbols are now in Python.h as Py_single_input, Py_file_input, and
-Py_eval_input.
+- Added "uue" as an alias for "uuencode" to mimetools.py.  (Hm, the
+uudecode bug where it complaints about trailing garbage is still there 
+:-( ).
 
-- The CObject interface has a new function,
-PyCObject_Import(module, name).  It calls PyCObject_AsVoidPtr()
-on the object referenced by "module.name".
+- pickle.py requires integers in text mode to be in decimal notation
+(it used to accept octal and hex, even though it would only generate
+decimal numbers).
 
+- In string.atof(), don't fail when the "re" module is unavailable.
+Plug the ensueing security leak by supplying an empty __builtins__
+directory to eval().
 
-Tkinter
--------
+- A bunch of small fixes and improvements to Tkinter.py.
 
-- On popular demand, _tkinter once again installs a hook for readline
-that processes certain Tk events while waiting for the user to type
-(using PyOS_InputHook).
+- Fixed a buffer overrun in PC/getpathp.c.
 
-- A patch by Craig McPheeters plugs the most obnoxious memory leaks,
-caused by command definitions referencing widget objects beyond their
-lifetime.
 
-- New standard dialog modules: tkColorChooser.py, tkCommonDialog.py,
-tkMessageBox.py, tkFileDialog.py, tkSimpleDialog.py These interface
-with the new Tk dialog scripts, and provide more "native platform"
-style file selection dialog boxes on some platforms.  Contributed by
-Fredrik Lundh.
+======================================================================
 
-- Tkinter.py: when the first Tk object is destroyed, it sets the
-hiddel global _default_root to None, so that when another Tk object is
-created it becomes the new default root.  Other miscellaneous
-changes and fixes.
 
-- The Image class now has a configure method.
+From 1.5a4 to 1.5b1
+===================
 
-- Added a bunch of new winfo options to Tkinter.py; we should now be
-up to date with Tk 4.2.  The new winfo options supported are:
-mananger, pointerx, pointerxy, pointery, server, viewable, visualid,
-visualsavailable.
+- The Windows NT/95 installer now includes full HTML of all manuals.
+It also has a checkbox that lets you decide whether to install the
+interpreter and library.  The WISE installer script for the installer
+is included in the source tree as PC/python15.wse, and so are the
+icons used for Python files.  The config.c file for the Windows build
+is now complete with the pcre module.
 
-- The broken bind() method on Canvas objects defined in the Canvas.py
-module has been fixed.  The CanvasItem and Group classes now also have
-an unbind() method.
+- sys.ps1 and sys.ps2 can now arbitrary objects; their str() is
+evaluated for the prompt.
 
-- The problem with Tkinter.py falling back to trying to import
-"tkinter" when "_tkinter" is not found has been fixed -- it no longer
-tries "tkinter", ever.  This makes diagnosing the problem "_tkinter
-not configured" much easier and will hopefully reduce the newsgroup
-traffic on this topic.
+- The reference manual is brought up to date (more or less -- it still
+needs work, e.g. in the area of package import).
 
-- The ScrolledText module once again supports the 'cnf' parameter, to
-be compatible with the examples in Mark Lutz' book (I know, I know,
-too late...)
+- The icons used by latex2html are now included in the Doc
+subdirectory (mostly so that tarring up the HTML files can be fully
+automated).  A simple index.html is also added to Doc (it only works
+after you have successfully run latex2html).
 
-- The _tkinter.c extension module has been revamped.  It now support
-Tk versions 4.1 through 8.0; support for 4.0 has been dropped.  It
-works well under Windows and Mac (with the latest Tk ports to those
-platforms).  It also supports threading -- it is safe for one
-(Python-created) thread to be blocked in _tkinter.mainloop() while
-other threads modify widgets.  To make the changes visible, those
-threads must use update_idletasks()method.  (The patch for threading
-in 1.5a3 was broken; in 1.5a4, it is back in a different version,
-which requires access to the Tcl sources to get it to work -- hence it
-is disabled by default.)
+- For all you would-be proselytizers out there: a new version of
+Misc/BLURB describes Python more concisely, and Misc/comparisons
+compares Python to several other languages.  Misc/BLURB.WINDOWS
+contains a blurb specifically aimed at Windows programmers (by Mark
+Hammond).
 
-- A bug in _tkinter.c has been fixed, where Split() with a string
-containing an unmatched '"' could cause an exception or core dump.
+- A new version of the Python mode for Emacs is included as
+Misc/python-mode.el.  There are too many new features to list here.
+See http://www.python.org/ftp/emacs/pmdetails.html for more info.
 
-- Unfortunately, on Windows and Mac, Tk 8.0 no longer supports
-CreateFileHandler, so _tkinter.createfilehandler is not available on
-those platforms when using Tk 8.0 or later.  I will have to rethink
-how to interface with Tcl's lower-level event mechanism, or with its
-channels (which are like Python's file-like objects).  Jack Jansen has
-provided a fix for the Mac, so createfilehandler *is* actually
-supported there; maybe I can adapt his fix for Windows.
+- New module fileinput makes iterating over the lines of a list of
+files easier.  (This still needs some more thinking to make it more
+extensible.)
 
+- There's full OS/2 support, courtesy Jeff Rush.  To build the OS/2
+version, see PC/readme.txt and PC/os2vacpp.  This is for IBM's Visual
+Age C++ compiler.  I expect that Jeff will also provide a binary
+release for this platform.
 
-Tools and Demos
----------------
+- On Linux, the configure script now uses '-Xlinker -export-dynamic'
+instead of '-rdynamic' to link the main program so that it exports its
+symbols to shared libraries it loads dynamically.  I hope this doesn't
+break on older Linux versions; it is needed for mklinux and appears to
+work on Linux 2.0.30.
 
-- A new regression test suite is provided, which tests most of the
-standard and built-in modules.  The regression test is run by invoking
-the script Lib/test/regrtest.py.  Barry Warsaw wrote the test harnass;
-he and Roger Masse contributed most of the new tests.
+- Some Tkinter resstructuring: the geometry methods that apply to a
+master are now properly usable on toplevel master widgets.  There's a
+new (internal) widget class, BaseWidget.  New, longer "official" names
+for the geometry manager methods have been added,
+e.g. "grid_columnconfigure()" instead of "columnconfigure()".  The old
+shorter names still work, and where there's ambiguity, pack wins over
+place wins over grid.  Also, the bind_class method now returns its
+value.
 
-- New tool: faqwiz -- the CGI script that is used to maintain the
-Python FAQ (http://grail.cnri.reston.va.us/cgi-bin/faqw.py).  In
-Tools/faqwiz.
+- New, RFC-822 conformant parsing of email addresses and address lists
+in the rfc822 module, courtesy Ben Escoto.
 
-- New tool: webchecker -- a simple extensible web robot that, when
-aimed at a web server, checks that server for dead links.  Available
-are a command line utility as well as a Tkinter based GUI version.  In
-Tools/webchecker.  A simplified version of this program is dissected
-in my article in O'Reilly's WWW Journal, the issue on Scripting
-Languages (Vol 2, No 2); Scripting the Web with Python (pp 97-120).
-Includes a parser for robots.txt files by Skip Montanaro.
+- New, revamped tkappinit.c with support for popular packages (PIL,
+TIX, BLT, TOGL).  For the last three, you need to execute the Tcl
+command "load {} Tix" (or Blt, or Togl) to gain access to them.
+The Modules/Setup line for the _tkinter module has been rewritten
+using the cool line-breaking feature of most Bourne shells.
 
-- New small tools: cvsfiles.py (prints a list of all files under CVS
-n a particular directory tree), treesync.py (a rather Guido-specific
-script to synchronize two source trees, one on Windows NT, the other
-one on Unix under CVS but accessible from the NT box), and logmerge.py
-(sort a collection of RCS or CVS logs by date).  In Tools/scripts.
+- New socket method connect_ex() returns the error code from connect()
+instead of raising an exception on errors; this makes the logic
+required for asynchronous connects simpler and more efficient.
 
-- The freeze script now also works under Windows (NT).  Another
-feature allows the -p option to be pointed at the Python source tree
-instead of the installation prefix.  This was loosely based on part of
-xfreeze by Sam Rushing and Bill Tutt.
+- New "locale" module with (still experimental) interface to the
+standard C library locale interface, courtesy Martin von Loewis.  This
+does not repeat my mistake in 1.5a4 of always calling
+setlocale(LC_ALL, "").  In fact, we've pretty much decided that
+Python's standard numerical formatting operations should always use
+the conventions for the C locale; the locale module contains utility
+functions to format numbers according to the user specified locale.
+(All this is accomplished by an explicit call to setlocale(LC_NUMERIC,
+"C") after locale-changing calls.)  See the library manual. (Alas, the
+promised changes to the "re" module for locale support have not been
+materialized yet.  If you care, volunteer!)
 
-- New examples (Demo/extend) that show how to use the generic
-extension makefile (Misc/Makefile.pre.in).
+- Memory leak plugged in Py_BuildValue when building a dictionary.
 
-- Tools/scripts/h2py.py now supports C++ comments.
+- Shared modules can now live inside packages (hierarchical module
+namespaces).  No changes to the shared module itself are needed.
 
-- Tools/scripts/pystone.py script is upgraded to version 1.1; there
-was a bug in version 1.0 (distributed with Python 1.4) that leaked
-memory.  Also, in 1.1, the LOOPS variable is incremented to 10000.
+- Improved policy for __builtins__: this is a module in __main__ and a
+dictionary everywhere else.
 
-- Demo/classes/Rat.py completely rewritten by Sjoerd Mullender.
+- Python no longer catches SIGHUP and SIGTERM by default.  This was
+impossible to get right in the light of thread contexts.  If you want
+your program to clean up when a signal happens, use the signal module
+to set up your own signal handler.
 
+- New Python/C API PyNumber_CoerceEx() does not return an exception
+when no coercion is possible.  This is used to fix a problem where
+comparing incompatible numbers for equality would raise an exception
+rather than return false as in Python 1.4 -- it once again will return
+false.
 
-Windows (NT and 95)
--------------------
+- The errno module is changed again -- the table of error messages
+(errorstr) is removed.  Instead, you can use os.strerror().  This
+removes redundance and a potential locale dependency.
 
-- New project files for Developer Studio (Visual C++) 5.0 for Windows
-NT (the old VC++ 4.2 Makefile is also still supported, but will
-eventually be withdrawn due to its bulkiness).
+- New module xmllib, to parse XML files.  By Sjoerd Mullender.
 
-- See the note on the new module search path in the "Miscellaneous" section 
-above.
+- New C API PyOS_AfterFork() is called after fork() in posixmodule.c.
+It resets the signal module's notion of what the current process ID
+and thread are, so that signal handlers will work after (and across)
+calls to os.fork().
 
-- Support for Win32s (the 32-bit Windows API under Windows 3.1) is
-basically withdrawn.  If it still works for you, you're lucky.
+- Fixed most occurrences of fatal errors due to missing thread state.
 
-- There's a new extension module, msvcrt.c, which provides various 
-low-level operations defined in the Microsoft Visual C++ Runtime Library.  
-These include locking(), setmode(), get_osfhandle(), set_osfhandle(), and 
-console I/O functions like kbhit(), getch() and putch().
+- For vgrind (a flexible source pretty printer) fans, there's a simple
+Python definition in Misc/vgrindefs, courtesy Neale Pickett.
 
-- The -u option not only sets the standard I/O streams to unbuffered
-status, but also sets them in binary mode.  (This can also be done
-using msvcrt.setmode(), by the way.)
+- Fixed memory leak in exec statement.
 
-- The, sys.prefix and sys.exec_prefix variables point to the directory 
-where Python is installed, or to the top of the source tree, if it was run 
-from there.
+- The test.pystone module has a new function, pystones(loops=LOOPS),
+which returns a (benchtime, stones) tuple.  The main() function now
+calls this and prints the report.
 
-- The various os.path modules (posixpath, ntpath, macpath) now support
-passing more than two arguments to the join() function, so
-os.path.join(a, b, c) is the same as os.path.join(a, os.path.join(b,
-c)).
+- Package directories now *require* the presence of an __init__.py (or
+__init__.pyc) file before they are considered as packages.  This is
+done to prevent accidental subdirectories with common names from
+overriding modules with the same name.
 
-- The ntpath module (normally used as os.path) supports ~ to $HOME 
-expansion in expanduser().
+- Fixed some strange exceptions in __del__ methods in library modules
+(e.g. urllib).  This happens because the builtin names are already
+deleted by the time __del__ is called.  The solution (a hack, but it
+works) is to set some instance variables to 0 instead of None.
 
-- The freeze tool now works on Windows.
+- The table of built-in module initializers is replaced by a pointer
+variable.  This makes it possible to switch to a different table at
+run time, e.g. when a collection of modules is loaded from a shared
+library.  (No example code of how to do this is given, but it is
+possible.)  The table is still there of course, its name prefixed with
+an underscore and used to initialize the pointer.
 
-- See also the Tkinter category for a sad note on
-_tkinter.createfilehandler().
+- The warning about a thread still having a frame now only happens in
+verbose mode.
 
-- The truncate() method for file objects now works on Windows.
+- Change the signal finialization so that it also resets the signal
+handlers.  After this has been called, our signal handlers are no
+longer active!
 
-- Py_Initialize() is no longer called when the DLL is loaded.  You
-must call it yourself.
+- New version of tokenize.py (by Ka-Ping Yee) recognizes raw string
+literals.  There's now also a test fort this module.
 
-- The time module's clock() function now has good precision through
-the use of the Win32 API QueryPerformanceCounter().
+- The copy module now also uses __dict__.update(state) instead of
+going through individual attribute assignments, for class instances
+without a __setstate__ method.
 
-- Mark Hammond will release Python 1.5 versions of PythonWin and his
-other Windows specific code: the win32api extensions, COM/ActiveX
-support, and the MFC interface.
+- New module reconvert translates old-style (regex module) regular
+expressions to new-style (re module, Perl-style) regular expressions.
 
+- Most modules that used to use the regex module now use the re
+module.  The grep module has a new pgrep() function which uses
+Perl-style regular expressions.
 
-Mac
----
+- The (very old, backwards compatibility) regexp.py module has been
+deleted.
 
-- As always, the Macintosh port will be done by Jack Jansen.  He will
-make a separate announcement for the Mac specific source code and the
-binary distribution(s) when these are ready.
+- Restricted execution (rexec): added the pcre module (support for the
+re module) to the list of trusted extension modules.
+
+- New version of Jim Fulton's CObject object type, adds
+PyCObject_FromVoidPtrAndDesc() and PyCObject_GetDesc() APIs.
+
+- Some patches to Lee Busby's fpectl mods that accidentally didn't
+make it into 1.5a4.
+
+- In the string module, add an optional 4th argument to count(),
+matching find() etc.
+
+- Patch for the nntplib module by Charles Waldman to add optional user
+and password arguments to NNTP.__init__(), for nntp servers that need
+them.
+
+- The str() function for class objects now returns
+"modulename.classname" instead of returning the same as repr().
+
+- The parsing of \xXX escapes no longer relies on sscanf().
+
+- The "sharedmodules" subdirectory of the installation is renamed to
+"lib-dynload".  (You may have to edit your Modules/Setup file to fix
+this in an existing installation!)
+
+- Fixed Don Beaudry's mess-up with the OPT test in the configure
+script.  Certain SGI platforms will still issue a warning for each
+compile; there's not much I can do about this since the compiler's
+exit status doesn't indicate that I was using an obsolete option.
+
+- Fixed Barry's mess-up with {}.get(), and added test cases for it.
+
+- Shared libraries didn't quite work under AIX because of the change
+in status of the GNU readline interface.  Fix due to by Vladimir
+Marangozov.
 
 
 ======================================================================
@@ -1432,448 +1274,966 @@ environment variable.
 ======================================================================
 
 
-From 1.5a4 to 1.5b1
-===================
-
-- The Windows NT/95 installer now includes full HTML of all manuals.
-It also has a checkbox that lets you decide whether to install the
-interpreter and library.  The WISE installer script for the installer
-is included in the source tree as PC/python15.wse, and so are the
-icons used for Python files.  The config.c file for the Windows build
-is now complete with the pcre module.
+From 1.4 to 1.5a3
+=================
 
-- sys.ps1 and sys.ps2 can now arbitrary objects; their str() is
-evaluated for the prompt.
+Security
+--------
 
-- The reference manual is brought up to date (more or less -- it still
-needs work, e.g. in the area of package import).
+- If you are using the setuid script C wrapper (Misc/setuid-prog.c),
+please use the new version.  The old version has a huge security leak.
 
-- The icons used by latex2html are now included in the Doc
-subdirectory (mostly so that tarring up the HTML files can be fully
-automated).  A simple index.html is also added to Doc (it only works
-after you have successfully run latex2html).
+Miscellaneous
+-------------
 
-- For all you would-be proselytizers out there: a new version of
-Misc/BLURB describes Python more concisely, and Misc/comparisons
-compares Python to several other languages.  Misc/BLURB.WINDOWS
-contains a blurb specifically aimed at Windows programmers (by Mark
-Hammond).
+- Because of various (small) incompatible changes in the Python
+bytecode interpreter, the magic number for .pyc files has changed
+again.
 
-- A new version of the Python mode for Emacs is included as
-Misc/python-mode.el.  There are too many new features to list here.
-See http://www.python.org/ftp/emacs/pmdetails.html for more info.
+- The default module search path is now much saner.  Both on Unix and
+Windows, it is essentially derived from the path to the executable
+(which can be overridden by setting the environment variable
+$PYTHONHOME).  The value of $PYTHONPATH on Windows is now inserted in
+front of the default path, like in Unix (instead of overriding the
+default path).  On Windows, the directory containing the executable is
+added to the end of the path.
 
-- New module fileinput makes iterating over the lines of a list of
-files easier.  (This still needs some more thinking to make it more
-extensible.)
+- A new version of python-mode.el for Emacs has been included.  Also,
+a new file ccpy-style.el has been added to configure Emacs cc-mode for
+the preferred style in Python C sources.
 
-- There's full OS/2 support, courtesy Jeff Rush.  To build the OS/2
-version, see PC/readme.txt and PC/os2vacpp.  This is for IBM's Visual
-Age C++ compiler.  I expect that Jeff will also provide a binary
-release for this platform.
+- On Unix, when using sys.argv[0] to insert the script directory in
+front of sys.path, expand a symbolic link.  You can now install a
+program in a private directory and have a symbolic link to it in a
+public bin directory, and it will put the private directory in the
+module search path.  Note that the symlink is expanded in sys.path[0]
+but not in sys.argv[0], so you can still tell the name by which you
+were invoked.
 
-- On Linux, the configure script now uses '-Xlinker -export-dynamic'
-instead of '-rdynamic' to link the main program so that it exports its
-symbols to shared libraries it loads dynamically.  I hope this doesn't
-break on older Linux versions; it is needed for mklinux and appears to
-work on Linux 2.0.30.
+- It is now recommended to use ``#!/usr/bin/env python'' instead of
+``#!/usr/local/bin/python'' at the start of executable scripts, except
+for CGI scripts.  It has been determined that the use of /usr/bin/env
+is more portable than that of /usr/local/bin/python -- scripts almost
+never have to be edited when the Python interpreter lives in a
+non-standard place.  Note that this doesn't work for CGI scripts since
+the python executable often doesn't live in the HTTP server's default
+search path.
 
-- Some Tkinter resstructuring: the geometry methods that apply to a
-master are now properly usable on toplevel master widgets.  There's a
-new (internal) widget class, BaseWidget.  New, longer "official" names
-for the geometry manager methods have been added,
-e.g. "grid_columnconfigure()" instead of "columnconfigure()".  The old
-shorter names still work, and where there's ambiguity, pack wins over
-place wins over grid.  Also, the bind_class method now returns its
-value.
+- The silly -s command line option and the corresponding
+PYTHONSUPPRESS environment variable (and the Py_SuppressPrint global
+flag in the Python/C API) are gone.
 
-- New, RFC-822 conformant parsing of email addresses and address lists
-in the rfc822 module, courtesy Ben Escoto.
+- Most problems on 64-bit platforms should now be fixed.  Andrew
+Kuchling helped.  Some uncommon extension modules are still not
+clean (image and audio ops?).
 
-- New, revamped tkappinit.c with support for popular packages (PIL,
-TIX, BLT, TOGL).  For the last three, you need to execute the Tcl
-command "load {} Tix" (or Blt, or Togl) to gain access to them.
-The Modules/Setup line for the _tkinter module has been rewritten
-using the cool line-breaking feature of most Bourne shells.
+- Fixed a bug where multiple anonymous tuple arguments would be mixed up
+when using the debugger or profiler (reported by Just van Rossum).
+The simplest example is ``def f((a,b),(c,d)): print a,b,c,d''; this
+would print the wrong value when run under the debugger or profiler.
 
-- New socket method connect_ex() returns the error code from connect()
-instead of raising an exception on errors; this makes the logic
-required for asynchronous connects simpler and more efficient.
+- The hacks that the dictionary implementation used to speed up
+repeated lookups of the same C string were removed; these were a
+source of subtle problems and don't seem to serve much of a purpose
+any longer.
 
-- New "locale" module with (still experimental) interface to the
-standard C library locale interface, courtesy Martin von Loewis.  This
-does not repeat my mistake in 1.5a4 of always calling
-setlocale(LC_ALL, "").  In fact, we've pretty much decided that
-Python's standard numerical formatting operations should always use
-the conventions for the C locale; the locale module contains utility
-functions to format numbers according to the user specified locale.
-(All this is accomplished by an explicit call to setlocale(LC_NUMERIC,
-"C") after locale-changing calls.)  See the library manual. (Alas, the
-promised changes to the "re" module for locale support have not been
-materialized yet.  If you care, volunteer!)
+- All traces of support for the long dead access statement have been
+removed from the sources.
 
-- Memory leak plugged in Py_BuildValue when building a dictionary.
+- Plugged the two-byte memory leak in the tokenizer when reading an
+interactive EOF.
 
-- Shared modules can now live inside packages (hierarchical module
-namespaces).  No changes to the shared module itself are needed.
+- There's a -O option to the interpreter that removes SET_LINENO
+instructions and assert statements (see below); it uses and produces
+.pyo files instead of .pyc files.  The speedup is only a few percent
+in most cases.  The line numbers are still available in the .pyo file,
+as a separate table (which is also available in .pyc files).  However,
+the removal of the SET_LINENO instructions means that the debugger
+(pdb) can't set breakpoints on lines in -O mode.  The traceback module
+contains a function to extract a line number from the code object
+referenced in a traceback object.  In the future it should be possible
+to write external bytecode optimizers that create better optimized
+.pyo files, and there should be more control over optimization;
+consider the -O option a "teaser".  Without -O, the assert statement
+actually generates code that first checks __debug__; if this variable
+is false, the assertion is not checked.  __debug__ is a built-in
+variable whose value is initialized to track the -O flag (it's true
+iff -O is not specified).  With -O, no code is generated for assert
+statements, nor for code of the form ``if __debug__: ''.
+Sorry, no further constant folding happens.
 
-- Improved policy for __builtins__: this is a module in __main__ and a
-dictionary everywhere else.
 
-- Python no longer catches SIGHUP and SIGTERM by default.  This was
-impossible to get right in the light of thread contexts.  If you want
-your program to clean up when a signal happens, use the signal module
-to set up your own signal handler.
+Performance
+-----------
 
-- New Python/C API PyNumber_CoerceEx() does not return an exception
-when no coercion is possible.  This is used to fix a problem where
-comparing incompatible numbers for equality would raise an exception
-rather than return false as in Python 1.4 -- it once again will return
-false.
+- It's much faster (almost twice for pystone.py -- see
+Tools/scripts).  See the entry on string interning below.
 
-- The errno module is changed again -- the table of error messages
-(errorstr) is removed.  Instead, you can use os.strerror().  This
-removes redundance and a potential locale dependency.
+- Some speedup by using separate free lists for method objects (both
+the C and the Python variety) and for floating point numbers.
 
-- New module xmllib, to parse XML files.  By Sjoerd Mullender.
+- Big speedup by allocating frame objects with a single malloc() call.
+The Python/C API for frames is changed (you shouldn't be using this
+anyway).
 
-- New C API PyOS_AfterFork() is called after fork() in posixmodule.c.
-It resets the signal module's notion of what the current process ID
-and thread are, so that signal handlers will work after (and across)
-calls to os.fork().
+- Significant speedup by inlining some common opcodes for common operand 
+types (e.g.  i+i, i-i, and list[i]).  Fredrik Lundh.
 
-- Fixed most occurrences of fatal errors due to missing thread state.
+- Small speedup by reordering the method tables of some common
+objects (e.g. list.append is now first).
 
-- For vgrind (a flexible source pretty printer) fans, there's a simple
-Python definition in Misc/vgrindefs, courtesy Neale Pickett.
+- Big optimization to the read() method of file objects.  A read()
+without arguments now attempts to use fstat to allocate a buffer of
+the right size; for pipes and sockets, it will fall back to doubling
+the buffer size.  While that the improvement is real on all systems,
+it is most dramatic on Windows.
 
-- Fixed memory leak in exec statement.
 
-- The test.pystone module has a new function, pystones(loops=LOOPS),
-which returns a (benchtime, stones) tuple.  The main() function now
-calls this and prints the report.
+Documentation
+-------------
 
-- Package directories now *require* the presence of an __init__.py (or
-__init__.pyc) file before they are considered as packages.  This is
-done to prevent accidental subdirectories with common names from
-overriding modules with the same name.
+- Many new pieces of library documentation were contributed, mostly by
+Andrew Kuchling.  Even cmath is now documented!  There's also a
+chapter of the library manual, "libundoc.tex", which provides a
+listing of all undocumented modules, plus their status (e.g. internal,
+obsolete, or in need of documentation).  Also contributions by Sue
+Williams, Skip Montanaro, and some module authors who succumbed to
+pressure to document their own contributed modules :-).  Note that
+printing the documentation now kills fewer trees -- the margins have
+been reduced.
 
-- Fixed some strange exceptions in __del__ methods in library modules
-(e.g. urllib).  This happens because the builtin names are already
-deleted by the time __del__ is called.  The solution (a hack, but it
-works) is to set some instance variables to 0 instead of None.
+- I have started documenting the Python/C API. Unfortunately this project 
+hasn't been completed yet.  It will be complete before the final release of 
+Python 1.5, though.  At the moment, it's better to read the LaTeX source 
+than to attempt to run it through LaTeX and print the resulting dvi file.
 
-- The table of built-in module initializers is replaced by a pointer
-variable.  This makes it possible to switch to a different table at
-run time, e.g. when a collection of modules is loaded from a shared
-library.  (No example code of how to do this is given, but it is
-possible.)  The table is still there of course, its name prefixed with
-an underscore and used to initialize the pointer.
+- The posix module (and hence os.py) now has doc strings!  Thanks to Neil 
+Schemenauer.  I received a few other contributions of doc strings.  In most 
+other places, doc strings are still wishful thinking...
 
-- The warning about a thread still having a frame now only happens in
-verbose mode.
 
-- Change the signal finialization so that it also resets the signal
-handlers.  After this has been called, our signal handlers are no
-longer active!
+Language changes
+----------------
+
+- Private variables with leading double underscore are now a permanent 
+feature of the language.  (These were experimental in release 1.4.  I have 
+favorable experience using them; I can't label them "experimental" 
+forever.)
+
+- There's new string literal syntax for "raw strings".  Prefixing a string 
+literal with the letter r (or R) disables all escape processing in the 
+string; for example, r'\n' is a two-character string consisting of a 
+backslash followed by the letter n.  This combines with all forms of string 
+quotes; it is actually useful for triple quoted doc strings which might 
+contain references to \n or \t.  An embedded quote prefixed with a 
+backslash does not terminate the string, but the backslash is still 
+included in the string; for example, r'\'' is a two-character string 
+consisting of a backslash and a quote.  (Raw strings are also 
+affectionately known as Robin strings, after their inventor, Robin 
+Friedrich.)
+
+- There's a simple assert statement, and a new exception
+AssertionError.  For example, ``assert foo > 0'' is equivalent to ``if
+not foo > 0: raise AssertionError''.  Sorry, the text of the asserted
+condition is not available; it would be too complicated to generate
+code for this (since the code is generated from a parse tree).
+However, the text is displayed as part of the traceback!
+
+- The raise statement has a new feature: when using "raise SomeClass,
+somevalue" where somevalue is not an instance of SomeClass, it
+instantiates SomeClass(somevalue).  In 1.5a4, if somevalue is an
+instance of a *derived* class of SomeClass, the exception class raised
+is set to somevalue.__class__, and SomeClass is ignored after that.
+
+- Duplicate keyword arguments are now detected at compile time;
+f(a=1,a=2) is now a syntax error.
+
+
+Changes to builtin features
+---------------------------
+
+- There's a new exception FloatingPointError (used only by Lee Busby's
+patches to catch floating point exceptions, at the moment).
+
+- The obsolete exception ConflictError (presumably used by the long
+obsolete access statement) has been deleted.
+
+- There's a new function sys.exc_info() which returns the tuple 
+(sys.exc_type, sys.exc_value, sys.exc_traceback) in a thread-safe way.
+
+- There's a new variable sys.executable, pointing to the executable file 
+for the Python interpreter.
+
+- The sort() methods for lists no longer uses the C library qsort(); I
+wrote my own quicksort implementation, with lots of help (in the form
+of a kind of competition) from Tim Peters.  This solves a bug in
+dictionary comparisons on some Solaris versions when Python is built
+with threads, and makes sorting lists even faster.
+
+- The semantics of comparing two dictionaries have changed, to make
+comparison of unequal dictionaries faster.  A shorter dictionary is
+always considered smaller than a larger dictionary.  For dictionaries
+of the same size, the smallest differing element determines the
+outcome (which yields the same results as before in this case, without
+explicit sorting).  Thanks to Aaron Watters for suggesting something
+like this.
+
+- The semantics of try-except have changed subtly so that calling a
+function in an exception handler that itself raises and catches an
+exception no longer overwrites the sys.exc_* variables.  This also
+alleviates the problem that objects referenced in a stack frame that
+caught an exception are kept alive until another exception is caught
+-- the sys.exc_* variables are restored to their previous value when
+returning from a function that caught an exception.
+
+- There's a new "buffer" interface.  Certain objects (e.g. strings and
+arrays) now support the "buffer" protocol.  Buffer objects are acceptable 
+whenever formerly a string was required for a write operation; mutable 
+buffer objects can be the target of a read operation using the call
+f.readinto(buffer).  A cool feature is that regular expression matching now 
+also work on array objects.  Contribution by Jack Jansen.  (Needs 
+documentation.)
+
+- String interning: dictionary lookups are faster when the lookup
+string object is the same object as the key in the dictionary, not
+just a string with the same value.  This is done by having a pool of
+"interned" strings.  Most names generated by the interpreter are now
+automatically interned, and there's a new built-in function intern(s)
+that returns the interned version of a string.  Interned strings are
+not a different object type, and interning is totally optional, but by
+interning most keys a speedup of about 15% was obtained for the
+pystone benchmark.
+
+- Dictionary objects have several new methods; clear() and copy() have
+the obvious semantics, while update(d) merges the contents of another
+dictionary d into this one, overriding existing keys.  The dictionary
+implementation file is now called dictobject.c rather than the
+confusing mappingobject.c.
+
+- The intrinsic function dir() is much smarter; it looks in __dict__,
+__members__ and __methods__.
+
+- The intrinsic functions int(), long() and float() can now take a
+string argument and then do the same thing as string.atoi(),
+string.atol(), and string.atof().  No second 'base' argument is
+allowed, and complex() does not take a string (nobody cared enough).
+
+- When a module is deleted, its globals are now deleted in two phases.
+In the first phase, all variables whose name begins with exactly one
+underscore are replaced by None; in the second phase, all variables
+are deleted.  This makes it possible to have global objects whose
+destructors depend on other globals.  The deletion order within each
+phase is still random.
+
+- It is no longer an error for a function to be called without a
+global variable __builtins__ -- an empty directory will be provided
+by default.
+
+- Guido's corollary to the "Don Beaudry hook": it is now possible to
+do metaprogramming by using an instance as a base class.  Not for the
+faint of heart; and undocumented as yet, but basically if a base class
+is an instance, its class will be instantiated to create the new
+class.  Jim Fulton will love it -- it also works with instances of his
+"extension classes", since it is triggered by the presence of a
+__class__ attribute on the purported base class.  See
+Demo/metaclasses/index.html for an explanation and see that directory
+for examples.
+
+- Another change is that the Don Beaudry hook is now invoked when
+*any* base class is special.  (Up to 1.5a3, the *last* special base
+class is used; in 1.5a4, the more rational choice of the *first*
+special base class is used.)
+
+- New optional parameter to the readlines() method of file objects.
+This indicates the number of bytes to read (the actual number of bytes
+read will be somewhat larger due to buffering reading until the end of
+the line).  Some optimizations have also been made to speed it up (but
+not as much as read()).
+
+- Complex numbers no longer have the ".conj" pseudo attribute; use
+z.conjugate() instead, or complex(z.real, -z.imag).  Complex numbers
+now *do* support the __members__ and __methods__ special attributes.
+
+- The complex() function now looks for a __complex__() method on class
+instances before giving up.
+
+- Long integers now support arbitrary shift counts, so you can now
+write 1L<<1000000, memory permitting.  (Python 1.4 reports "outrageous
+shift count for this.)
+
+- The hex() and oct() functions have been changed so that for regular
+integers, they never emit a minus sign.  For example, on a 32-bit
+machine, oct(-1) now returns '037777777777' and hex(-1) returns
+'0xffffffff'.  While this may seem inconsistent, it is much more
+useful.  (For long integers, a minus sign is used as before, to fit
+the result in memory :-)
+
+- The hash() function computes better hashes for several data types,
+including strings, floating point numbers, and complex numbers.
+
+
+New extension modules
+---------------------
+
+- New extension modules cStringIO.c and cPickle.c, written by Jim
+Fulton and other folks at Digital Creations.  These are much more
+efficient than their Python counterparts StringIO.py and pickle.py,
+but don't support subclassing.  cPickle.c clocks up to 1000 times
+faster than pickle.py; cStringIO.c's improvement is less dramatic but
+still significant.
+
+- New extension module zlibmodule.c, interfacing to the free zlib
+library (gzip compatible compression).  There's also a module gzip.py
+which provides a higher level interface.  Written by Andrew Kuchling
+and Jeremy Hylton.
+
+- New module readline; see the "miscellaneous" section above.
+
+- New Unix extension module resource.c, by Jeremy Hylton, provides
+access to getrlimit(), getrusage(), setrusage(), getpagesize(), and
+related symbolic constants.
+
+- New extension puremodule.c, by Barry Warsaw, which interfaces to the
+Purify(TM) C API.  See also the file Misc/PURIFY.README.  It is also
+possible to enable Purify by simply setting the PURIFY Makefile
+variable in the Modules/Setup file.
+
+
+Changes in extension modules
+----------------------------
+
+- The struct extension module has several new features to control byte
+order and word size.  It supports reading and writing IEEE floats even
+on platforms where this is not the native format.  It uses uppercase
+format codes for unsigned integers of various sizes (always using
+Python long ints for 'I' and 'L'), 's' with a size prefix for strings,
+and 'p' for "Pascal strings" (with a leading length byte, included in
+the size; blame Hannu Krosing; new in 1.5a4).  A prefix '>' forces
+big-endian data and '<' forces little-endian data; these also select
+standard data sizes and disable automatic alignment (use pad bytes as
+needed).
+
+- The array module supports uppercase format codes for unsigned data
+formats (like the struct module).
+
+- The fcntl extension module now exports the needed symbolic
+constants.  (Formerly these were in FCNTL.py which was not available
+or correct for all platforms.)
+
+- The extension modules dbm, gdbm and bsddb now check that the
+database is still open before making any new calls.
+
+- The dbhash module is no more.  Use bsddb instead.  (There's a third
+party interface for the BSD 2.x code somewhere on the web; support for
+bsddb will be deprecated.)
+
+- The gdbm module now supports a sync() method.
+
+- The socket module now has some new functions: getprotobyname(), and
+the set {ntoh,hton}{s,l}().
+
+- Various modules now export their type object: socket.SocketType,
+array.ArrayType.
+
+- The socket module's accept() method now returns unknown addresses as
+a tuple rather than raising an exception.  (This can happen in
+promiscuous mode.)  Theres' also a new function getprotobyname().
+
+- The pthread support for the thread module now works on most platforms.
+
+- STDWIN is now officially obsolete.  Support for it will eventually
+be removed from the distribution.
+
+- The binascii extension module is now hopefully fully debugged.
+(XXX Oops -- Fredrik Lundh promised me a uuencode fix that I never
+received.)
+
+- audioop.c: added a ratecv() function; better handling of overflow in
+add().
+
+- posixmodule.c: now exports the O_* flags (O_APPEND etc.).  On
+Windows, also O_TEXT and O_BINARY.  The 'error' variable (the
+exception is raises) is renamed -- its string value is now "os.error",
+so newbies don't believe they have to import posix (or nt) to catch
+it when they see os.error reported as posix.error.  The execve()
+function now accepts any mapping object for the environment.
+
+- A new version of the al (audio library) module for SGI was
+contributed by Sjoerd Mullender.
+
+- The regex module has a new function get_syntax() which retrieves the
+syntax setting set by set_syntax().  The code was also sanitized,
+removing worries about unclean error handling.  See also below for its
+successor, re.py.
+
+- The "new" module (which creates new objects of various types) once
+again has a fully functioning new.function() method.  Dangerous as
+ever!  Also, new.code() has several new arguments.
+
+- A problem has been fixed in the rotor module: on systems with signed
+characters, rotor-encoded data was not portable when the key contained
+8-bit characters.  Also, setkey() now requires its argument rather
+than having broken code to default it.
+
+- The sys.builtin_module_names variable is now a tuple.  Another new
+variables in sys is sys.executable (the full path to the Python
+binary, if known).
+
+- The specs for time.strftime() have undergone some revisions.  It
+appears that not all format characters are supported in the same way
+on all platforms.  Rather than reimplement it, we note these
+differences in the documentation, and emphasize the shared set of
+features.  There's also a thorough test set (that occasionally finds
+problems in the C library implementation, e.g. on some Linuxes),
+thanks to Skip Montanaro.
+
+- The nis module seems broken when used with NIS+; unfortunately
+nobody knows how to fix it.  It should still work with old NIS.
+
+
+New library modules
+-------------------
+
+- New (still experimental) Perl-style regular expression module,
+re.py, which uses a new interface for matching as well as a new
+syntax; the new interface avoids the thread-unsafety of the regex
+interface.  This comes with a helper extension reopmodule.c and vastly
+rewritten regexpr.c.  Most work on this was done by Jeffrey Ollie, Tim
+Peters, and Andrew Kuchling.  See the documentation libre.tex.  In
+1.5, the old regex module is still fully supported; in the future, it
+will become obsolete.
+
+- New module gzip.py; see zlib above.
+
+- New module keyword.py exports knowledge about Python's built-in
+keywords.  (New version by Ka-Ping Yee.)
+
+- New module pprint.py (with documentation) which supports
+pretty-printing of lists, tuples, & dictionaries recursively.  By Fred
+Drake.
+
+- New module code.py.  The function code.compile_command() can
+determine whether an interactively entered command is complete or not,
+distinguishing incomplete from invalid input.  (XXX Unfortunately,
+this seems broken at this moment, and I don't have the time to fix
+it.  It's probably better to add an explicit interface to the parser
+for this.)
+
+- There is now a library module xdrlib.py which can read and write the
+XDR data format as used by Sun RPC, for example.  It uses the struct
+module.
+
+
+Changes in library modules
+--------------------------
+
+- Module codehack.py is now completely obsolete.
+
+- The pickle.py module has been updated to make it compatible with the
+new binary format that cPickle.c produces.  By default it produces the
+old all-ASCII format compatible with the old pickle.py, still much
+faster than pickle.py; it will read both formats automatically.  A few
+other updates have been made.
+
+- A new helper module, copy_reg.py, is provided to register extensions
+to the pickling code.
+
+- Revamped module tokenize.py is much more accurate and has an
+interface that makes it a breeze to write code to colorize Python
+source code.  Contributed by Ka-Ping Yee.
+
+- In ihooks.py, ModuleLoader.load_module() now closes the file under
+all circumstances.
+
+- The tempfile.py module has a new class, TemporaryFile, which creates
+an open temporary file that will be deleted automatically when
+closed.  This works on Windows and MacOS as well as on Unix.  (Jim
+Fulton.)
+
+- Changes to the cgi.py module: Most imports are now done at the
+top of the module, which provides a speedup when using ni (Jim
+Fulton).  The problem with file upload to a Windows platform is solved
+by using the new tempfile.TemporaryFile class; temporary files are now
+always opened in binary mode (Jim Fulton).  The cgi.escape() function
+now takes an optional flag argument that quotes '"' to '"'.  It
+is now possible to invoke cgi.py from a command line script, to test
+cgi scripts more easily outside an http server.  There's an optional
+limit to the size of uploads to POST (Skip Montanaro).  Added a
+'strict_parsing' option to all parsing functions (Jim Fulton).  The
+function parse_qs() now uses urllib.unquote() on the name as well as
+the value of fields (Clarence Gardner).  The FieldStorage class now
+has a __len__() method.
+
+- httplib.py: the socket object is no longer closed; all HTTP/1.*
+responses are now accepted; and it is now thread-safe (by not using
+the regex module).
+
+- BaseHTTPModule.py: treat all HTTP/1.* versions the same.
+
+- The popen2.py module is now rewritten using a class, which makes
+access to the standard error stream and the process id of the
+subprocess possible.
+
+- Added timezone support to the rfc822.py module, in the form of a
+getdate_tz() method and a parsedate_tz() function; also a mktime_tz().
+Also added recognition of some non-standard date formats, by Lars
+Wirzenius, and RFC 850 dates (Chris Lawrence).
+
+- mhlib.py: various enhancements, including almost compatible parsing
+of message sequence specifiers without invoking a subprocess.  Also
+added a createmessage() method by Lars Wirzenius.
+
+- The StringIO.StringIO class now supports readline(nbytes).  (Lars 
+Wirzenius.)  (Of course, you should be using cStringIO for performance.)
+
+- UserDict.py supports the new dictionary methods as well.
+
+- Improvements for whrandom.py by Tim Peters: use 32-bit arithmetic to
+speed it up, and replace 0 seed values by 1 to avoid degeneration.
+A bug was fixed in the test for invalid arguments.
+
+- Module ftplib.py: added support for parsing a .netrc file (Fred
+Drake).  Also added an ntransfercmd() method to the FTP class, which
+allows access to the expected size of a transfer when available, and a
+parse150() function to the module which parses the corresponding 150
+response.
+
+- urllib.py: the ftp cache is now limited to 10 entries.  Added
+quote_plus() and unquote_plus() functions which are like quote() and
+unquote() but also replace spaces with '+' or vice versa, for
+encoding/decoding CGI form arguments.  Catch all errors from the ftp
+module.  HTTP requests now add the Host: header line.  The proxy
+variable names are now mapped to lower case, for Windows.  The
+spliturl() function no longer erroneously throws away all data past
+the first newline.  The basejoin() function now intereprets "../"
+correctly.  I *believe* that the problems with "exception raised in
+__del__" under certain circumstances have been fixed (mostly by
+changes elsewher in the interpreter).
+
+- In urlparse.py, there is a cache for results in urlparse.urlparse();
+its size limit is set to 20.  Also, new URL schemes shttp, https, and
+snews are "supported".
+
+- shelve.py: use cPickle and cStringIO when available.  Also added
+a sync() method, which calls the database's sync() method if there is
+one.
+
+- The mimetools.py module now uses the available Python modules for
+decoding quoted-printable, uuencode and base64 formats, rather than
+creating a subprocess.
+
+- The python debugger (pdb.py, and its base class bdb.py) now support
+conditional breakpoints.  See the docs.
+
+- The modules base64.py, uu.py and quopri.py can now be used as simple
+command line utilities.
 
-- New version of tokenize.py (by Ka-Ping Yee) recognizes raw string
-literals.  There's now also a test fort this module.
+- Various small fixes to the nntplib.py module that I can't bother to
+document in detail.
 
-- The copy module now also uses __dict__.update(state) instead of
-going through individual attribute assignments, for class instances
-without a __setstate__ method.
+- Sjoerd Mullender's mimify.py module now supports base64 encoding and 
+includes functions to handle the funny encoding you sometimes see in mail 
+headers.  It is now documented.
 
-- New module reconvert translates old-style (regex module) regular
-expressions to new-style (re module, Perl-style) regular expressions.
+- mailbox.py: Added BabylMailbox.  Improved the way the mailbox is
+gotten from the environment.
 
-- Most modules that used to use the regex module now use the re
-module.  The grep module has a new pgrep() function which uses
-Perl-style regular expressions.
+- Many more modules now correctly open files in binary mode when this
+is necessary on non-Unix platforms.
 
-- The (very old, backwards compatibility) regexp.py module has been
-deleted.
+- The copying functions in the undocumented module shutil.py are
+smarter.
 
-- Restricted execution (rexec): added the pcre module (support for the
-re module) to the list of trusted extension modules.
+- The Writer classes in the formatter.py module now have a flush()
+method.
 
-- New version of Jim Fulton's CObject object type, adds
-PyCObject_FromVoidPtrAndDesc() and PyCObject_GetDesc() APIs.
+- The sgmllib.py module accepts hyphens and periods in the middle of
+attribute names.  While this is against the SGML standard, there is
+some HTML out there that uses this...
 
-- Some patches to Lee Busby's fpectl mods that accidentally didn't
-make it into 1.5a4.
+- The interface for the Python bytecode disassembler module, dis.py,
+has been enhanced quite a bit.  There's now one main function,
+dis.dis(), which takes almost any kind of object (function, module,
+class, instance, method, code object) and disassembles it; without
+arguments it disassembles the last frame of the last traceback.  The
+other functions have changed slightly, too.
 
-- In the string module, add an optional 4th argument to count(),
-matching find() etc.
+- The imghdr.py module recognizes new image types: BMP, PNG.
 
-- Patch for the nntplib module by Charles Waldman to add optional user
-and password arguments to NNTP.__init__(), for nntp servers that need
-them.
+- The string.py module has a new function replace(str, old, new,
+[maxsplit]) which does substring replacements.  It is actually
+implemented in C in the strop module.  The functions [r]find() an
+[r]index() have an optional 4th argument indicating the end of the
+substring to search, alsoo implemented by their strop counterparts.
+(Remember, never import strop -- import string uses strop when
+available with zero overhead.)
 
-- The str() function for class objects now returns
-"modulename.classname" instead of returning the same as repr().
+- The string.join() function now accepts any sequence argument, not
+just lists and tuples.
 
-- The parsing of \xXX escapes no longer relies on sscanf().
+- The string.maketrans() requires its first two arguments to be
+present.  The old version didn't require them, but there's not much
+point without them, and the documentation suggests that they are
+required, so we fixed the code to match the documentation.
 
-- The "sharedmodules" subdirectory of the installation is renamed to
-"lib-dynload".  (You may have to edit your Modules/Setup file to fix
-this in an existing installation!)
+- The regsub.py module has a function clear_cache(), which clears its
+internal cache of compiled regular expressions.  Also, the cache now
+takes the current syntax setting into account.  (However, this module
+is now obsolete -- use the sub() or subn() functions or methods in the
+re module.)
 
-- Fixed Don Beaudry's mess-up with the OPT test in the configure
-script.  Certain SGI platforms will still issue a warning for each
-compile; there's not much I can do about this since the compiler's
-exit status doesn't indicate that I was using an obsolete option.
+- The undocumented module Complex.py has been removed, now that Python
+has built-in complex numbers.  A similar module remains as
+Demo/classes/Complex.py, as an example.
 
-- Fixed Barry's mess-up with {}.get(), and added test cases for it.
 
-- Shared libraries didn't quite work under AIX because of the change
-in status of the GNU readline interface.  Fix due to by Vladimir
-Marangozov.
+Changes to the build process
+----------------------------
 
+- The way GNU readline is configured is totally different.  The
+--with-readline configure option is gone.  It is now an extension
+module, which may be loaded dynamically.  You must enable it (and
+specify the correct linraries to link with) in the Modules/Setup file.
+Importing the module installs some hooks which enable command line
+editing.  When the interpreter shell is invoked interactively, it
+attempts to import the readline module; when this fails, the default
+input mechanism is used.  The hook variables are PyOS_InputHook and
+PyOS_ReadlineFunctionPointer.  (Code contributed by Lee Busby, with
+ideas from William Magro.)
 
-======================================================================
+- New build procedure: a single library, libpython1.5.a, is now built,
+which contains absolutely everything except for a one-line main()
+program (which calls Py_Main(argc, argv) to start the interpreter
+shell).  This makes life much simpler for applications that need to
+embed Python.  The serial number of the build is now included in the
+version string (sys.version).
 
+- As far as I can tell, neither gcc -Wall nor the Microsoft compiler
+emits a single warning any more when compiling Python.
 
-From 1.5b1 to 1.5b2
-===================
+- A number of new Makefile variables have been added for special
+situations, e.g. LDLAST is appended to the link command.  These are
+used by editing the Makefile or passing them on the make command
+line.
 
-- Fixed a bug in cPickle.c that caused it to crash right away because
-the version string had a different format.
+- A set of patches from Lee Busby has been integrated that make it
+possible to catch floating point exceptions.  Use the configure option
+--with-fpectl to enable the patches; the extension modules fpectl and
+fpetest provide control to enable/disable and test the feature,
+respectively.
 
-- Changes in pickle.py and cPickle.c: when unpickling an instance of a
-class that doesn't define the __getinitargs__() method, the __init__()
-constructor is no longer called.  This makes a much larger group of
-classes picklable by default, but may occasionally change semantics.
-To force calling __init__() on unpickling, define a __getinitargs__()
-method.  Other changes too, in particular cPickle now handles classes
-defined in packages correctly.  The same change applies to copying
-instances with copy.py.  The cPickle.c changes and some pickle.py
-changes are courtesy Jim Fulton.
+- The support for shared libraries under AIX is now simpler and more
+robust.  Thanks to Vladimir Marangozov for revamping his own patches!
 
-- Locale support in he "re" (Perl regular expressions) module.  Use 
-the flag re.L (or re.LOCALE) to enable locale-specific matching
-rules for \w and \b.  The in-line syntax for this flag is (?L).
+- The Modules/makesetup script now reads a file Setup.local as well as
+a file Setup.  Most changes to the Setup script can be done by editing
+Setup.local instead, which makes it easier to carry a particular setup
+over from one release to the next.
 
-- The built-in function isinstance(x, y) now also succeeds when y is
-a type object and type(x) is y.
+- The Modules/makesetup script now copies any "include" lines it
+encounters verbatim into the output Makefile.  It also recognizes .cxx
+and .cpp as C++ source files.
 
-- repr() and str() of class and instance objects now reflect the
-package/module in which the class is defined.
+- The configure script is smarter about C compiler options; e.g. with
+gcc it uses -O2 and -g when possible, and on some other platforms it
+uses -Olimit 1500 to avoid a warning from the optimizer about the main
+loop in ceval.c (which has more than 1000 basic blocks).
 
-- Module "ni" has been removed.  (If you really need it, it's been
-renamed to "ni1".  Let me know if this causes any problems for you.
-Package authors are encouraged to write __init__.py files that
-support both ni and 1.5 package support, so the same version can be
-used with Python 1.4 as well as 1.5.)
+- The configure script now detects whether malloc(0) returns a NULL
+pointer or a valid block (of length zero).  This avoids the nonsense
+of always adding one byte to all malloc() arguments on most platforms.
 
-- The thread module is now automatically included when threads are
-configured.  (You must remove it from your existing Setup file,
-since it is now in its own Setup.thread file.)
+- The configure script has a new option, --with-dec-threads, to enable
+DEC threads on DEC Alpha platforms.  Also, --with-threads is now an
+alias for --with-thread (this was the Most Common Typo in configure
+arguments).
 
-- New command line option "-x" to skip the first line of the script;
-handy to make executable scripts on non-Unix platforms.
+- Many changes in Doc/Makefile; amongst others, latex2html is now used
+to generate HTML from all latex documents.
 
-- In importdl.c, add the RTLD_GLOBAL to the dlopen() flags.  I
-haven't checked how this affects things, but it should make symbols
-in one shared library available to the next one.
 
-- The Windows installer now installs in the "Program Files" folder on
-the proper volume by default.
+Change to the Python/C API
+--------------------------
 
-- The Windows configuration adds a new main program, "pythonw", and
-registers a new extension, ".pyw" that invokes this.  This is a
-pstandard Python interpreter that does not pop up a console window;
-handy for pure Tkinter applications.  All output to the original
-stdout and stderr is lost; reading from the original stdin yields
-EOF.  Also, both python.exe and pythonw.exe now have a pretty icon
-(a green snake in a box, courtesy Mark Hammond).
+- Because some interfaces have changed, the PYTHON_API macro has been
+bumped.  Most extensions built for the old API version will still run,
+but I can't guarantee this.  Python prints a warning message on
+version mismatches; it dumps core when the version mismatch causes a
+serious problem :-)
 
-- Lots of improvements to emacs-mode.el again.  See Barry's web page:
-http://www.python.org/ftp/emacs/pmdetails.html.
+- I've completed the Grand Renaming, with the help of Roger Masse and
+Barry Warsaw.  This makes reading or debugging the code much easier.
+Many other unrelated code reorganizations have also been carried out.
+The allobjects.h header file is gone; instead, you would have to
+include Python.h followed by rename2.h.  But you're better off running
+Tools/scripts/fixcid.py -s Misc/RENAME on your source, so you can omit
+the rename2.h; it will disappear in the next release.
 
-- Lots of improvements and additions to the library reference manual;
-many by Fred Drake.
+- Various and sundry small bugs in the "abstract" interfaces have been
+fixed.  Thanks to all the (involuntary) testers of the Python 1.4
+version!  Some new functions have been added, e.g. PySequence_List(o),
+equivalent to list(o) in Python.
 
-- Doc strings for the following modules: rfc822.py, posixpath.py,
-ntpath.py, httplib.py.  Thanks to Mitch Chapman and Charles Waldman.
+- New API functions PyLong_FromUnsignedLong() and
+PyLong_AsUnsignedLong().
 
-- Some more regression testing.
+- The API functions in the file cgensupport.c are no longer
+supported.  This file has been moved to Modules and is only ever
+compiled when the SGI specific 'gl' module is built.
 
-- An optional 4th (maxsplit) argument to strop.replace().
+- PyObject_Compare() can now raise an exception.  Check with
+PyErr_Occurred().  The comparison function in an object type may also
+raise an exception.
 
-- Fixed handling of maxsplit in string.splitfields().
+- The slice interface uses an upper bound of INT_MAX when no explicit
+upper bound is given (e.x. for a[1:]).  It used to ask the object for
+its length and do the calculations.
 
-- Tweaked os.environ so it can be pickled and copied.
+- Support for multiple independent interpreters.  See Doc/api.tex,
+functions Py_NewInterpreter() and Py_EndInterpreter().  Since the
+documentation is incomplete, also see the new Demo/pysvr example
+(which shows how to use these in a threaded application) and the
+source code.
 
-- The portability problems caused by indented preprocessor commands
-and C++ style comments should be gone now.
+- There is now a Py_Finalize() function which "de-initializes"
+Python.  It is possible to completely restart the interpreter
+repeatedly by calling Py_Finalize() followed by Py_Initialize().  A
+change of functionality in Py_Initialize() means that it is now a
+fatal error to call it while the interpreter is already initialized.
+The old, half-hearted Py_Cleanup() routine is gone.  Use of Py_Exit()
+is deprecated (it is nothing more than Py_Finalize() followed by
+exit()).
 
-- In random.py, added Pareto and Weibull distributions.
+- There are no known memory leaks left.  While Py_Finalize() doesn't
+free *all* allocated memory (some of it is hard to track down),
+repeated calls to Py_Finalize() and Py_Initialize() do not create
+unaccessible heap blocks.
 
-- The crypt module is now disabled in Modules/Setup.in by default; it
-is rarely needed and causes errors on some systems where users often
-don't know how to deal with those.
+- There is now explicit per-thread state.  (Inspired by, but not the
+same as, Greg Stein's free threading patches.)
 
-- Some improvements to the _tkinter build line suggested by Case Roole.
+- There is now better support for threading C applications.  There are
+now explicit APIs to manipulate the interpreter lock.  Read the source
+or the Demo/pysvr example; the new functions are
+PyEval_{Acquire,Release}{Lock,Thread}().
 
-- A full suite of platform specific files for NetBSD 1.x, submitted by 
-Anders Andersen.
+- The test macro DEBUG has changed to Py_DEBUG, to avoid interference
+with other libraries' DEBUG macros.  Likewise for any other test
+macros that didn't yet start with Py_.
+
+- New wrappers around malloc() and friends: Py_Malloc() etc. call
+malloc() and call PyErr_NoMemory() when it fails; PyMem_Malloc() call
+just malloc().  Use of these wrappers could be essential if multiple
+memory allocators exist (e.g. when using certain DLL setups under
+Windows).  (Idea by Jim Fulton.)
 
-- New Solaris specific header STROPTS.py.
+- New C API PyImport_Import() which uses whatever __import__() hook
+that is installed for the current execution environment.  By Jim
+Fulton.
 
-- Moved a confusing occurrence of *shared* from the comments in
-Modules/Setup.in (people would enable this one instead of the real
-one, and get disappointing results).
+- It is now possible for an extension module's init function to fail
+non-fatally, by calling one of the PyErr_* functions and returning.
 
-- Changed the default mode for directories to be group-writable when
-the installation process creates them.
+- The PyInt_AS_LONG() and PyFloat_AS_DOUBLE() macros now cast their
+argument to the proper type, like the similar PyString macros already
+did.  (Suggestion by Marc-Andre Lemburg.)  Similar for PyList_GET_SIZE
+and PyList_GET_ITEM.
 
-- Check for pthread support in "-l_r" for FreeBSD/NetBSD, and support
-shared libraries for both.
+- Some of the Py_Get* function, like Py_GetVersion() (but not yet
+Py_GetPath()) are now declared as returning a const char *.  (More
+should follow.)
 
-- Support FreeBSD and NetBSD in posixfile.py.
+- Changed the run-time library to check for exceptions after object
+comparisons.  PyObject_Compare() can now return an exception; use
+PyErr_Occurred() to check (there is *no* special return value).
 
-- Support for the "event" command, new in Tk 4.2.  By Case Roole.
+- PyFile_WriteString() and Py_Flushline() now return error indicators
+instead of clearing exceptions.  This fixes an obscure bug where using
+these would clear a pending exception, discovered by Just van Rossum.
 
-- Add Tix_SafeInit() support to tkappinit.c.
+- There's a new function, PyArg_ParseTupleAndKeywords(), which parses
+an argument list including keyword arguments.  Contributed by Geoff
+Philbrick.
 
-- Various bugs fixed in "re.py" and "pcre.c".
+- PyArg_GetInt() is gone.
 
-- Fixed a bug (broken use of the syntax table) in the old "regexpr.c".
+- It's no longer necessary to include graminit.h when calling one of
+the extended parser API functions.  The three public grammar start
+symbols are now in Python.h as Py_single_input, Py_file_input, and
+Py_eval_input.
 
-- In frozenmain.c, stdin is made unbuffered too when PYTHONUNBUFFERED
-is set.
+- The CObject interface has a new function,
+PyCObject_Import(module, name).  It calls PyCObject_AsVoidPtr()
+on the object referenced by "module.name".
 
-- Provide default blocksize for retrbinary in ftplib.py (Skip
-Montanaro).
 
-- In NT, pick the username up from different places in user.py (Jeff
-Bauer).
+Tkinter
+-------
 
-- Patch to urlparse.urljoin() for ".." and "..#1", Marc Lemburg.
+- On popular demand, _tkinter once again installs a hook for readline
+that processes certain Tk events while waiting for the user to type
+(using PyOS_InputHook).
 
-- Many small improvements to Jeff Rush' OS/2 support.
+- A patch by Craig McPheeters plugs the most obnoxious memory leaks,
+caused by command definitions referencing widget objects beyond their
+lifetime.
 
-- ospath.py is gone; it's been obsolete for so many years now...
+- New standard dialog modules: tkColorChooser.py, tkCommonDialog.py,
+tkMessageBox.py, tkFileDialog.py, tkSimpleDialog.py These interface
+with the new Tk dialog scripts, and provide more "native platform"
+style file selection dialog boxes on some platforms.  Contributed by
+Fredrik Lundh.
 
-- The reference manual is now set up to prepare better HTML (still
-using webmaker, alas).
+- Tkinter.py: when the first Tk object is destroyed, it sets the
+hiddel global _default_root to None, so that when another Tk object is
+created it becomes the new default root.  Other miscellaneous
+changes and fixes.
 
-- Add special handling to /Tools/freeze for Python modules that are
-imported implicitly by the Python runtime: 'site' and 'exceptions'.
+- The Image class now has a configure method.
 
-- Tools/faqwiz 0.8.3 -- add an option to suppress URL processing
-inside 
, by "Scott".
+- Added a bunch of new winfo options to Tkinter.py; we should now be
+up to date with Tk 4.2.  The new winfo options supported are:
+mananger, pointerx, pointerxy, pointery, server, viewable, visualid,
+visualsavailable.
 
-- Added ConfigParser.py, a generic parser for sectioned configuration
-files.
+- The broken bind() method on Canvas objects defined in the Canvas.py
+module has been fixed.  The CanvasItem and Group classes now also have
+an unbind() method.
 
-- In _localemodule.c, LC_MESSAGES is not always defined; put it
-between #ifdefs.
+- The problem with Tkinter.py falling back to trying to import
+"tkinter" when "_tkinter" is not found has been fixed -- it no longer
+tries "tkinter", ever.  This makes diagnosing the problem "_tkinter
+not configured" much easier and will hopefully reduce the newsgroup
+traffic on this topic.
 
-- Typo in resource.c: RUSAGE_CHILDERN -> RUSAGE_CHILDREN.
+- The ScrolledText module once again supports the 'cnf' parameter, to
+be compatible with the examples in Mark Lutz' book (I know, I know,
+too late...)
 
-- Demo/scripts/newslist.py: Fix the way the version number is gotten
-out of the RCS revision.
+- The _tkinter.c extension module has been revamped.  It now support
+Tk versions 4.1 through 8.0; support for 4.0 has been dropped.  It
+works well under Windows and Mac (with the latest Tk ports to those
+platforms).  It also supports threading -- it is safe for one
+(Python-created) thread to be blocked in _tkinter.mainloop() while
+other threads modify widgets.  To make the changes visible, those
+threads must use update_idletasks()method.  (The patch for threading
+in 1.5a3 was broken; in 1.5a4, it is back in a different version,
+which requires access to the Tcl sources to get it to work -- hence it
+is disabled by default.)
 
-- PyArg_Parse[Tuple] now explicitly check for bad characters at the
-end of the format string.
+- A bug in _tkinter.c has been fixed, where Split() with a string
+containing an unmatched '"' could cause an exception or core dump.
 
-- Revamped PC/example_nt to support VC++ 5.x.
+- Unfortunately, on Windows and Mac, Tk 8.0 no longer supports
+CreateFileHandler, so _tkinter.createfilehandler is not available on
+those platforms when using Tk 8.0 or later.  I will have to rethink
+how to interface with Tcl's lower-level event mechanism, or with its
+channels (which are like Python's file-like objects).  Jack Jansen has
+provided a fix for the Mac, so createfilehandler *is* actually
+supported there; maybe I can adapt his fix for Windows.
 
-- .sort() now uses a modified quicksort by Raymund Galvin,
-after studying the GNU libg++ quicksort.  This should be much faster
-if there are lots of duplicates, and otherwise at least as good.
 
-- Added "uue" as an alias for "uuencode" to mimetools.py.  (Hm, the
-uudecode bug where it complaints about trailing garbage is still there 
-:-( ).
+Tools and Demos
+---------------
 
-- pickle.py requires integers in text mode to be in decimal notation
-(it used to accept octal and hex, even though it would only generate
-decimal numbers).
+- A new regression test suite is provided, which tests most of the
+standard and built-in modules.  The regression test is run by invoking
+the script Lib/test/regrtest.py.  Barry Warsaw wrote the test harnass;
+he and Roger Masse contributed most of the new tests.
 
-- In string.atof(), don't fail when the "re" module is unavailable.
-Plug the ensueing security leak by supplying an empty __builtins__
-directory to eval().
+- New tool: faqwiz -- the CGI script that is used to maintain the
+Python FAQ (http://grail.cnri.reston.va.us/cgi-bin/faqw.py).  In
+Tools/faqwiz.
 
-- A bunch of small fixes and improvements to Tkinter.py.
+- New tool: webchecker -- a simple extensible web robot that, when
+aimed at a web server, checks that server for dead links.  Available
+are a command line utility as well as a Tkinter based GUI version.  In
+Tools/webchecker.  A simplified version of this program is dissected
+in my article in O'Reilly's WWW Journal, the issue on Scripting
+Languages (Vol 2, No 2); Scripting the Web with Python (pp 97-120).
+Includes a parser for robots.txt files by Skip Montanaro.
 
-- Fixed a buffer overrun in PC/getpathp.c.
+- New small tools: cvsfiles.py (prints a list of all files under CVS
+n a particular directory tree), treesync.py (a rather Guido-specific
+script to synchronize two source trees, one on Windows NT, the other
+one on Unix under CVS but accessible from the NT box), and logmerge.py
+(sort a collection of RCS or CVS logs by date).  In Tools/scripts.
 
+- The freeze script now also works under Windows (NT).  Another
+feature allows the -p option to be pointed at the Python source tree
+instead of the installation prefix.  This was loosely based on part of
+xfreeze by Sam Rushing and Bill Tutt.
 
-======================================================================
+- New examples (Demo/extend) that show how to use the generic
+extension makefile (Misc/Makefile.pre.in).
 
+- Tools/scripts/h2py.py now supports C++ comments.
 
-From 1.5b2 to 1.5
-=================
+- Tools/scripts/pystone.py script is upgraded to version 1.1; there
+was a bug in version 1.0 (distributed with Python 1.4) that leaked
+memory.  Also, in 1.1, the LOOPS variable is incremented to 10000.
 
-- Newly documentated module: BaseHTTPServer.py, thanks to Greg Stein.
+- Demo/classes/Rat.py completely rewritten by Sjoerd Mullender.
 
-- Added doc strings to string.py, stropmodule.c, structmodule.c,
-thanks to Charles Waldman.
 
-- Many nits fixed in the manuals, thanks to Fred Drake and many others
-(especially Rob Hooft and Andrew Kuchling).  The HTML version now uses
-HTML markup instead of inline GIF images for tables; only two images
-are left (for obsure bits of math).  The index of the HTML version has
-also been much improved.  Finally, it is once again possible to
-generate an Emacs info file from the library manual (but I don't
-commit to supporting this in future versions).
+Windows (NT and 95)
+-------------------
 
-- New module: telnetlib.py (a simple telnet client library).
+- New project files for Developer Studio (Visual C++) 5.0 for Windows
+NT (the old VC++ 4.2 Makefile is also still supported, but will
+eventually be withdrawn due to its bulkiness).
 
-- New tool: Tools/versioncheck/, by Jack Jansen.
+- See the note on the new module search path in the "Miscellaneous" section 
+above.
 
-- Ported zlibmodule.c and bsddbmodule.c to NT; The project file for MS
-DevStudio 5.0 now includes new subprojects to build the zlib and bsddb
-extension modules.
+- Support for Win32s (the 32-bit Windows API under Windows 3.1) is
+basically withdrawn.  If it still works for you, you're lucky.
 
-- Many small changes again to Tkinter.py -- mostly bugfixes and adding
-missing routines.  Thanks to Greg McFarlane for reporting a bunch of
-problems and proofreading my fixes.
+- There's a new extension module, msvcrt.c, which provides various 
+low-level operations defined in the Microsoft Visual C++ Runtime Library.  
+These include locking(), setmode(), get_osfhandle(), set_osfhandle(), and 
+console I/O functions like kbhit(), getch() and putch().
 
-- The re module and its documentation are up to date with the latest
-version released to the string-sig (Dec. 22).
+- The -u option not only sets the standard I/O streams to unbuffered
+status, but also sets them in binary mode.  (This can also be done
+using msvcrt.setmode(), by the way.)
 
-- Stop test_grp.py from failing when the /etc/group file is empty
-(yes, this happens!).
+- The, sys.prefix and sys.exec_prefix variables point to the directory 
+where Python is installed, or to the top of the source tree, if it was run 
+from there.
 
-- Fix bug in integer conversion (mystrtoul.c) that caused
-4294967296==0 to be true!
+- The various os.path modules (posixpath, ntpath, macpath) now support
+passing more than two arguments to the join() function, so
+os.path.join(a, b, c) is the same as os.path.join(a, os.path.join(b,
+c)).
 
-- The VC++ 4.2 project file should be complete again.
+- The ntpath module (normally used as os.path) supports ~ to $HOME 
+expansion in expanduser().
 
-- In tempfile.py, use a better template on NT, and add a new optional
-argument "suffix" with default "" to specify a specific extension for
-the temporary filename (needed sometimes on NT but perhaps also handy
-elsewhere).
+- The freeze tool now works on Windows.
 
-- Fixed some bugs in the FAQ wizard, and converted it to use re
-instead of regex.
+- See also the Tkinter category for a sad note on
+_tkinter.createfilehandler().
 
-- Fixed a mysteriously undetected error in dlmodule.c (it was using a
-totally bogus routine name to raise an exception).
+- The truncate() method for file objects now works on Windows.
 
-- Fixed bug in import.c which wasn't using the new "dos-8x3" name yet.
+- Py_Initialize() is no longer called when the DLL is loaded.  You
+must call it yourself.
 
-- Hopefully harmless changes to the build process to support shared
-libraries on DG/UX.  This adds a target to create
-libpython$(VERSION).so; however this target is *only* for DG/UX.
+- The time module's clock() function now has good precision through
+the use of the Win32 API QueryPerformanceCounter().
 
-- Fixed a bug in the new format string error checking in getargs.c.
+- Mark Hammond will release Python 1.5 versions of PythonWin and his
+other Windows specific code: the win32api extensions, COM/ActiveX
+support, and the MFC interface.
 
-- A simple fix for infinite recursion when printing __builtins__:
-reset '_' to None before printing and set it to the printed variable
-*after* printing (and only when printing is successful).
 
-- Fixed lib-tk/SimpleDialog.py to keep the dialog visible even if the
-parent window is not (Skip Montanaro).
+Mac
+---
 
-- Fixed the two most annoying problems with ftp URLs in
-urllib.urlopen(); an empty file now correctly raises an error, and it
-is no longer required to explicitly close the returned "file" object
-before opening another ftp URL to the same host and directory.
+- As always, the Macintosh port will be done by Jack Jansen.  He will
+make a separate announcement for the Mac specific source code and the
+binary distribution(s) when these are ready.
 
 
 ======================================================================
-- 
cgit v0.12