Merged revisions 2527-2645 via svnmerge from

http://scons.tigris.org/svn/scons/branches/core

........
  r2528 | stevenknight | 2007-12-13 06:08:21 -0800 (Thu, 13 Dec 2007) | 5 lines

  Remove the .del_binfo() method, no longer needed since the Big Signature
  Refactoring causes us to visit every Node in order during the DAG walk,
  and the BuildInfo object now just holds information for storage in the
  .sconsign file.
........
  r2529 | stevenknight | 2007-12-13 13:17:15 -0800 (Thu, 13 Dec 2007) | 3 lines

  Fix the --keep-going flag so it builds all possible targets even when
  a later top-level target depends on a child that failed its build.
........
  r2530 | stevenknight | 2007-12-14 04:02:05 -0800 (Fri, 14 Dec 2007) | 4 lines

  Issue 1715:  BuildDir(duplicate=0) support for Tex/LaTeX.
  Re-run LaTeX in response to package warnings.
  (Rob Managan)
........
  r2531 | stevenknight | 2007-12-14 07:14:31 -0800 (Fri, 14 Dec 2007) | 3 lines

  Refactor the max_drift logic around fetching stored signatures into
  its own new method.
........
  r2532 | stevenknight | 2007-12-14 07:18:44 -0800 (Fri, 14 Dec 2007) | 3 lines

  Have get_csig() return the stored content signature if max_drift
  says it's okay.
........
  r2533 | stevenknight | 2007-12-14 18:34:51 -0800 (Fri, 14 Dec 2007) | 2 lines

  Issue 1859:  Support SWIG statements like %module(directors="1").
........
  r2534 | stevenknight | 2007-12-15 03:51:13 -0800 (Sat, 15 Dec 2007) | 3 lines

  Python 2.1 portability fix w.r.t. "import SCons" and "import
  SCons.platform.win32" and binding local variables and whatnot.
........
  r2535 | stevenknight | 2007-12-15 03:51:56 -0800 (Sat, 15 Dec 2007) | 2 lines

  Python 1.5 fix:  use the -classic flag when invoking SWIG.
........
  r2536 | stevenknight | 2007-12-15 06:03:48 -0800 (Sat, 15 Dec 2007) | 4 lines

  Support subclasses of the new-style str() class as input to Builders
  and the like.  Also speed up all of the Util.is_*() functions when using
  new-style classes by just using isinstance() internally.
........
  r2537 | stevenknight | 2007-12-15 06:35:49 -0800 (Sat, 15 Dec 2007) | 3 lines

  Issue 1851:  Fix being able to use $PDB and $WINDOWS_INSERT_MANIFEST together.
  (Benoit Belley)
........
  r2538 | stevenknight | 2007-12-15 06:59:43 -0800 (Sat, 15 Dec 2007) | 3 lines

  Handle dangling entries for the Intel C compiler in the Windows registry.
  (Benoit Belley)
........
  r2539 | stevenknight | 2007-12-15 09:51:59 -0800 (Sat, 15 Dec 2007) | 2 lines

  Reorganize library-related tests into a separate subdirectory.
........
  r2540 | stevenknight | 2007-12-15 09:57:29 -0800 (Sat, 15 Dec 2007) | 4 lines

  Issue 1850:  better support for non-standard shared library prefixes and
  suffixes by stripping all prefixes and suffixes in lists of $SHLIBPREFIXES
  and $SHLIBSUFFIXES.  (Benoit Belley)
........
  r2541 | stevenknight | 2007-12-15 18:49:15 -0800 (Sat, 15 Dec 2007) | 2 lines

  Python 1.5 portability fixes.
........
  r2542 | stevenknight | 2007-12-15 19:02:39 -0800 (Sat, 15 Dec 2007) | 3 lines

  Issue 1768:  Have the D language scanner search for .di files as well
  as .d files.  (Jerome Berger)
........
  r2543 | stevenknight | 2007-12-16 14:31:40 -0800 (Sun, 16 Dec 2007) | 3 lines

  Add a find_include_names() method to the Scanner.Classic class to abstract
  out how included names can be generated by subclasses.  (Jerome Berger)
........
  r2544 | stevenknight | 2007-12-16 14:31:54 -0800 (Sun, 16 Dec 2007) | 3 lines

  Add a find_include_names() method to the Scanner.Classic class to abstract
  out how included names can be generated by subclasses.  (Jerome Berger)
........
  r2545 | stevenknight | 2007-12-16 15:04:43 -0800 (Sun, 16 Dec 2007) | 3 lines

  Issue 1860:  Support the D scanner returning multiple modules from a
  single import statement.  (Jerome Berger)
........
  r2546 | stevenknight | 2007-12-16 17:41:17 -0800 (Sun, 16 Dec 2007) | 3 lines

  Issue 1861:  Fix the ability to #include a file (or search other $*PATH
  variables) that has an absoluate path.
........
  r2547 | stevenknight | 2007-12-18 08:09:59 -0800 (Tue, 18 Dec 2007) | 2 lines

  Replace uses of "is_List() or is_Tuple()" with is_Sequence().
........
  r2548 | stevenknight | 2007-12-18 08:13:14 -0800 (Tue, 18 Dec 2007) | 2 lines

  Report the incorrect value in assertions.
........
  r2549 | stevenknight | 2007-12-19 07:58:56 -0800 (Wed, 19 Dec 2007) | 3 lines

  Fix handling #includes of absolute path names when the path doesn't
  exist (implicitly, because it's #ifdef'ed out).
........
  r2550 | stevenknight | 2007-12-19 08:29:24 -0800 (Wed, 19 Dec 2007) | 4 lines

  Fix test path examination when the temporary directory location
  is redirected via symlinks (e.g. /usr/tmp -> /var/tmp on Red Hat).
  (Benoit Belley)
........
  r2551 | stevenknight | 2007-12-19 08:30:17 -0800 (Wed, 19 Dec 2007) | 2 lines

  Fix scons-time path reporting when symlinks are involved.  (Benoit Belley)
........
  r2552 | stevenknight | 2007-12-19 22:51:18 -0800 (Wed, 19 Dec 2007) | 4 lines

  Issue 1855:  Reduce the worker thread stack size to a default of 256
  Kbytes.  Add a --stack-size= command-line option, also configurable
  via SetOption('stack_size').  (Benoit Belley)
........
  r2553 | stevenknight | 2007-12-20 18:25:50 -0800 (Thu, 20 Dec 2007) | 2 lines

  Skip this test if SWIG isn't installed.
........
  r2554 | stevenknight | 2007-12-20 18:26:21 -0800 (Thu, 20 Dec 2007) | 2 lines

  Accomodate slightly different permissions errors on Ubuntu Gutsy.
........
  r2555 | stevenknight | 2007-12-21 02:12:09 -0800 (Fri, 21 Dec 2007) | 3 lines

  Fix a Python 2.2 quirk in the reported file name ("<string>") when
  encountering a SyntaxError in a SConstruct file.
........
  r2556 | stevenknight | 2007-12-21 02:12:35 -0800 (Fri, 21 Dec 2007) | 2 lines

  Enforce order between the build of f1.out and f2.out.
........
  r2557 | stevenknight | 2007-12-21 02:12:55 -0800 (Fri, 21 Dec 2007) | 2 lines

  Don't die if the Python version doesn't have os.path.realpath().
........
  r2558 | stevenknight | 2007-12-21 02:13:19 -0800 (Fri, 21 Dec 2007) | 2 lines

  Refactor the test/build-errors.py script into separate scripts for each test.
........
  r2559 | stevenknight | 2007-12-21 08:08:12 -0800 (Fri, 21 Dec 2007) | 3 lines

  Issue 1864:  Add a CheckDeclaration() call to configure contexts.
  (David Cournapeau)
........
  r2560 | stevenknight | 2007-12-21 08:18:47 -0800 (Fri, 21 Dec 2007) | 2 lines

  Issue 1865:  Improve the CheckTypeSize() code.  (David Cournapeau)
........
  r2561 | stevenknight | 2007-12-21 08:21:47 -0800 (Fri, 21 Dec 2007) | 2 lines

  Fix os.path.realpath() handling (a Python 2.1 portability issue).
........
  r2562 | stevenknight | 2007-12-21 14:08:39 -0800 (Fri, 21 Dec 2007) | 2 lines

  Split CPPDEFINES.py into separate sub-test scripts.
........
  r2563 | stevenknight | 2007-12-21 15:56:26 -0800 (Fri, 21 Dec 2007) | 6 lines

  Support proper expansion of construction variables containing lists
  within expansions like $CPPPATH.
  Change env.subst() to return a list, not a joined string, when the
  input is a list.
  (Konstantin Bozhikov)
........
  r2564 | stevenknight | 2007-12-22 04:15:11 -0800 (Sat, 22 Dec 2007) | 2 lines

  Normalize the ModDate field when comparing generated PDF files.
........
  r2565 | stevenknight | 2007-12-22 22:01:45 -0800 (Sat, 22 Dec 2007) | 5 lines

  Java test refactoring to commonize construction environment initialization
  and searching for javac / javah / jar / rmic.
  Don't look for *_Skel.class files to be created by Java 1.[56].
  Minor Java code changes to deal with compiler warnings.
........
  r2566 | stevenknight | 2007-12-23 05:20:45 -0800 (Sun, 23 Dec 2007) | 2 lines

  Don't still look for *_Skel.class files.
........
  r2567 | stevenknight | 2007-12-23 07:30:36 -0800 (Sun, 23 Dec 2007) | 5 lines

  Fix Intel C compiler issues:
  Issue 1863:  Fix failure to match /opt/intel_cc_* directories.  (Benoit Belley)
  Issue 1866:  Fix topdir when the version isn't specified.  (Jonas Olsson)
  Issue 1867:  Fix use of network licenses.  (Jonas Olsson)
........
  r2573 | stevenknight | 2008-01-01 09:59:16 -0800 (Tue, 01 Jan 2008) | 3 lines

  Add asynchronous subprocess communication via new start() and finish()
  methods.
........
  r2574 | stevenknight | 2008-01-01 10:02:26 -0800 (Tue, 01 Jan 2008) | 4 lines

  Minor code cleanup:  attach the version string to the options parser
  object, instead of passing it in to deal with the lack of nested scopes
  in Python 1.5.2.
........
  r2575 | stevenknight | 2008-01-01 10:08:46 -0800 (Tue, 01 Jan 2008) | 4 lines

  Rename the CacheDir class and let the name CacheDir be a variable that
  can be reset at will, depending on whether CacheDir() support is enabled
  or disabled at any particular time.
........
  r2576 | stevenknight | 2008-01-01 10:14:58 -0800 (Tue, 01 Jan 2008) | 2 lines

  Restore the Node.del_binfo() method and its call in Node.clear().
........
  r2577 | stevenknight | 2008-01-02 07:51:25 -0800 (Wed, 02 Jan 2008) | 6 lines

  Refactor CacheDir support (again) for --interactive mode.  Delay effects
  of --cache-* settings until they're needed by getting rid of the Null()
  object pattern and the functional programming idiom of replacing the
  CacheDebug method.  Have the Environment.CacheDir() method just record
  the path for later instantiation.
........
  r2578 | stevenknight | 2008-01-02 18:48:12 -0800 (Wed, 02 Jan 2008) | 3 lines

  Issue 1657:  Add a --interactive option to create a command-line
  interpreter for re-building targets without re-reading SConscript files.
........
  r2579 | stevenknight | 2008-01-02 21:54:38 -0800 (Wed, 02 Jan 2008) | 2 lines

  Python 1.5.2 portability fix (no use of +=).
........
  r2580 | stevenknight | 2008-01-02 21:54:47 -0800 (Wed, 02 Jan 2008) | 3 lines

  Use a regular expression to avoid having to match a specific
  MD5 checksum value in the --cache-debug output.
........
  r2581 | stevenknight | 2008-01-02 21:54:59 -0800 (Wed, 02 Jan 2008) | 4 lines

  Don't bother looking for shlex.split(), since our compatibility layer
  provides it in older Python version.  Make the compatibility version of
  shlex.split() not treat '.' as a token separator.
........
  r2582 | stevenknight | 2008-01-02 21:56:15 -0800 (Wed, 02 Jan 2008) | 3 lines

  Python 1.5.2 portability fixes:  no list comprehensions, no nested
  scopes, no "for x in" a dictionary.
........
  r2583 | stevenknight | 2008-01-03 07:39:59 -0800 (Thu, 03 Jan 2008) | 3 lines

  Fix a left-over use of a string method.
  Fix printing --interactive help text, which I outright broke last checkin.
........
  r2584 | stevenknight | 2008-01-03 07:58:56 -0800 (Thu, 03 Jan 2008) | 4 lines

  Import the vanilla Python2.5 shlex module, which we'll use as a basis
  for retrofitting to old Python versions to provide shlex.split()
  functionality.
........
  r2585 | stevenknight | 2008-01-03 08:01:02 -0800 (Thu, 03 Jan 2008) | 3 lines

  Modifications to the vanilla Python 2.5 shlex module to make it work
  back to Python 1.5.
........
  r2586 | stevenknight | 2008-01-03 08:04:31 -0800 (Thu, 03 Jan 2008) | 3 lines

  Use the new shlex compatibility module if we're using an old version of
  Python with a native shlex module that has no shlex.split() function.
........
  r2587 | stevenknight | 2008-01-03 09:31:15 -0800 (Thu, 03 Jan 2008) | 3 lines

  Fix the ParseFlags() unit test now that we have a real shlex.split()
  function even on earlier Python versions.
........
  r2588 | stevenknight | 2008-01-06 04:52:05 -0800 (Sun, 06 Jan 2008) | 3 lines

  Add compat/_scons_shlex.py to exception lists for __copyright__ and
  __revision__ strings.
........
  r2589 | stevenknight | 2008-01-06 06:32:07 -0800 (Sun, 06 Jan 2008) | 2 lines

  Remove leftover debug print.
........
  r2590 | stevenknight | 2008-01-06 07:35:46 -0800 (Sun, 06 Jan 2008) | 3 lines

  Change the test to work by wrapping the public .__call__() method
  of the C scanner, instead of the internal .scan() method.
........
  r2591 | stevenknight | 2008-01-06 07:39:12 -0800 (Sun, 06 Jan 2008) | 3 lines

  Use the public CScan.path() method, not the internal CScan.path_function
  attribute.
........
  r2592 | stevenknight | 2008-01-07 02:55:53 -0800 (Mon, 07 Jan 2008) | 2 lines

  Use a tuple instead of a list for the cpp module path(s).
........
  r2593 | stevenknight | 2008-01-07 03:10:28 -0800 (Mon, 07 Jan 2008) | 2 lines

  Don't die if a macro function expands to a non-string (an integer).
........
  r2594 | stevenknight | 2008-01-07 03:29:12 -0800 (Mon, 07 Jan 2008) | 3 lines

  Python 1.5 throws TypeError, not AttributeError if you try to
  string.split() a non-string value.
........
  r2595 | stevenknight | 2008-01-07 03:30:18 -0800 (Mon, 07 Jan 2008) | 3 lines

  Reduce duplicate execution of individual test_*() unit test methods
  by eliminating duplicates (if the set() type is avaiable).
........
  r2596 | stevenknight | 2008-01-07 06:57:30 -0800 (Mon, 07 Jan 2008) | 6 lines

  Add a basic test of in-line #include handling.
  Sort the test names.
  Don't os.path.join() the directory name if we
  find the file in the current directory.
  Use os.curdir instead of hard-coding '.' as the current directory.
........
  r2597 | stevenknight | 2008-01-07 06:59:29 -0800 (Mon, 07 Jan 2008) | 3 lines

  Read files with a new .read_file() method, so it can be overridden
  by subclasses.
........
  r2598 | stevenknight | 2008-01-07 17:59:50 -0800 (Mon, 07 Jan 2008) | 6 lines

  Record the name of the file currently being processed.

  Make the public API (the .__call__() method) passing in a file name to
  be opened, and have it call a new, separate .process_contents() method
  (the old .__call__() method) for handling in-memory strings.
........
  r2599 | stevenknight | 2008-01-07 20:03:18 -0800 (Mon, 07 Jan 2008) | 3 lines

  Make the test failure informative when we don't find the includes
  we expect by printing the expected string and actual output.
........
  r2600 | stevenknight | 2008-01-07 20:24:21 -0800 (Mon, 07 Jan 2008) | 2 lines

  Handle no white space after #include (e.g. #include<foo.h>).
........
  r2601 | stevenknight | 2008-01-07 21:01:27 -0800 (Mon, 07 Jan 2008) | 4 lines

  Fixes for older Python versions:
  No tempfile.mktemp(prefix=) argument.
  No string methods.
........
  r2602 | stevenknight | 2008-01-08 20:57:30 -0800 (Tue, 08 Jan 2008) | 3 lines

  Fix command-line editing of --interactive mode with the readline module
  by only changing sys.stdout to our Unbuffered class if it isn't a tty.
........
  r2603 | stevenknight | 2008-01-08 22:12:20 -0800 (Tue, 08 Jan 2008) | 4 lines

  Fix the --interactive "build" command with no targets:  build the
  specified Default() targets; issue an error message but don't exit if
  Default(None) is explicity specified.
........
  r2604 | stevenknight | 2008-01-09 05:00:36 -0800 (Wed, 09 Jan 2008) | 9 lines

  Improve Python functions used as actions by incorporating into their
  build signatures:
      - literal values referenced by the byte code.
      - values of default arguments
      - code of nested functions
      - values of variables captured by closures
      - names of referenced global variables and functions
  (Benoit Belley)
........
  r2605 | stevenknight | 2008-01-09 06:39:03 -0800 (Wed, 09 Jan 2008) | 4 lines

  Add a Configure.Define() method for adding arbitrary #define lines
  to generated configure header files.
  (David Cournapeau)
........
  r2606 | stevenknight | 2008-01-09 07:33:21 -0800 (Wed, 09 Jan 2008) | 4 lines

  Issue 1858:  Fix the closing message when --clean and --keep-going are
  both used so it only reports errors if some actually occurred.
  (Benoit Belley)
........
  r2607 | stevenknight | 2008-01-09 07:51:55 -0800 (Wed, 09 Jan 2008) | 3 lines

  Issue 1843:  Add a gfortran Tool module for the GNU F95/F2003 compiler.
  (David Cournapeau)
........
  r2608 | stevenknight | 2008-01-09 09:31:15 -0800 (Wed, 09 Jan 2008) | 4 lines

  Issue 1733: If $JARCHDIR isn't set explicitly, use the .java_classdir
  attribute that was set when the Java() Builder built the .class files.
  (Jan Nijtmans)
........
  r2609 | stevenknight | 2008-01-09 11:27:28 -0800 (Wed, 09 Jan 2008) | 4 lines

  Allow Scanner.FindPathDirs objects to not take a dir= keyword argument
  when called.  (The code already detects that and uses the current
  directory if necessary.)
........
  r2610 | stevenknight | 2008-01-09 12:23:26 -0800 (Wed, 09 Jan 2008) | 3 lines

  Allow subclass overrides of results-handling by the addition of
  new initialize_result() and finalize_result() methods.
........
  r2611 | stevenknight | 2008-01-09 14:49:50 -0800 (Wed, 09 Jan 2008) | 6 lines

  Capture new C Scanner glue code that knows how to use $CPPDEFINES to
  evaluate CPP #if/#ifdef/#elif/#else lines.  Currently disabled (including
  the test script that validates the behavior) while we look for the right
  way to let users configure the feature, and work on performance issues
  with its O(N*M) algorithm.
........
  r2612 | stevenknight | 2008-01-24 20:42:57 -0800 (Thu, 24 Jan 2008) | 3 lines

  Fix regular expression comparisons on Windows by escaping the \ path
  separators.
........
  r2613 | stevenknight | 2008-01-24 20:49:04 -0800 (Thu, 24 Jan 2008) | 3 lines

  Rename a created stub script from "cmd.py" so it doesn't mistakenly
  get imported by the "import cmd" statement in Script/Interactive.py.
........
  r2614 | stevenknight | 2008-01-24 20:56:05 -0800 (Thu, 24 Jan 2008) | 4 lines

  Fix a race condition between the actions executed by the worker threads
  by having the dependent action print its own execution line, and telling
  SCons to treat it silently (strfunction=None).
........
  r2615 | stevenknight | 2008-01-24 20:59:03 -0800 (Thu, 24 Jan 2008) | 2 lines

  Remove left-over commented-out lines.
........
  r2616 | stevenknight | 2008-01-24 21:59:49 -0800 (Thu, 24 Jan 2008) | 7 lines

  Windows portability in --interactive mode and its tests:

  Quote target names that may have spaces in them.  Use the .exe suffix
  on a generated executable.  Use the subprocess .wait() method to get the
  subprocess exit status when shelling out on Windows.  Use an Unbuffered
  object for stderr (when it's not a tty).
........
  r2617 | stevenknight | 2008-01-24 22:14:49 -0800 (Thu, 24 Jan 2008) | 3 lines

  Issue 1886:  Fix the ability to build Aliases in --interactive mode.
  (Gary Oberbrunner)
........
  r2618 | stevenknight | 2008-01-24 22:33:29 -0800 (Thu, 24 Jan 2008) | 3 lines

  Issue 1886:  Handle Python versions that throw TypeError when they can't
  pickle a nested function.  (Gary Oberbrunner)
........
  r2619 | stevenknight | 2008-01-24 22:38:44 -0800 (Thu, 24 Jan 2008) | 3 lines

  Fix the LoadableModule.py test when run on Intel Macs (look for the
  string i386 in the file output, in addition to ppc).
........
  r2620 | stevenknight | 2008-01-25 06:50:43 -0800 (Fri, 25 Jan 2008) | 4 lines

  Issue 1892:  use "link" instead of "gnulink" for the Mac tool chain,
  since it doesn't understand the -rpath option and can't use $RPATH.
  (David Cournapeau)
........
  r2621 | stevenknight | 2008-01-25 07:51:56 -0800 (Fri, 25 Jan 2008) | 2 lines

  Issue 1893:  add Intel C compiler support on Mac OS X.  (Benoit Belley)
........
  r2622 | stevenknight | 2008-01-25 21:48:16 -0800 (Fri, 25 Jan 2008) | 2 lines

  Fix how we handle falling back to timestamps when no md5.py module exists.
........
  r2623 | stevenknight | 2008-01-26 16:55:56 -0800 (Sat, 26 Jan 2008) | 5 lines

  Work around a metaclass / new.instancemethod() bug in base Python 2.2 by
  disallowing --debug=memoizer functionality if Python can't handle the
  Memoizer initialization (much like we do for earlier Python versions
  that don't have metaclasses at all).
........
  r2624 | stevenknight | 2008-01-26 18:22:14 -0800 (Sat, 26 Jan 2008) | 4 lines

  Fix CacheDir by simplifying how the NullEnvironment hands back something
  that looks enough like a CacheDir object that the rest of the code
  doesn't require special handling.
........
  r2625 | stevenknight | 2008-01-26 20:56:17 -0800 (Sat, 26 Jan 2008) | 2 lines

  Have the "scons-time time" subcommand handle empty files gracefully.
........
  r2626 | stevenknight | 2008-01-26 20:57:21 -0800 (Sat, 26 Jan 2008) | 3 lines

  Add a Trace() statement to the Node.changed() method if the dependency
  lists are different lengths.
........
  r2627 | stevenknight | 2008-01-26 21:30:59 -0800 (Sat, 26 Jan 2008) | 3 lines

  Have the "scons-time time --which" subcommand handle files that don't
  contain the requested results
........
  r2628 | stevenknight | 2008-01-26 21:52:51 -0800 (Sat, 26 Jan 2008) | 2 lines

  Fix the ability to draw vertical bars with --fmt gnuplot option.
........
  r2629 | stevenknight | 2008-01-26 22:23:10 -0800 (Sat, 26 Jan 2008) | 3 lines

  Allow "scons-time run" to copy non-archive files for timing.
  Document the archive_list config file variable.
........
  r2630 | stevenknight | 2008-01-27 10:38:11 -0800 (Sun, 27 Jan 2008) | 3 lines

  Use the maximum Y value, not the maximum X value, as the top Y endpoint
  of a vertical bar drawn with --fmt=gnuplot.
........
  r2631 | stevenknight | 2008-01-27 12:05:40 -0800 (Sun, 27 Jan 2008) | 2 lines

  Make scons-time more robust when handling log files that have no results.
........
  r2632 | stevenknight | 2008-01-27 12:49:02 -0800 (Sun, 27 Jan 2008) | 2 lines

  Rotate label positions so they don't overwrite each other.
........
  r2633 | stevenknight | 2008-01-27 16:21:17 -0800 (Sun, 27 Jan 2008) | 2 lines

  Extend vertical bars to graph top, not maximum X value.
........
  r2634 | stevenknight | 2008-01-27 18:08:19 -0800 (Sun, 27 Jan 2008) | 2 lines

  Capture three configurations for timing various aspects of SCons.
........
  r2635 | stevenknight | 2008-01-28 04:55:12 -0800 (Mon, 28 Jan 2008) | 2 lines

  Fix jar calls to use "tf" instead of "-t -f" for compatibility with Sun.
........
  r2636 | stevenknight | 2008-01-28 12:49:58 -0800 (Mon, 28 Jan 2008) | 6 lines

  Refactor cut-and-paste tempdir_re() function into a common method
  in QMTest/TestSCons_time.py.
  In the refactored code, fix typo of os.path.relpath() where we meant
  os.path.realpath(), so we follow the /tmp -> /private/tmp symlink on
  Mac OS X.
........
  r2637 | stevenknight | 2008-01-28 15:18:14 -0800 (Mon, 28 Jan 2008) | 5 lines

  Apple portability in the test for explicit "No such file" error messages
  from trying to fork()/exec() a non-existent file name.
  Refactor the tests for (non-)expected output in stderr so they're
  informative if they fail.
........
  r2638 | stevenknight | 2008-01-28 17:54:29 -0800 (Mon, 28 Jan 2008) | 3 lines

  Make the test output deterministic by making the InstallAs() targets
  (file[23].out) depend on the Install() target (file1.out).
........
  r2639 | stevenknight | 2008-01-28 21:37:38 -0800 (Mon, 28 Jan 2008) | 4 lines

  On Mac OS X, add -w to LINKFLAGS to suppress warnings about the
  directories we specify as -L arguments which don't actually exist.
  We just want to make sure that the right directory names show up.
........
  r2640 | stevenknight | 2008-01-28 21:38:36 -0800 (Mon, 28 Jan 2008) | 3 lines

  On Mac OS X, the generated include file for C++ just tacks ".h" on the end
  of the generated .cpp file name.  Define $YACCHXXFILESUFFIX accordingly.
........
  r2641 | stevenknight | 2008-01-29 04:56:18 -0800 (Tue, 29 Jan 2008) | 3 lines

  Add the src/CHANGES.txt for the previous change (Mac OS X bison behavior).
  Add a "bison" application entity to the DocBook infrastructure.
........
  r2642 | stevenknight | 2008-01-30 05:09:02 -0800 (Wed, 30 Jan 2008) | 5 lines

  Improve QT tests for Mac OS X:
  More general regular expression match for a "Generated moc file" warning.
  Copy libmyqt.dylib to the same directory as the "aaa" executable so
  it's found when we run it.
........
  r2643 | stevenknight | 2008-01-30 05:19:23 -0800 (Wed, 30 Jan 2008) | 2 lines

  Skip the test of Java handling SWIG dependencies if swig isn't installed.
........
  r2644 | stevenknight | 2008-01-30 06:44:30 -0800 (Wed, 30 Jan 2008) | 2 lines

  Remove left-over print statement.
........
  r2645 | stevenknight | 2008-01-30 06:52:54 -0800 (Wed, 30 Jan 2008) | 2 lines

  Mac OS X fix:  use .dylib, not .so, in the list of "weird suffixes" we test.
........

4 files changed, 596 insertions, 135 deletions

diff --git a/QMTest/TestCmd.py b/QMTest/TestCmd.py
index f5e1c71..8bf054b 100644
--- a/QMTest/TestCmd.py
+++ b/QMTest/TestCmd.py
@@ -181,12 +181,12 @@ version.
 # SUPPORT, UPDATES, ENHANCEMENTS, OR MODIFICATIONS.
 
 __author__ = "Steven Knight <knight at baldmt dot com>"
-__revision__ = "TestCmd.py 0.30.D001 2007/10/01 16:53:55 knight"
-__version__ = "0.30"
+__revision__ = "TestCmd.py 0.31.D001 2008/01/01 09:05:59 knight"
+__version__ = "0.31"
 
+import errno
 import os
 import os.path
-import popen2
 import re
 import shutil
 import stat
@@ -457,6 +457,252 @@ else:
 
     default_sleep_seconds = 1
 
+
+
+try:
+    import subprocess
+except ImportError:
+    # The subprocess module doesn't exist in this version of Python,
+    # so we're going to cobble up something that looks just enough
+    # like its API for our purposes below.
+    import new
+
+    subprocess = new.module('subprocess')
+
+    subprocess.PIPE = 'PIPE'
+    subprocess.STDOUT = 'STDOUT'
+    subprocess.mswindows = (sys.platform == 'win32')
+
+    try:
+        import popen2
+        popen2.Popen3
+    except AttributeError:
+        class Popen3:
+            universal_newlines = 1
+            def __init__(self, command, **kw):
+                if sys.platform == 'win32' and command[0] == '"':
+                    command = '"' + command + '"'
+                (stdin, stdout, stderr) = os.popen3(' ' + command)
+                self.stdin = stdin
+                self.stdout = stdout
+                self.stderr = stderr
+            def close_output(self):
+                self.stdout.close()
+                self.resultcode = self.stderr.close()
+            def wait(self):
+                return self.resultcode
+
+    else:
+        try:
+            popen2.Popen4
+        except AttributeError:
+            # A cribbed Popen4 class, with some retrofitted code from
+            # the Python 1.5 Popen3 class methods to do certain things
+            # by hand.
+            class Popen4(popen2.Popen3):
+                childerr = None
+
+                def __init__(self, cmd, bufsize=-1):
+                    p2cread, p2cwrite = os.pipe()
+                    c2pread, c2pwrite = os.pipe()
+                    self.pid = os.fork()
+                    if self.pid == 0:
+                        # Child
+                        os.dup2(p2cread, 0)
+                        os.dup2(c2pwrite, 1)
+                        os.dup2(c2pwrite, 2)
+                        for i in range(3, popen2.MAXFD):
+                            try:
+                                os.close(i)
+                            except: pass
+                        try:
+                            os.execvp(cmd[0], cmd)
+                        finally:
+                            os._exit(1)
+                        # Shouldn't come here, I guess
+                        os._exit(1)
+                    os.close(p2cread)
+                    self.tochild = os.fdopen(p2cwrite, 'w', bufsize)
+                    os.close(c2pwrite)
+                    self.fromchild = os.fdopen(c2pread, 'r', bufsize)
+                    popen2._active.append(self)
+
+            popen2.Popen4 = Popen4
+
+        class Popen3(popen2.Popen3, popen2.Popen4):
+            universal_newlines = 1
+            def __init__(self, command, **kw):
+                if kw.get('stderr') == 'STDOUT':
+                    apply(popen2.Popen4.__init__, (self, command, 1))
+                else:
+                    apply(popen2.Popen3.__init__, (self, command, 1))
+                self.stdin = self.tochild
+                self.stdout = self.fromchild
+                self.stderr = self.childerr
+
+    subprocess.Popen = Popen3
+
+
+
+# From Josiah Carlson,
+# ASPN : Python Cookbook : Module to allow Asynchronous subprocess use on Windows and Posix platforms
+# http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/440554
+
+PIPE = subprocess.PIPE
+
+if subprocess.mswindows:
+    from win32file import ReadFile, WriteFile
+    from win32pipe import PeekNamedPipe
+    import msvcrt
+else:
+    import select
+    import fcntl
+
+    try:                    fcntl.F_GETFL
+    except AttributeError:  fcntl.F_GETFL = 3
+
+    try:                    fcntl.F_SETFL
+    except AttributeError:  fcntl.F_SETFL = 4
+
+class Popen(subprocess.Popen):
+    def recv(self, maxsize=None):
+        return self._recv('stdout', maxsize)
+
+    def recv_err(self, maxsize=None):
+        return self._recv('stderr', maxsize)
+
+    def send_recv(self, input='', maxsize=None):
+        return self.send(input), self.recv(maxsize), self.recv_err(maxsize)
+
+    def get_conn_maxsize(self, which, maxsize):
+        if maxsize is None:
+            maxsize = 1024
+        elif maxsize < 1:
+            maxsize = 1
+        return getattr(self, which), maxsize
+
+    def _close(self, which):
+        getattr(self, which).close()
+        setattr(self, which, None)
+
+    if subprocess.mswindows:
+        def send(self, input):
+            if not self.stdin:
+                return None
+
+            try:
+                x = msvcrt.get_osfhandle(self.stdin.fileno())
+                (errCode, written) = WriteFile(x, input)
+            except ValueError:
+                return self._close('stdin')
+            except (subprocess.pywintypes.error, Exception), why:
+                if why[0] in (109, errno.ESHUTDOWN):
+                    return self._close('stdin')
+                raise
+
+            return written
+
+        def _recv(self, which, maxsize):
+            conn, maxsize = self.get_conn_maxsize(which, maxsize)
+            if conn is None:
+                return None
+
+            try:
+                x = msvcrt.get_osfhandle(conn.fileno())
+                (read, nAvail, nMessage) = PeekNamedPipe(x, 0)
+                if maxsize < nAvail:
+                    nAvail = maxsize
+                if nAvail > 0:
+                    (errCode, read) = ReadFile(x, nAvail, None)
+            except ValueError:
+                return self._close(which)
+            except (subprocess.pywintypes.error, Exception), why:
+                if why[0] in (109, errno.ESHUTDOWN):
+                    return self._close(which)
+                raise
+
+            #if self.universal_newlines:
+            #    read = self._translate_newlines(read)
+            return read
+
+    else:
+        def send(self, input):
+            if not self.stdin:
+                return None
+
+            if not select.select([], [self.stdin], [], 0)[1]:
+                return 0
+
+            try:
+                written = os.write(self.stdin.fileno(), input)
+            except OSError, why:
+                if why[0] == errno.EPIPE: #broken pipe
+                    return self._close('stdin')
+                raise
+
+            return written
+
+        def _recv(self, which, maxsize):
+            conn, maxsize = self.get_conn_maxsize(which, maxsize)
+            if conn is None:
+                return None
+
+            try:
+                flags = fcntl.fcntl(conn, fcntl.F_GETFL)
+            except TypeError:
+                flags = None
+            else:
+                if not conn.closed:
+                    fcntl.fcntl(conn, fcntl.F_SETFL, flags| os.O_NONBLOCK)
+
+            try:
+                if not select.select([conn], [], [], 0)[0]:
+                    return ''
+
+                r = conn.read(maxsize)
+                if not r:
+                    return self._close(which)
+
+                #if self.universal_newlines:
+                #    r = self._translate_newlines(r)
+                return r
+            finally:
+                if not conn.closed and not flags is None:
+                    fcntl.fcntl(conn, fcntl.F_SETFL, flags)
+
+disconnect_message = "Other end disconnected!"
+
+def recv_some(p, t=.1, e=1, tr=5, stderr=0):
+    if tr < 1:
+        tr = 1
+    x = time.time()+t
+    y = []
+    r = ''
+    pr = p.recv
+    if stderr:
+        pr = p.recv_err
+    while time.time() < x or r:
+        r = pr()
+        if r is None:
+            if e:
+                raise Exception(disconnect_message)
+            else:
+                break
+        elif r:
+            y.append(r)
+        else:
+            time.sleep(max((x-time.time())/tr, 0))
+    return ''.join(y)
+
+def send_all(p, data):
+    while len(data):
+        sent = p.send(data)
+        if sent is None:
+            raise Exception(disconnect_message)
+        data = buffer(data, sent)
+
+
+
 class TestCmd:
     """Class TestCmd
     """
@@ -703,26 +949,17 @@ class TestCmd:
         dir = self.canonicalize(dir)
         os.rmdir(dir)
 
-    def run(self, program = None,
-                  interpreter = None,
-                  arguments = None,
-                  chdir = None,
-                  stdin = None,
-                  universal_newlines = None):
-        """Runs a test of the program or script for the test
-        environment.  Standard output and error output are saved for
-        future retrieval via the stdout() and stderr() methods.
+    def start(self, program = None,
+                    interpreter = None,
+                    arguments = None,
+                    universal_newlines = None,
+                    **kw):
+        """
+        Starts a program or script for the test environment.
 
         The specified program will have the original directory
-        prepending unless it is enclosed in a [list].
+        prepended unless it is enclosed in a [list].
         """
-        if chdir:
-            oldcwd = os.getcwd()
-            if not os.path.isabs(chdir):
-                chdir = os.path.join(self.workpath(chdir))
-            if self.verbose:
-                sys.stderr.write("chdir(" + chdir + ")\n")
-            os.chdir(chdir)
         if program:
             if type(program) == type('') and not os.path.isabs(program):
                 program = os.path.join(self._cwd, program)
@@ -747,38 +984,56 @@ class TestCmd:
         if universal_newlines is None:
             universal_newlines = self.universal_newlines
 
-        try:
-            import subprocess
-        except ImportError:
-            try:
-                Popen3 = popen2.Popen3
-            except AttributeError:
-                class Popen3:
-                    def __init__(self, command):
-                        (stdin, stdout, stderr) = os.popen3(' ' + command)
-                        self.stdin = stdin
-                        self.stdout = stdout
-                        self.stderr = stderr
-                    def close_output(self):
-                        self.stdout.close()
-                        self.resultcode = self.stderr.close()
-                    def wait(self):
-                        return self.resultcode
-                if sys.platform == 'win32' and cmd_string[0] == '"':
-                    cmd_string = '"' + cmd_string + '"'
-                p = Popen3(cmd_string)
-            else:
-                p = Popen3(cmd, 1)
-                p.stdin = p.tochild
-                p.stdout = p.fromchild
-                p.stderr = p.childerr
+        combine = kw.get('combine', self.combine)
+        if combine:
+            stderr_value = subprocess.STDOUT
         else:
-            p = subprocess.Popen(cmd,
-                                 stdin=subprocess.PIPE,
-                                 stdout=subprocess.PIPE,
-                                 stderr=subprocess.PIPE,
-                                 universal_newlines=universal_newlines)
+            stderr_value = subprocess.PIPE
+
+        return Popen(cmd,
+                     stdin=subprocess.PIPE,
+                     stdout=subprocess.PIPE,
+                     stderr=stderr_value,
+                     universal_newlines=universal_newlines)
 
+    def finish(self, popen, **kw):
+        """
+        Finishes and waits for the process being run under control of
+        the specified popen argument, recording the exit status,
+        standard output and error output.
+        """
+        popen.stdin.close()
+        self.status = popen.wait()
+        if not self.status:
+            self.status = 0
+        self._stdout.append(popen.stdout.read())
+        if popen.stderr:
+            stderr = popen.stderr.read()
+        else:
+            stderr = ''
+        self._stderr.append(stderr)
+
+    def run(self, program = None,
+                  interpreter = None,
+                  arguments = None,
+                  chdir = None,
+                  stdin = None,
+                  universal_newlines = None):
+        """Runs a test of the program or script for the test
+        environment.  Standard output and error output are saved for
+        future retrieval via the stdout() and stderr() methods.
+
+        The specified program will have the original directory
+        prepended unless it is enclosed in a [list].
+        """
+        if chdir:
+            oldcwd = os.getcwd()
+            if not os.path.isabs(chdir):
+                chdir = os.path.join(self.workpath(chdir))
+            if self.verbose:
+                sys.stderr.write("chdir(" + chdir + ")\n")
+            os.chdir(chdir)
+        p = self.start(program, interpreter, arguments, universal_newlines)
         if stdin:
             if is_List(stdin):
                 for line in stdin:
@@ -788,23 +1043,26 @@ class TestCmd:
         p.stdin.close()
 
         out = p.stdout.read()
-        err = p.stderr.read()
+        if p.stderr is None:
+            err = ''
+        else:
+            err = p.stderr.read()
         try:
-            p.close_output()
+            close_output = p.close_output
         except AttributeError:
             p.stdout.close()
-            p.stderr.close()
+            if not p.stderr is None:
+                p.stderr.close()
+        else:
+            close_output()
+
+        self._stdout.append(out)
+        self._stderr.append(err)
 
         self.status = p.wait()
         if not self.status:
             self.status = 0
 
-        if self.combine:
-            self._stdout.append(out + err)
-        else:
-            self._stdout.append(out)
-            self._stderr.append(err)
-
         if chdir:
             os.chdir(oldcwd)
         if self.verbose >= 2:
@@ -990,18 +1248,24 @@ class TestCmd:
     def readable(self, top, read=1):
         """Make the specified directory tree readable (read == 1)
         or not (read == None).
+
+        This method has no effect on Windows systems, which use a
+        completely different mechanism to control file readability.
         """
 
+        if sys.platform == 'win32':
+            return
+
         if read:
             def do_chmod(fname):
                 try: st = os.stat(fname)
                 except OSError: pass
-                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]|0400))
+                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]|stat.S_IREAD))
         else:
             def do_chmod(fname):
                 try: st = os.stat(fname)
                 except OSError: pass
-                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]&~0400))
+                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]&~stat.S_IREAD))
 
         if os.path.isfile(top):
             # If it's a file, that's easy, just chmod it.
@@ -1040,16 +1304,29 @@ class TestCmd:
         or not (write == None).
         """
 
-        if write:
-            def do_chmod(fname):
-                try: st = os.stat(fname)
-                except OSError: pass
-                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]|0200))
+        if sys.platform == 'win32':
+
+            if write:
+                def do_chmod(fname):
+                    try: os.chmod(fname, stat.S_IWRITE)
+                    except OSError: pass
+            else:
+                def do_chmod(fname):
+                    try: os.chmod(fname, stat.S_IREAD)
+                    except OSError: pass
+
         else:
-            def do_chmod(fname):
-                try: st = os.stat(fname)
-                except OSError: pass
-                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]&~0200))
+
+            if write:
+                def do_chmod(fname):
+                    try: st = os.stat(fname)
+                    except OSError: pass
+                    else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]|0200))
+            else:
+                def do_chmod(fname):
+                    try: st = os.stat(fname)
+                    except OSError: pass
+                    else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]&~0200))
 
         if os.path.isfile(top):
             do_chmod(top)
@@ -1061,18 +1338,24 @@ class TestCmd:
     def executable(self, top, execute=1):
         """Make the specified directory tree executable (execute == 1)
         or not (execute == None).
+
+        This method has no effect on Windows systems, which use a
+        completely different mechanism to control file executability.
         """
 
+        if sys.platform == 'win32':
+            return
+
         if execute:
             def do_chmod(fname):
                 try: st = os.stat(fname)
                 except OSError: pass
-                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]|0100))
+                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]|stat.S_IEXEC))
         else:
             def do_chmod(fname):
                 try: st = os.stat(fname)
                 except OSError: pass
-                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]&~0100))
+                else: os.chmod(fname, stat.S_IMODE(st[stat.ST_MODE]&~stat.S_IEXEC))
 
         if os.path.isfile(top):
             # If it's a file, that's easy, just chmod it.
diff --git a/QMTest/TestCommon.py b/QMTest/TestCommon.py
index d6b21ad..acc63d4 100644
--- a/QMTest/TestCommon.py
+++ b/QMTest/TestCommon.py
@@ -84,9 +84,10 @@ The TestCommon module also provides the following variables
 # SUPPORT, UPDATES, ENHANCEMENTS, OR MODIFICATIONS.
 
 __author__ = "Steven Knight <knight at baldmt dot com>"
-__revision__ = "TestCommon.py 0.30.D001 2007/10/01 16:53:55 knight"
-__version__ = "0.30"
+__revision__ = "TestCommon.py 0.31.D001 2008/01/01 09:05:59 knight"
+__version__ = "0.31"
 
+import copy
 import os
 import os.path
 import stat
@@ -378,6 +379,97 @@ class TestCommon(TestCmd):
             print "Writable files: `%s'" % string.join(writable, "', `")
         self.fail_test(missing + writable)
 
+    def _complete(self, actual_stdout, expected_stdout,
+                        actual_stderr, expected_stderr, status, match):
+        """
+        Post-processes running a subcommand, checking for failure
+        status and displaying output appropriately.
+        """
+        if _failed(self, status):
+            expect = ''
+            if status != 0:
+                expect = " (expected %s)" % str(status)
+            print "%s returned %s%s" % (self.program, str(_status(self)), expect)
+            print self.banner('STDOUT ')
+            print actual_stdout
+            print self.banner('STDERR ')
+            print actual_stderr
+            self.fail_test()
+        if not expected_stdout is None and not match(actual_stdout, expected_stdout):
+            self.diff(expected_stdout, actual_stdout, 'STDOUT ')
+            if actual_stderr:
+                print self.banner('STDERR ')
+                print actual_stderr
+            self.fail_test()
+        if not expected_stderr is None and not match(actual_stderr, expected_stderr):
+            print self.banner('STDOUT ')
+            print actual_stdout
+            self.diff(expected_stderr, actual_stderr, 'STDERR ')
+            self.fail_test()
+
+    def start(self, program = None,
+                    interpreter = None,
+                    arguments = None,
+                    universal_newlines = None,
+                    **kw):
+        """
+        Starts a program or script for the test environment.
+
+        This handles the "options" keyword argument and exceptions.
+        """
+        try:
+            options = kw['options']
+            del kw['options']
+        except KeyError:
+            pass
+        else:
+            if options:
+                if arguments is None:
+                    arguments = options
+                else:
+                    arguments = options + " " + arguments
+        try:
+            return apply(TestCmd.start,
+                         (self, program, interpreter, arguments, universal_newlines),
+                         kw)
+        except KeyboardInterrupt:
+            raise
+        except Exception, e:
+            print self.banner('STDOUT ')
+            try:
+                print self.stdout()
+            except IndexError:
+                pass
+            print self.banner('STDERR ')
+            try:
+                print self.stderr()
+            except IndexError:
+                pass
+            raise e
+
+    def finish(self, popen, stdout = None, stderr = '', status = 0, **kw):
+        """
+        Finishes and waits for the process being run under control of
+        the specified popen argument.  Additional arguments are similar
+        to those of the run() method:
+
+                stdout  The expected standard output from
+                        the command.  A value of None means
+                        don't test standard output.
+
+                stderr  The expected error output from
+                        the command.  A value of None means
+                        don't test error output.
+
+                status  The expected exit status from the
+                        command.  A value of None means don't
+                        test exit status.
+        """
+        apply(TestCmd.finish, (self, popen,), kw)
+        match = kw.get('match', self.match)
+        self._complete(self.stdout(), stdout,
+                       self.stderr(), stderr, status, match)
+
     def run(self, options = None, arguments = None,
                   stdout = None, stderr = '', status = 0, **kw):
         """Runs the program under test, checking that the test succeeded.
@@ -415,44 +507,9 @@ class TestCommon(TestCmd):
             del kw['match']
         except KeyError:
             match = self.match
-        try:
-            apply(TestCmd.run, [self], kw)
-        except KeyboardInterrupt:
-            raise
-        except Exception, e:
-            print self.banner('STDOUT ')
-            try:
-                print self.stdout()
-            except IndexError:
-                pass
-            print self.banner('STDERR ')
-            try:
-                print self.stderr()
-            except IndexError:
-                pass
-            raise e
-        if _failed(self, status):
-            expect = ''
-            if status != 0:
-                expect = " (expected %s)" % str(status)
-            print "%s returned %s%s" % (self.program, str(_status(self)), expect)
-            print self.banner('STDOUT ')
-            print self.stdout()
-            print self.banner('STDERR ')
-            print self.stderr()
-            self.fail_test()
-        if not stdout is None and not match(self.stdout(), stdout):
-            self.diff(stdout, self.stdout(), 'STDOUT ')
-            stderr = self.stderr()
-            if stderr:
-                print self.banner('STDERR ')
-                print stderr
-            self.fail_test()
-        if not stderr is None and not match(self.stderr(), stderr):
-            print self.banner('STDOUT ')
-            print self.stdout()
-            self.diff(stderr, self.stderr(), 'STDERR ')
-            self.fail_test()
+        apply(TestCmd.run, [self], kw)
+        self._complete(self.stdout(), stdout,
+                       self.stderr(), stderr, status, match)
 
     def skip_test(self, message="Skipping test.\n"):
         """Skips a test.
diff --git a/QMTest/TestSCons.py b/QMTest/TestSCons.py
index b1fdbc1..6b6f5ed 100644
--- a/QMTest/TestSCons.py
+++ b/QMTest/TestSCons.py
@@ -21,6 +21,7 @@ import os.path
 import re
 import string
 import sys
+import time
 
 import __builtin__
 try:
@@ -138,7 +139,6 @@ def re_escape(str):
     return str
 
 
-
 class TestSCons(TestCommon):
     """Class for testing SCons.
 
@@ -337,8 +337,8 @@ class TestSCons(TestCommon):
         return x
 
     def normalize_pdf(self, s):
-        s = re.sub(r'/CreationDate \(D:[^)]*\)',
-                   r'/CreationDate (D:XXXX)', s)
+        s = re.sub(r'/(Creation|Mod)Date \(D:[^)]*\)',
+                   r'/\1Date (D:XXXX)', s)
         s = re.sub(r'/ID \[<[0-9a-fA-F]*> <[0-9a-fA-F]*>\]',
                    r'/ID [<XXXX> <XXXX>]', s)
         s = re.sub(r'/(BaseFont|FontName) /[A-Z]{6}',
@@ -381,33 +381,114 @@ class TestSCons(TestCommon):
 
         return s
 
-    def java_ENV(self):
+    def java_ENV(self, version=None):
         """
-        Return a default external environment that uses a local Java SDK
-        in preference to whatever's found in the default PATH.
+        Initialize with a default external environment that uses a local
+        Java SDK in preference to whatever's found in the default PATH.
         """
+        try:
+            return self._java_env[version]['ENV']
+        except AttributeError:
+            self._java_env = {}
+        except KeyError:
+            pass
+
         import SCons.Environment
         env = SCons.Environment.Environment()
-        java_path = [
-            '/usr/local/j2sdk1.4.2/bin',
-            '/usr/local/j2sdk1.4.1/bin',
-            '/usr/local/j2sdk1.3.1/bin',
-            '/usr/local/j2sdk1.3.0/bin',
-            '/usr/local/j2sdk1.2.2/bin',
-            '/usr/local/j2sdk1.2/bin',
-            '/usr/local/j2sdk1.1.8/bin',
-            '/usr/local/j2sdk1.1.7/bin',
-            '/usr/local/j2sdk1.1.6/bin',
-            '/usr/local/j2sdk1.1.5/bin',
-            '/usr/local/j2sdk1.1.4/bin',
-            '/usr/local/j2sdk1.1.3/bin',
-            '/usr/local/j2sdk1.1.2/bin',
-            '/usr/local/j2sdk1.1.1/bin',
-            env['ENV']['PATH'],
-        ]
+        self._java_env[version] = env
+
+        def paths(patterns):
+            import glob
+            result = []
+            for p in patterns:
+                paths = glob.glob(p)
+                paths.sort()
+                result.extend(paths)
+            return result
+
+        if version:
+            patterns = [
+                '/usr/lib/jvm/*-%s*/bin' % version,
+                '/usr/local/j2sdk%s*/bin' % version,
+            ]
+            java_path = paths(patterns) + [env['ENV']['PATH']]
+        else:
+            patterns = [
+                '/usr/lib/jvm/*/bin',
+                '/usr/local/j2sdk*/bin',
+            ]
+            java_path = paths(patterns) + [env['ENV']['PATH']]
+
         env['ENV']['PATH'] = string.join(java_path, os.pathsep)
         return env['ENV']
 
+    def java_where_jar(self, version=None):
+        ENV = self.java_ENV(version)
+        if self.detect_tool('jar', ENV=ENV):
+            where_jar = self.detect('JAR', 'jar', ENV=ENV)
+        else:
+            where_jar = self.where_is('jar', ENV['PATH'])
+        if not where_jar:
+            self.skip_test("Could not find Java jar, skipping test(s).\n")
+        return where_jar
+
+    def java_where_java(self, version=None):
+        """
+        Return a path to the java executable.
+        """
+        ENV = self.java_ENV(version)
+        where_java = self.where_is('java', ENV['PATH'])
+        if not where_java:
+            self.skip_test("Could not find Java java, skipping test(s).\n")
+        return where_java
+
+    def java_where_javac(self, version=None):
+        """
+        Return a path to the javac compiler.
+        """
+        ENV = self.java_ENV(version)
+        if self.detect_tool('javac'):
+            where_javac = self.detect('JAVAC', 'javac', ENV=ENV)
+        else:
+            where_javac = self.where_is('javac', ENV['PATH'])
+        if not where_javac:
+            self.skip_test("Could not find Java javac, skipping test(s).\n")
+        self.run(program = where_javac,
+                 arguments = '-version',
+                 stderr=None,
+                 status=None)
+        if version:
+            if string.find(self.stderr(), 'javac %s' % version) == -1:
+                fmt = "Could not find javac for Java version %s, skipping test(s).\n"
+                self.skip_test(fmt % version)
+        else:
+            m = re.search(r'javac (\d\.\d)', self.stderr())
+            if m:
+                version = m.group(1)
+            else:
+                version = None
+        return where_javac, version
+
+    def java_where_javah(self, version=None):
+        ENV = self.java_ENV(version)
+        if self.detect_tool('javah'):
+            where_javah = self.detect('JAVAH', 'javah', ENV=ENV)
+        else:
+            where_javah = self.where_is('javah', ENV['PATH'])
+        if not where_javah:
+            self.skip_test("Could not find Java javah, skipping test(s).\n")
+        return where_javah
+
+    def java_where_rmic(self, version=None):
+        ENV = self.java_ENV(version)
+        if self.detect_tool('rmic'):
+            where_rmic = self.detect('RMIC', 'rmic', ENV=ENV)
+        else:
+            where_rmic = self.where_is('rmic', ENV['PATH'])
+        if not where_rmic:
+            self.skip_test("Could not find Java rmic, skipping non-simulated test(s).\n")
+        return where_rmic
+
     def Qt_dummy_installation(self, dir='qt'):
         # create a dummy qt installation
 
@@ -840,6 +921,22 @@ print "self._msvs_versions =", str(env['MSVS']['VERSIONS'])
         else:
             return distutils.sysconfig.get_python_inc()
 
+    def wait_for(self, fname, timeout=10.0, popen=None):
+        """
+        Waits for the specified file name to exist.
+        """
+        waited = 0.0
+        while not os.path.exists(fname):
+            if timeout and waited >= timeout:
+                sys.stderr.write('timed out waiting for %s to exist\n' % fname)
+                if popen:
+                    popen.stdin.close()
+                    self.status = 1
+                    self.finish(popen)
+                self.fail_test()
+            time.sleep(1.0)
+            waited = waited + 1.0
+
 # In some environments, $AR will generate a warning message to stderr
 # if the library doesn't previously exist and is being created.  One
 # way to fix this is to tell AR to be quiet (sometimes the 'c' flag),
diff --git a/QMTest/TestSCons_time.py b/QMTest/TestSCons_time.py
index 102181e..f3ea49a 100644
--- a/QMTest/TestSCons_time.py
+++ b/QMTest/TestSCons_time.py
@@ -246,6 +246,30 @@ class TestSCons_time(TestCommon):
         self.write(python_name, profile_py % d)
         self.run(program = python_name, interpreter = sys.executable)
 
+    def tempdir_re(self, *args):
+        """
+        Returns a regular expression to match a scons-time
+        temporary directory.
+        """
+        import re
+        import tempfile
+
+        sep = re.escape(os.sep)
+        tempdir = tempfile.gettempdir()
+
+        try:
+            realpath = os.path.realpath
+        except AttributeError:
+            pass
+        else:
+            tempdir = realpath(tempdir)
+
+        args = (tempdir, 'scons-time-',) + args
+        x = apply(os.path.join, args)
+        x = re.escape(x)
+        x = string.replace(x, 'time\\-', 'time\\-[^%s]*' % sep)
+        return x
+
     def write_fake_aegis_py(self, name):
         name = self.workpath(name)
         self.write(name, aegis_py)