Test issues

["Vin Shelton" <acs@alumni.princeton.edu>]

Greetings -

I'd like to bring up a few issues with the test scripts:

1. Since yesterday, the A04 test has been failing on my linux systems
at home (kubuntu) and at work (RHEL).  Here's the tail of
'ZTST_verbose=3 TESTNUM=A04 make test':

Running test: Using {fdvar}> syntax to open a new file descriptor
ZTST_test: expecting status: 0
Input: /tmp/zsh.ztst.in.26465, output: /tmp/zsh.ztst.out.26465, error:
/tmp/zsh.ztst.terr.26465
make: [test] Error 127 (ignored)

Please let me know if you need more diagnostic input.

2. Peter, thanks for implementing the multibyte test.  There's a very
minor typo:

Index: Test/D07multibyte.ztst
===================================================================
RCS file: /cvsroot/zsh/zsh/Test/D07multibyte.ztst,v
retrieving revision 1.5
diff -u -r1.5 D07multibyte.ztst
--- Test/D07multibyte.ztst      10 Jul 2006 13:08:24 -0000      1.5
+++ Test/D07multibyte.ztst      11 Jul 2006 14:17:52 -0000
@@ -12,7 +12,7 @@
     fi
   done
   if [[ -z $mb_ok ]]; then
-    ZTST_unimplemented="no UTF-8 locale or multibyte mode is not implemnted"
+    ZTST_unimplemented="no UTF-8 locale or multibyte mode is not implemented"
   else
     print Testing multibyte with locale $LANG >&8
   fi

3. Is there a relliable way to get the number of test failures?  In
case #1 above, the output of 'make check' looks like this:

/usr/local/src/zsh-2006-07-11/Test/A03quoting.ztst: starting.
/usr/local/src/zsh-2006-07-11/Test/A03quoting.ztst: all tests successful.
/usr/local/src/zsh-2006-07-11/Test/A04redirect.ztst: starting.
/usr/local/src/zsh-2006-07-11/Test/A05execution.ztst: starting.
/usr/local/src/zsh-2006-07-11/Test/A05execution.ztst: all tests successful.

Note that there's no failure message printed for A04.  What I'm
currently doing is using 'grep -c' to count 'starting' and then
counting 'skipped' and 'successful'.  Currently, my math looks like
this: #failures = #starts - #successful - #skipped.  Is there a better
way?

Peter - I think the test suite is very helpful - thanks for creating it!

Thanks,
  Vin

-- 
Whoever you are, no matter how lonely,
the world offers itself to your imagination,
calls to you like the wild geese, harsh and exciting--
over and over announcing your place
in the family of things.			Mary Oliver