reid 2001/04/07 12:09:24 PDT Modified files: src/unix configure configure.in Added files: tests .cvsignore runstdtest testScript.in tests/demos Loaded.output tests/libs Addr.input Addr.output FixIO.input FixIO.lhs FixIO.output HugsLibs.output Loaded.output complex1.input complex1.output intTest.hs intTest.input intTest.output list1.hs list1.input list1.output system1.hs system1.input system1.output tests/misc DictHW.hs T1.hs T4.hs T6.hs gc.hs gc1.input gc1.output gc2.input gc2.output ioerror1.hs ioerror1.input ioerror1.output ioerror2.hs ioerror2.input ioerror2.output iohandle.hs iohandle.input iohandle.output iohandle.tst mutvars.hs mutvars.input mutvars.output mvar.hs mvar.input mvar.output ptrEq.hs ptrEq.input ptrEq.output refs.hs refs.input refs.output runst.hs testDebug.hs testcvar.hs unwritable.tst tests/rts arith.hs arith.input arith.output array1.input array1.output array2.hs array2.input array2.output arrayEx.hs arrayEx.input arrayEx.output arrayt.hs bignums.hs bignums.input bignums.output catch.hs catch.input catch.output catch2.hs catch2.output enum.hs enum.input enum.output enum.output1 enum.output2 infix.hs infix.input infix.output maxint.hs maxint.input maxint.output ord.hs ord.input ord.output print.hs print.input print1.output print2.output read.hs read.input read.output testlist.hs testlist.input testlist.output tests/static Loaded.output T1.hs T2.hs T2.output T3.hs T3.output T6.hs T7.hs export1.hs export1.output mod1.hs mod1.output mod10.hs mod10.output mod11.hs mod11.output mod12.hs mod12.output mod13.hs mod13.output mod14.hs mod14.output mod15.hs mod15.output mod16.hs mod16.output mod17.hs mod17.output mod18.hs mod18.output mod19.hs mod19.output mod2.hs mod2.output mod20.hs mod20.output mod21.hs mod21.output mod22.hs mod22.output mod23.hs mod23.output mod24.hs mod24.output mod25.hs mod25.output mod26.hs mod26.output mod27.hs mod27.output mod28.hs mod28.output mod29.hs mod29.output mod3.hs mod3.output mod30.hs mod30.output mod31.hs mod31.output mod32.hs mod32.output mod33.hs mod33.output mod34.hs mod34.output mod35.hs mod35.output mod36.hs mod36.output mod37.hs mod37.output mod38.hs mod38.output mod39.hs mod39.output mod4.hs mod4.output mod40.hs mod40.output mod41.hs mod41.output mod42.hs mod42.output mod43.hs mod43.output mod44.hs mod44.output mod45.hs mod45.output mod46.hs mod46.output mod47.hs mod47.output mod48.hs mod48.output mod49.hs mod49.output mod5.hs mod5.output mod50.hs mod50.output mod51.hs mod51.output mod52.hs mod52.output mod53.hs mod53.output mod54.hs mod54.output mod55.hs mod55.output mod56.hs mod56.output mod57.hs mod57.output mod58.hs mod58.output mod59.hs mod59.output mod6.hs mod6.output mod60.hs mod60.output mod61.hs mod61.output mod62.hs mod62.output mod63.hs mod63.output mod64.hs mod64.output mod65.hs mod65.output mod66.hs mod66.output mod67.hs mod67.output mod68.hs mod68.output mod69.hs mod69.output mod7.hs mod7.output mod70.hs mod70.output mod71.hs mod71.output mod72.hs mod72.output mod73.hs mod73.output mod74.hs mod74.output mod75.hs mod75.output mod76.hs mod76.output mod77.hs mod77.output mod78.hs mod78.output mod79.hs mod79.output mod8.hs mod8.output mod80.hs mod80.output mod81.hs mod81.output mod82.hs mod82.output mod83.hs mod83.output mod84.hs mod84.output mod85.hs mod85.output mod86.hs mod86.output mod87.hs mod87.output mod88.hs mod88.output mod89.hs mod89.output mod9.hs mod9.output mod90.hs mod90.output mod91.hs mod91.output mod92.hs mod92.output mod93.hs mod93.output mod94.hs mod94.output mod95.hs mod95.output mod96.hs mod96.output mod97.hs mod97.output mod98.hs mod98.output qual1.hs qual1.output qual2.hs qual2.output qual3.hs qual3.output qual4.hs qual4.output qual5.hs qual5.output syntax.hs syntax.output tests/tcheck DictHW.input DictHW.output DictHW1.hs DictHW2.hs TyErr.hs TyErr.output dicts.hs dicts.input dicts.output monad.hs monad.output ty1.hs ty1.output ty2.hs ty2.output types.hs types.output Log: Added the old testsuite from the Yale releases. Beats me why this was deleted from the OGI release. What were they thinking? To run tests: cd hugs98/src/unix ./configure cd .. make hugs cd ../tests sh ./testScript static tcheck rts libs demos Once you get bored of seeing all the successful tests (yahoo!), you can use this to restrict output to the failures: sh ./testScript static tcheck rts libs demos | grep -v '^--' [If I remember correctly, configuring with readline doesn't work. Also note that you have to rerun configure to build tests/testScript.] About the test harness ~~~~~~~~~~~~~~~~~~~~~~ The test harness is very portable. It even runs on Windows though you have to install perl and cygwin to be able to run the tests. The core of the test harness is the program runstdtest - a hacked up version of a similar script from the GHC distro. This runs Hugs over some input and compares the output against a file containing the "correct" output. Hugs generates a bunch of noise (banners, list of modules being loaded, etc.) before generating the interesting part of the output so we tell runstdtest to ignore the first N lines of output using the -s<N> flag. If you change the length of the banner or the module structure you will have to change all these -s flags (this is a bit tedious - better solutions welcome). About the test suite ~~~~~~~~~~~~~~~~~~~~ The testsuite itself is a little out of date. There was a time when it checked every single error in static.c but this is probably not true now. In particular, there are no tests which check the +98 errors. I have updated the sample output files to match current output except in cases where it wasn't clear if the current output was an error or intended behaviour. Here's a list of the potential errors that may need to be fixed. ---------------------------------------------------------------- Hugs used to detect an error in static/mod39.hs and no longer does. I don't know if this is kosher. ./../src/hugs +q -pHugs: static/mod39.hs < /dev/null expected stdout not matched by reality *** static/mod39.output Fri Apr 6 18:05:40 2001 --- /tmp/runtest14605.3 Sat Apr 7 12:18:34 2001 *************** *** 1,2 **** ! ERROR static/mod39.hs:3 - Illegal constraints on class variable "a" in type of member function "f" Hugs:[Leaving Hugs] --- 1,6 ---- ! ! Hugs session for: ! ../lib/Prelude.hs ! static/mod39.hs ! Type :? for help Hugs:[Leaving Hugs] ---------------------------------------------------------------- Parentheses have been added in this error message. I guess that's ok. ./../src/hugs +q -pHugs: static/mod61.hs < /dev/null expected stdout not matched by reality *** static/mod61.output Fri Apr 6 18:05:40 2001 --- /tmp/runtest14914.3 Sat Apr 7 12:18:38 2001 *************** *** 1,2 **** ! ERROR static/mod61.hs:3 - Ambiguous use of operator "==" with "==" Hugs:[Leaving Hugs] --- 1,2 ---- ! ERROR static/mod61.hs:3 - Ambiguous use of operator "(==)" with "(==)" Hugs:[Leaving Hugs] ---------------------------------------------------------------- Hugs used to report an error in mod75.hs. This module refers to a local variable by its qualified name. I'm not sure if this is legal in Haskell'98 ./../src/hugs +q -pHugs: static/mod75.hs < /dev/null expected stdout not matched by reality *** static/mod75.output Fri Apr 6 18:05:40 2001 --- /tmp/runtest15111.3 Sat Apr 7 12:18:41 2001 *************** *** 1,2 **** ! ERROR static/mod75.hs:3 - Undefined qualified variable "M.f" Hugs:[Leaving Hugs] --- 1,6 ---- ! ! Hugs session for: ! ../lib/Prelude.hs ! static/mod75.hs ! Type :? for help Hugs:[Leaving Hugs] ---------------------------------------------------------------- tcheck/DictHW{1,2}.hs and tcheck/DictHW.input check for an old (fixed) error in the manipulation of dictHw when a module compilation aborts due to a type error. I'm a little surprised by the change in the error message. It doesn't look like unresolved top-level overloading to me. It looks like Int not being an instance of Fractional. ./../src/hugs -w +q -pHugs: < tcheck/DictHW.input expected stdout not matched by reality *** tcheck/DictHW.output Sat Apr 7 12:05:25 2001 --- /tmp/runtest15588.3 Sat Apr 7 12:18:49 2001 *************** *** 1,3 **** Hugs:Hugs:Reading file "DictHW.hs": ! ERROR DictHW.hs:4 - Int is not an instance of class "Fractional" Hugs:Hugs:Reading file "DictHW.hs": --- 1,6 ---- Hugs:Hugs:Reading file "DictHW.hs": ! ERROR DictHW.hs:4 - Unresolved top-level overloading ! *** Binding : g ! *** Outstanding context : Fractional Int ! Hugs:Hugs:Reading file "DictHW.hs": ---------------------------------------------------------------- If you use "show" to print data constructors, you get the expected output: True, False, Just 42, etc. But if you use the builtin printer ('hugs -u' or in error messages), the constructors are prefixed by the name of the type: Bool_True, Bool_False, Maybe_Just 42, etc. Is this better? Do we want this behaviour in both the generic printer and in error messages? Do we care? ./../src/hugs +q -pHugs: -u rts/print.hs < rts/print.input expected stdout not matched by reality *** rts/print1.output Fri Oct 10 14:45:19 1997 --- /tmp/runtest15633.3 Sat Apr 7 12:18:51 2001 *************** *** 60,63 **** Hugs:[1] ! Hugs:True ! Hugs:False Hugs:('a','b') --- 60,63 ---- Hugs:[1] ! Hugs:Bool_True ! Hugs:Bool_False Hugs:('a','b') *************** *** 67,72 **** ! Hugs:R 1 ! Hugs:L 'a' ! Hugs:J True ! Hugs:N Hugs:[Leaving Hugs] --- 67,72 ---- ! Hugs:E_R 1 ! Hugs:E_L 'a' ! Hugs:M_J Bool_True ! Hugs:M_N Hugs:[Leaving Hugs] --!!! Testing top level printer (note that this doesn't necessarily test show) ./../src/hugs +q -pHugs: -u -f rts/print.hs < rts/print.input expected stdout not matched by reality *** rts/print2.output Tue Apr 21 16:20:03 1998 --- /tmp/runtest15648.3 Sat Apr 7 12:18:52 2001 *************** *** 39,42 **** Hugs:[1] ! Hugs:True ! Hugs:False Hugs:('a','b') --- 39,42 ---- Hugs:[1] ! Hugs:Bool_True ! Hugs:Bool_False Hugs:('a','b') *************** *** 44,49 **** Hugs:(1,{error "foo"},3) ! Hugs:R 1 ! Hugs:L 'a' ! Hugs:J True ! Hugs:N Hugs:[Leaving Hugs] --- 44,49 ---- Hugs:(1,{error "foo"},3) ! Hugs:E_R 1 ! Hugs:E_L 'a' ! Hugs:M_J Bool_True ! Hugs:M_N Hugs:[Leaving Hugs] --!!! Testing top level printer (note that this doesn't necessarily test show) ./../src/hugs +q -pHugs: -u rts/enum.hs < rts/enum.input expected stdout not matched by reality *** rts/enum.output1 Fri Apr 6 20:16:12 2001 --- /tmp/runtest15663.3 Sat Apr 7 12:18:53 2001 *************** *** 9,14 **** Hugs: ! Program error: {_ToEnum C1 (-1)} Hugs: ! Program error: {_ToEnum C1 7} --- 9,14 ---- Hugs: ! Program error: {_ToEnum T_C1 (-1)} Hugs: ! Program error: {_ToEnum T_C1 7} *************** *** 17,22 **** Hugs: ! Program error: {_ToEnum C1 7} Hugs: ! Program error: {_ToEnum C1 (-1)} --- 17,22 ---- Hugs: ! Program error: {_ToEnum T_C1 7} Hugs: ! Program error: {_ToEnum T_C1 (-1)} --!!! Testing Enum ./../src/hugs +q -pHugs: -u rts/infix.hs < rts/infix.input expected stdout not matched by reality *** rts/infix.output Fri Oct 10 14:43:41 1997 --- /tmp/runtest15678.3 Sat Apr 7 12:18:53 2001 *************** *** 1,2 **** ! Hugs:Scale (Note :+: Note) Hugs:"Scale (Note :+: Note)" --- 1,2 ---- ! Hugs:Music_Scale (Music_Note Music_:+: Music_Note) Hugs:"Scale (Note :+: Note)" --!!! Testing the printing of infix constructors ./../src/hugs +q -pHugs: +u rts/enum.hs < rts/enum.input expected stdout not matched by reality *** rts/enum.output2 Fri Apr 6 20:15:15 2001 --- /tmp/runtest15693.3 Sat Apr 7 12:18:54 2001 *************** *** 9,14 **** Hugs:" ! Program error: {_ToEnum C1 (-1)} Hugs:" ! Program error: {_ToEnum C1 7} --- 9,14 ---- Hugs:" ! Program error: {_ToEnum T_C1 (-1)} Hugs:" ! Program error: {_ToEnum T_C1 7} *************** *** 17,22 **** Hugs:" ! Program error: {_ToEnum C1 7} Hugs:" ! Program error: {_ToEnum C1 (-1)} --- 17,22 ---- Hugs:" ! Program error: {_ToEnum T_C1 7} Hugs:" ! Program error: {_ToEnum T_C1 (-1)} Revision Changes Path 1.7 +4 -4 hugs98/src/unix/configure 1.7 +3 -3 hugs98/src/unix/configure.in