On Mon, 2011-05-23 at 15:14 +0100, Ian Lynagh wrote:
If we'd like to add some flexibility we could allow tests to carry arbitrary tags:
class TestInstance a where tags :: a -> [String]
Just because GHC's testsuite distinguishes between ways and tests, I'm not sure if Cabal's testsuite framework needs to do so. Ways could just be encoded into the hierarchy, e.g. GHC's testsuite could include the tests typechecker.T5636.ghci typechecker.T5636.opt typechecker.T5636.prof rather than the test typechecker.T5636 with 3 tagged variants.
Perhaps having tags /as well/ would make sense, so typechecker.T5636.ghci would be tagged ["typechecker", "ghci"] and it would then be possible to run 'all tests tagged "ghci"' or 'all tests tagged "typechecker"'.
Right, I was thinking of the latter, that each way is a separate test but that they're tagged so you know they're related in some way. Duncan