Re: Offering GHC builder build slaves

Hi, Am Samstag, den 07.06.2014, 12:21 +0200 schrieb Páli Gábor János:

2014-06-07 0:17 GMT+02:00 Mateusz Kowalczyk :

...

It'd be a shame to have various test results from multiple machines but not use them.

I see what you mean. But I would also feel strange to mark the test results failed if only a few of them fail. Note that the testsuite summaries are forwarded to the ghc-builds mailing list so they are published and archived.

ideally, these would be collected in a meaningful way, so that one can see „Commit 123 changed the number of failing tests from 2 to 3“ or „Test T1234 fails since 1.1.2014“ or so. Ideally together with performance numbers („This commit improved nofib by x%“) and nice graphs. It must be possible to collect and present such results that without reinventing the wheel, I just haven’t seen such a tool yet. (And I know that „we should have X“ mails are not very useful...) Greetings from Zürich, Joachim -- Joachim “nomeata” Breitner mail@joachim-breitner.de • http://www.joachim-breitner.de/ Jabber: nomeata@joachim-breitner.de • GPG-Key: 0xF0FBF51F Debian Developer: nomeata@debian.org