Status of Harbormaster

Hello everyone, Over the last few weeks I have been gradually pushing away at increasing our Harbormaster coverage. I'm happy to report that Harbormaster should now test commits on, * x86_64 Ubuntu Linux * x86_64 Mac OS X Sierra * x86_64 Windows (although the bugs are still being worked out here) Differentials are tested on, * x86_64 Ubuntu Linux * x86_64 Windows For those of you following along at home I've roughly documented the configuration on the Phabricator Wiki [1]. One open question is whether we want to enable Differential building on the OS X box. The security implications of allowing essentially anonymous users to build and run untrusted code in our own CI environment are already quite sticky; to enable Differential building on the OS X box would mean that we would be running untrusted code on someone else's hardware, which seems like it may be a step too far. It would be nice to find a way to extend Differential builds to other platforms in the future, however, so we can ensure that we catch bad patches before they even make it to the tree. It's a bit unclear how far we should extend test coverage. In the future I think I will at very least add an i386 Ubuntu environment, but we could go farther still. For instance these platforms immediately come to mind, * x86_64 FreeBSD * x86_64 Solaris * ARM Linux (although this could be quite tricky given the speed of these machines) * AArch64 Linux There is certainly a maintenance and complexity tradeoff that comes with extending our coverage like this, however, so it's quite unclear where the right compromise lies. I'd love to hear what you think. Happy hacking, - Ben [1] https://phabricator.haskell.org/w/ghc_harbormaster/

Ben Gamari wrote:
It's a bit unclear how far we should extend test coverage. In the future I think I will at very least add an i386 Ubuntu environment, but we could go farther still. For instance these platforms immediately come to mind,
* x86_64 FreeBSD * x86_64 Solaris * ARM Linux (although this could be quite tricky given the speed of these machines) * AArch64 Linux
That would be awesome if we could get access to a decent (by which I mean server grade, with at least 4 cores and 8 Gig of RAM). The other option for ARM/Linux and AArch64/Linux is cross-compile builds. Just building GHC as a cross-compiler for these targets would shave out a lot of bugs. Let me know if you're interested. Its really pretty easy to set up on a Debian or Ubuntu system. Erik -- ---------------------------------------------------------------------- Erik de Castro Lopo http://www.mega-nerd.com/

On 10/ 4/16 09:18 AM, Erik de Castro Lopo wrote:
* AArch64 Linux
That would be awesome if we could get access to a decent (by which I mean server grade, with at least 4 cores and 8 Gig of RAM).
Just ask for account on GNU GCC Compile Farm. They do have X-gene V1 machine in the farm, pretty powerful box especially in comparison with my pandaboard. I for example keep running POWER7 buildbot for GHC there. Cheers, Karel

Erik de Castro Lopo
Ben Gamari wrote:
It's a bit unclear how far we should extend test coverage. In the future I think I will at very least add an i386 Ubuntu environment, but we could go farther still. For instance these platforms immediately come to mind,
* x86_64 FreeBSD * x86_64 Solaris * ARM Linux (although this could be quite tricky given the speed of these machines) * AArch64 Linux
That would be awesome if we could get access to a decent (by which I mean server grade, with at least 4 cores and 8 Gig of RAM).
I've wondered how one of the Scaleway ARMs would fare. Their specs are seem to be comparable to the Odroid XU4 which I use for my own builds, which barely passes. Perhaps dedicating some of the 50GB SSD to swap would help.
The other option for ARM/Linux and AArch64/Linux is cross-compile builds. Just building GHC as a cross-compiler for these targets would shave out a lot of bugs. Let me know if you're interested. Its really pretty easy to set up on a Debian or Ubuntu system.
I am absolutely interested but I'd first like to stabilize what we have. Let's chat about cross-compilation once that happens. Don't hesitate to remind me in a few weeks. Cheers, - Ben
participants (4)
-
Ben Gamari
-
Ben Gamari
-
Erik de Castro Lopo
-
Karel Gardas