#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) ----------------------------------------+---------------------------------- Reporter: erikd | Owner: Type: bug | Status: new Priority: normal | Milestone: 7.12.1 Component: Compiler | Version: 7.11 Resolution: | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC failed | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Revisions: ----------------------------------------+---------------------------------- Comment (by rwbarton): Oh, it's probably Phab:D524 (#9706) then. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:2 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) ----------------------------------------+---------------------------------- Reporter: erikd | Owner: Type: bug | Status: new Priority: normal | Milestone: 7.12.1 Component: Compiler | Version: 7.11 Resolution: | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC failed | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Revisions: ----------------------------------------+---------------------------------- Comment (by erikd): If I hack `configure.ac` and disable `USE_LARGE_ADDRESS_SPACE` GHC builds fine. Need to figure out why Arm64 doesn't support this. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:4 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) ----------------------------------------+---------------------------------- Reporter: erikd | Owner: Type: bug | Status: new Priority: normal | Milestone: 7.12.1 Component: Compiler | Version: 7.11 Resolution: | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC failed | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Revisions: ----------------------------------------+---------------------------------- Changes (by kgardas): * cc: kgardas (added) Comment: Replying to [ticket:10682 erikd]:

Some time in the last week, GHC Git HEAD started to fail to build with:

{{{ dll-split: out of memory (requested 1099512676352 bytes) compiler/ghc.mk:655: recipe for target 'compiler/stage2/dll-split.stamp' failed }}}

Obviously, attempting to allocate a terrabyte is not going to work.

Will try to git bisect.

This is very similar to what I get here on amd64/solaris11 builder[1] after I've been able to start it after holidays. Perhaps the same issue? I'll try to debug that too as time permits. [1]: http://haskell.inf.elte.hu/builders/solaris-amd64-head/index.html -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:6 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) ----------------------------------------+---------------------------------- Reporter: erikd | Owner: Type: bug | Status: new Priority: normal | Milestone: 7.12.1 Component: Compiler | Version: 7.11 Resolution: | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC failed | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Revisions: ----------------------------------------+---------------------------------- Comment (by kgardas): Edward, you are of course right. The symptoms may be the same but fix is completely different since this is heavily #ifdefed OS specific code anyway, so Solaris fix will touch different place anyway. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:8 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) ----------------------------------------+---------------------------------- Reporter: erikd | Owner: Type: bug | Status: new Priority: normal | Milestone: 7.12.1 Component: Compiler | Version: 7.11 Resolution: | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC failed | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Revisions: ----------------------------------------+---------------------------------- Comment (by erikd): @kgardas has an amd64-solaris fix at Phab:D1169. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:10 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) -------------------------------------+------------------------------------- Reporter: erikd | Owner: Type: bug | Status: patch Priority: normal | Milestone: 7.12.1 Component: Compiler | Version: 7.11 Resolution: | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC | Test Case: failed | Blocked By: | Blocking: Related Tickets: | Differential Revisions: Phab:D1171 -------------------------------------+------------------------------------- Comment (by Erik de Castro Lopo ): In [changeset:"38c98e4f61a48084995a5347d76ddd024ce1a09c/ghc" 38c98e4/ghc]: {{{ #!CommitTicketReference repository="ghc" revision="38c98e4f61a48084995a5347d76ddd024ce1a09c" RTS: Reduce MBLOCK_SPACE_SIZE on AArch64 Commit 0d1a8d09f4 added a two step allocator for 64 bit systems. This allocator mmaps a huge (1 TB) chunk of memory out of which it does smaller allocations. On AArch64/Arm64 linux, this mmap was failing due to the Arm64 Linux kernel parameter CONFIG_ARM64_VA_BITS defaulting to 39 bits. Therefore reducing the AArch64 value for MBLOCK_SPACE_SIZE to make this allocation 1/4 TB while remaining 1 TB for other archs. Reviewers: ezyang, austin, bgamari Subscribers: thomie Differential Revision: https://phabricator.haskell.org/D1171 GHC Trac Issues: #10682 }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:12 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) -------------------------------------+------------------------------------- Reporter: erikd | Owner: Type: bug | Status: patch Priority: normal | Milestone: 8.0.1 Component: Compiler | Version: 7.11 Resolution: | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC | Test Case: failed | Blocked By: | Blocking: Related Tickets: | Differential Revisions: Phab:D1171 -------------------------------------+------------------------------------- Comment (by rwbarton): So, this is fixed right? -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:15 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) -------------------------------------+------------------------------------- Reporter: erikd | Owner: Type: bug | Status: closed Priority: normal | Milestone: 8.0.1 Component: Compiler | Version: 7.11 Resolution: fixed | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC | Test Case: failed | Blocked By: | Blocking: Related Tickets: | Differential Revisions: Phab:D1171 -------------------------------------+------------------------------------- Comment (by RyanGlScott): This is still happening to me on an x86_64 machine: {{{ inplace/bin/dll-split compiler/stage2/build/.depend-v-dyn.haskell "DynFlags" "Annotations ApiAnnotation Avail Bag BasicTypes Binary BooleanFormula BreakArray BufWrite Class CmdLineParser CmmType CoAxiom ConLike Coercion Config Constants CoreArity CoreFVs CoreSubst CoreSyn CoreTidy CoreUnfold CoreUtils CoreSeq CoreStats CostCentre Ctype DataCon Demand Digraph DriverPhases DynFlags Encoding ErrUtils Exception FamInstEnv FastFunctions FastMutInt FastString Fingerprint FiniteMap ForeignCall Hooks HsBinds HsDecls HsDoc HsExpr HsImpExp HsLit PlaceHolder HsPat HsSyn HsTypes HsUtils HscTypes IOEnv Id IdInfo IfaceSyn IfaceType InstEnv Kind Lexeme Lexer ListSetOps Literal Maybes MkCore MkId Module MonadUtils Name NameEnv NameSet OccName OccurAnal OptCoercion OrdList Outputable PackageConfig Packages Pair Panic PatSyn PipelineMonad Platform PlatformConstants PprCore PrelNames PrelRules Pretty PrimOp RdrName Rules Serialized SrcLoc StaticFlags StringBuffer TcEvidence TcRnTypes TcType TrieMap TyCon Type TypeRep TysPrim TysWiredIn Unify UniqFM UniqSet UniqSupply Unique Util Var VarEnv VarSet Bitmap BlockId ByteCodeAsm ByteCodeInstr ByteCodeItbls CLabel Cmm CmmCallConv CmmExpr CmmInfo CmmMachOp CmmNode CmmSwitch CmmUtils CodeGen.Platform CodeGen.Platform.ARM CodeGen.Platform.ARM64 CodeGen.Platform.NoRegs CodeGen.Platform.PPC CodeGen.Platform.PPC_Darwin CodeGen.Platform.SPARC CodeGen.Platform.X86 CodeGen.Platform.X86_64 Hoopl Hoopl.Dataflow InteractiveEvalTypes MkGraph PprCmm PprCmmDecl PprCmmExpr Reg RegClass SMRep StgCmmArgRep StgCmmClosure StgCmmEnv StgCmmLayout StgCmmMonad StgCmmProf StgCmmTicky StgCmmUtils StgSyn Stream" dll-split: out of memory (requested 1099512676352 bytes) }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:17 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10682: AArch64: dll-split: out of memory (requested 1099512676352 bytes) -------------------------------------+------------------------------------- Reporter: erikd | Owner: Type: bug | Status: closed Priority: normal | Milestone: 8.0.1 Component: Compiler | Version: 7.11 Resolution: fixed | Keywords: Operating System: Unknown/Multiple | Architecture: aarch64 Type of failure: Building GHC | Test Case: failed | Blocked By: | Blocking: Related Tickets: #10877 | Differential Revisions: Phab:D1171 -------------------------------------+------------------------------------- Changes (by RyanGlScott): * related: => #10877 -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10682#comment:19 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler