#9885: ghc-pkg parser eats too much memory -------------------------------------+------------------------------------- Reporter: gnezdo | Owner: Type: bug | Status: new Priority: normal | Milestone: Component: ghc-pkg | Version: 7.8.3 Resolution: | Keywords: Operating System: Linux | Architecture: Unknown/Multiple Type of failure: Runtime | Difficulty: Moderate (less performance bug | than a day) Test Case: | Blocked By: Blocking: | Related Tickets: Differential Revisions: | -------------------------------------+------------------------------------- Comment (by gnezdo): I did some profiling. To save somebody a bit of digging, reproducing the build/profile/plot script here (would love to hear how to do this more optimally): {{{ #!/bin/bash # Demonstrates memory consumption behavior of ghc-pkg as a function of # the number of ld-options arguments. set -eu (cd ~/ghc-copy/Cabal/Cabal && cabal install --enable-library-profiling --enable-executable-profiling --force-reinstalls --ghc-option=-rtsopts --ghc-option=-prof --ghc-option=-fprof-auto) (cd ~/ghc-copy/ghc/libraries/bin-package-db && cabal install --enable- library-profiling --enable-executable-profiling --force-reinstalls --ghc- option=-rtsopts --ghc-option=-prof --ghc-option=-fprof-auto) (cd ~/ghc-copy/ghc/utils/ghc-pkg && cabal install --enable-library- profiling --enable-executable-profiling --force-reinstalls --ghc- option=-rtsopts --ghc-option=-prof --ghc-option=-fprof-auto --ghc- option=-DBOOTSTRAPPING) ghcpkg=~/.cabal/bin/ghc-pkg for i in {13..13}; do size=$((1 << $i)) echo $size rm -fr a.packages $ghcpkg init a.packages cat > a.spec <> a.spec for i in $(seq 1 $size); do echo -n "x "; done >> a.spec rm -f ghc-pkg.{hp,ps} /usr/bin/time $ghcpkg -v2 --global-package-db a.packages register --force a.spec +RTS -hc -L100 || true hp2ps -b -c ghc-pkg.hp evince ghc-pkg.ps done }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/9885#comment:1 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#9885: ghc-pkg parser eats too much memory -------------------------------------+------------------------------------- Reporter: gnezdo | Owner: Type: bug | Status: new Priority: normal | Milestone: Component: ghc-pkg | Version: 7.8.3 Resolution: | Keywords: Operating System: Linux | Architecture: Unknown/Multiple Type of failure: Runtime | Difficulty: Moderate (less performance bug | than a day) Test Case: | Blocked By: Blocking: | Related Tickets: Differential Revisions: | -------------------------------------+------------------------------------- Comment (by gnezdo): Filed as https://github.com/haskell/cabal/issues/2276 -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/9885#comment:3 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#9885: ghc-pkg parser eats too much memory -------------------------------------+------------------------------------- Reporter: gnezdo | Owner: (none) Type: bug | Status: new Priority: low | Milestone: Component: ghc-pkg | Version: 7.8.3 Resolution: | Keywords: Operating System: Linux | Architecture: Type of failure: Runtime | Unknown/Multiple performance bug | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): -------------------------------------+------------------------------------- Comment (by Ben Gamari ): In [changeset:"2671cccde749ed64129097358f81bff43480cdb9/ghc" 2671ccc/ghc]: {{{ #!CommitTicketReference repository="ghc" revision="2671cccde749ed64129097358f81bff43480cdb9" Update Cabal submodule - Cabal-2.2 uses SPDX license identifiers, so I had to update `cabal-version: 2.1` packages `license: BSD3` to `license: BSD-3-Clause` - `ghc-cabal` used old ReadP parsec, now it uses `parsec` too - InstalledPackageInfo pretty-printing have changed a little, fields with default values aren't printed. This can be changed in `Cabal` still, but I haven't found problems with omitting them. Note: `BSD-3-Clause` is parsed as "name = BSD, version = 3" by old parser (because 3-Clause looks like version 3 with tag Clause). If you see *"BSD-3" is not a valid license*, then something is using old parser still. Fixes #9885. }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/9885#comment:5 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler