Checksum failures when building all packages

I've checked out habs and am trying to build all the packages as described in the readme. Every once in a while the build will fail with a checksum error while installing dependencies ==> Installing missing dependencies... resolving dependencies... looking for inter-conflicts... Packages (3): haskell-polyparse-1.9-58 haskell-text-1.1.0.1-3 haskell-cpphs-1.18.4-3 Total Installed Size: 37.85 MiB :: Proceed with installation? [Y/n] (3/3) checking keys in keyring [########################################] 100% (3/3) checking package integrity [########################################] 100% :: File /var/cache/pacman/pkg/haskell-polyparse-1.9-58-x86_64.pkg.tar.xz is corrupted (invalid or corrupted package (checksum)). Do you want to delete it? [Y/n] :: File /var/cache/pacman/pkg/haskell-cpphs-1.18.4-3-x86_64.pkg.tar.xz is corrupted (invalid or corrupted package (checksum)). Do you want to delete it? [Y/n] error: failed to commit transaction (invalid or corrupted package (checksum)) Errors occurred, no packages were upgraded. ==> ERROR: 'pacman' failed to install missing dependencies. ==> ERROR: Build failed, check /home/rwallace/Development/habs/x86_64-chroot/build/build *** ERROR: Trapped ERR, something went very wrong. If I just restart the build, it appears to download the problem dependency instead of using the locally built package. Is this normal, or am I doing something wrong? Thanks, Rich

On Fri, Apr 25, 2014 at 09:13:23AM -0700, Richard Wallace wrote:
I've checked out habs and am trying to build all the packages as described in the readme. Every once in a while the build will fail with a checksum error while installing dependencies
==> Installing missing dependencies... resolving dependencies... looking for inter-conflicts...
Packages (3): haskell-polyparse-1.9-58 haskell-text-1.1.0.1-3 haskell-cpphs-1.18.4-3
Total Installed Size: 37.85 MiB
:: Proceed with installation? [Y/n] (3/3) checking keys in keyring [########################################] 100% (3/3) checking package integrity [########################################] 100% :: File /var/cache/pacman/pkg/haskell-polyparse-1.9-58-x86_64.pkg.tar.xz is corrupted (invalid or corrupted package (checksum)). Do you want to delete it? [Y/n] :: File /var/cache/pacman/pkg/haskell-cpphs-1.18.4-3-x86_64.pkg.tar.xz is corrupted (invalid or corrupted package (checksum)). Do you want to delete it? [Y/n] error: failed to commit transaction (invalid or corrupted package (checksum)) Errors occurred, no packages were upgraded. ==> ERROR: 'pacman' failed to install missing dependencies.
==> ERROR: Build failed, check /home/rwallace/Development/habs/x86_64-chroot/build/build *** ERROR: Trapped ERR, something went very wrong.
If I just restart the build, it appears to download the problem dependency instead of using the locally built package.
Is this normal, or am I doing something wrong?
It's not something I remember noticing. After building a package in the chroot it should be installed, which means that if you really are building of all of habs then you shouldn't really need to download many packages at all. /M -- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus@therning.org jabber: magnus@therning.org twitter: magthe http://therning.org/magnus Perl is another example of filling a tiny, short-term need, and then being a real problem in the longer term. -- Alan Kay

Ok, I tried checking out a fresh copy and starting over and everything
worked without a hitch this time. Strange.
On Sat, Apr 26, 2014 at 12:34 AM, Magnus Therning
On Fri, Apr 25, 2014 at 09:13:23AM -0700, Richard Wallace wrote:
I've checked out habs and am trying to build all the packages as described in the readme. Every once in a while the build will fail with a checksum error while installing dependencies
==> Installing missing dependencies... resolving dependencies... looking for inter-conflicts...
Packages (3): haskell-polyparse-1.9-58 haskell-text-1.1.0.1-3 haskell-cpphs-1.18.4-3
Total Installed Size: 37.85 MiB
:: Proceed with installation? [Y/n] (3/3) checking keys in keyring [########################################] 100% (3/3) checking package integrity [########################################] 100% :: File /var/cache/pacman/pkg/haskell-polyparse-1.9-58-x86_64.pkg.tar.xz is corrupted (invalid or corrupted package (checksum)). Do you want to delete it? [Y/n] :: File /var/cache/pacman/pkg/haskell-cpphs-1.18.4-3-x86_64.pkg.tar.xz is corrupted (invalid or corrupted package (checksum)). Do you want to delete it? [Y/n] error: failed to commit transaction (invalid or corrupted package (checksum)) Errors occurred, no packages were upgraded. ==> ERROR: 'pacman' failed to install missing dependencies.
==> ERROR: Build failed, check /home/rwallace/Development/habs/x86_64-chroot/build/build *** ERROR: Trapped ERR, something went very wrong.
If I just restart the build, it appears to download the problem dependency instead of using the locally built package.
Is this normal, or am I doing something wrong?
It's not something I remember noticing.
After building a package in the chroot it should be installed, which means that if you really are building of all of habs then you shouldn't really need to download many packages at all.
/M
-- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus@therning.org jabber: magnus@therning.org twitter: magthe http://therning.org/magnus
Perl is another example of filling a tiny, short-term need, and then being a real problem in the longer term. -- Alan Kay
_______________________________________________ arch-haskell mailing list arch-haskell@haskell.org http://www.haskell.org/mailman/listinfo/arch-haskell

Hm. Ok so the first time I don't think I had a completely clean repository like I thought. After adding a new package to the cblrepo.db, I started getting the same thing when trying to build all the packages without deleting the previously built packages. Should I be rebuilding all the packages from scratch after I add one? On Sat, Apr 26, 2014 at 4:46 PM, Richard Wallace < rwallace@thewallacepack.net> wrote:
Ok, I tried checking out a fresh copy and starting over and everything worked without a hitch this time. Strange.
On Sat, Apr 26, 2014 at 12:34 AM, Magnus Therning
wrote: On Fri, Apr 25, 2014 at 09:13:23AM -0700, Richard Wallace wrote:
I've checked out habs and am trying to build all the packages as described in the readme. Every once in a while the build will fail with a checksum error while installing dependencies
==> Installing missing dependencies... resolving dependencies... looking for inter-conflicts...
Packages (3): haskell-polyparse-1.9-58 haskell-text-1.1.0.1-3 haskell-cpphs-1.18.4-3
Total Installed Size: 37.85 MiB
:: Proceed with installation? [Y/n] (3/3) checking keys in keyring [########################################] 100% (3/3) checking package integrity [########################################] 100% :: File /var/cache/pacman/pkg/haskell-polyparse-1.9-58-x86_64.pkg.tar.xz is corrupted (invalid or corrupted package (checksum)). Do you want to delete it? [Y/n] :: File /var/cache/pacman/pkg/haskell-cpphs-1.18.4-3-x86_64.pkg.tar.xz is corrupted (invalid or corrupted package (checksum)). Do you want to delete it? [Y/n] error: failed to commit transaction (invalid or corrupted package (checksum)) Errors occurred, no packages were upgraded. ==> ERROR: 'pacman' failed to install missing dependencies.
==> ERROR: Build failed, check /home/rwallace/Development/habs/x86_64-chroot/build/build *** ERROR: Trapped ERR, something went very wrong.
If I just restart the build, it appears to download the problem dependency instead of using the locally built package.
Is this normal, or am I doing something wrong?
It's not something I remember noticing.
After building a package in the chroot it should be installed, which means that if you really are building of all of habs then you shouldn't really need to download many packages at all.
/M
-- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus@therning.org jabber: magnus@therning.org twitter: magthe http://therning.org/magnus
Perl is another example of filling a tiny, short-term need, and then being a real problem in the longer term. -- Alan Kay
_______________________________________________ arch-haskell mailing list arch-haskell@haskell.org http://www.haskell.org/mailman/listinfo/arch-haskell

On Sat, Apr 26, 2014 at 05:27:08PM -0700, Richard Wallace wrote:
Hm. Ok so the first time I don't think I had a completely clean repository like I thought. After adding a new package to the cblrepo.db, I started getting the same thing when trying to build all the packages without deleting the previously built packages. Should I be rebuilding all the packages from scratch after I add one?
No, you should absolutely *not* have to rebuild everything after adding a single package! I'm not really sure I understand what commands you are running, or even what it is you are trying to accomplish. With a bit more information I might be able to help better. /M -- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus@therning.org jabber: magnus@therning.org twitter: magthe http://therning.org/magnus Perl is another example of filling a tiny, short-term need, and then being a real problem in the longer term. -- Alan Kay

Right, sorry for not including more details. So what I'm trying to do is
get all the needed packages for adding taffybar built. The first I tried
with was HStringTemplate. My last attempt at doing this looking a bit like
# just getting started, making sure I can build from a clean repo
$ git clone git://github.com/archhaskell/habs.git
$ cd habs
$ cblrepo sync
$ cblrepo pkgbuild --ghc-version 7.8.2-1 $(cblrepo build base|tail -n +2)
$ ./makeahpkg -c -- $(cblrepo build base | tail -n +2)
# that worked, no problem, so now I try adding HStringTemplate
$ cblrepo add HStringTemplate,0.7.3
$ cblrepo pkgbuild --ghc-version 7.8.2-1 HStringTemplate
$ ./makeahpkg -c -- HStringTemplate
This ended up giving me a checksum error on the haskell-mtl package.
If I instead do the last step with the `./makeahpkg -c -- $(cblrepo build
base | tail -n +2)` everything builds without a hitch. At first I thought
I had to clean out all the previously built packages using `git clean -fd`,
but that turns out to not be the case. Do I just need to include all the
HStringTemplate dependencies when trying to build it?
Thanks,
Rich
On Sun, Apr 27, 2014 at 12:57 PM, Magnus Therning
On Sat, Apr 26, 2014 at 05:27:08PM -0700, Richard Wallace wrote:
Hm. Ok so the first time I don't think I had a completely clean repository like I thought. After adding a new package to the cblrepo.db, I started getting the same thing when trying to build all the packages without deleting the previously built packages. Should I be rebuilding all the packages from scratch after I add one?
No, you should absolutely *not* have to rebuild everything after adding a single package!
I'm not really sure I understand what commands you are running, or even what it is you are trying to accomplish. With a bit more information I might be able to help better.
/M
-- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus@therning.org jabber: magnus@therning.org twitter: magthe http://therning.org/magnus
Perl is another example of filling a tiny, short-term need, and then being a real problem in the longer term. -- Alan Kay

On Sun, Apr 27, 2014 at 01:23:18PM -0700, Richard Wallace wrote:
Right, sorry for not including more details. So what I'm trying to do is get all the needed packages for adding taffybar built. The first I tried with was HStringTemplate. My last attempt at doing this looking a bit like
# just getting started, making sure I can build from a clean repo $ git clone git://github.com/archhaskell/habs.git $ cd habs $ cblrepo sync $ cblrepo pkgbuild --ghc-version 7.8.2-1 $(cblrepo build base|tail -n +2) $ ./makeahpkg -c -- $(cblrepo build base | tail -n +2)
# that worked, no problem, so now I try adding HStringTemplate $ cblrepo add HStringTemplate,0.7.3 $ cblrepo pkgbuild --ghc-version 7.8.2-1 HStringTemplate $ ./makeahpkg -c -- HStringTemplate
This ended up giving me a checksum error on the haskell-mtl package.
If I instead do the last step with the `./makeahpkg -c -- $(cblrepo build base | tail -n +2)` everything builds without a hitch. At first I thought I had to clean out all the previously built packages using `git clean -fd`, but that turns out to not be the case. Do I just need to include all the HStringTemplate dependencies when trying to build it?
Now things are a bit clearer to me :) A few things that might clear things up a bit: 1. The packages in HABS are available pre-built in the [haskell-core] repo[^1]. 2. The chroot that `makeahpkg` creates is already pointing to [haskell-core] and thus will download any missing Haskell packages from there. 3. `makeahpkg` keeps two chroots, one 'root' and one 'build'. All packages are built in 'build'. 4. The argument '-c' will sync 'root' and 'build', i.e. any packages that have been built and installed in 'build' will effectively be removed by using `makeahpkg -c`. 5. If `makeahpkg` finds that a package has already been built, it will skip building and installing it again. This means that you never really *need* to build all of HABS. It also means that if you are adding several packages but building them one at a time you really shouldn't use the '-c' argument, since you then will have to first remove any already built packages in the habs/ area, and then rebuild all dependencies for the package you really wanted. I believe, but please correct me if I'm wrong, that the installing of the package at the end means the package ends up in the local pacman cache. If that's the case then what you see is explained by: 1. You build all of HABS locally, which means it's all in your local pacman cache. 2. You clean out the build chroot. 3. The package you want to build (HStringTemplate) now depends on uninstalled packages. 4. Pacman tries the locally cached packages, but finds they don't match what comes from [haskell-core] -- checksum error! The reson that it works the second time is that the cache is cleansed of non-matching packages as they are found. /M [^1]: http://is.gd/DDV64T -- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus@therning.org jabber: magnus@therning.org twitter: magthe http://therning.org/magnus Most software today is very much like an Egyptian pyramid with millions of bricks piled on top of each other, with no structural integrity, but just done by brute force and thousands of slaves. -- Alan Kay

Aha! I understand now. I was overusing the -c option. Things are going
much more smoothly now. Thanks!
On Sun, Apr 27, 2014 at 2:08 PM, Magnus Therning
Right, sorry for not including more details. So what I'm trying to do is get all the needed packages for adding taffybar built. The first I tried with was HStringTemplate. My last attempt at doing this looking a bit
On Sun, Apr 27, 2014 at 01:23:18PM -0700, Richard Wallace wrote: like
# just getting started, making sure I can build from a clean repo $ git clone git://github.com/archhaskell/habs.git $ cd habs $ cblrepo sync $ cblrepo pkgbuild --ghc-version 7.8.2-1 $(cblrepo build base|tail -n +2) $ ./makeahpkg -c -- $(cblrepo build base | tail -n +2)
# that worked, no problem, so now I try adding HStringTemplate $ cblrepo add HStringTemplate,0.7.3 $ cblrepo pkgbuild --ghc-version 7.8.2-1 HStringTemplate $ ./makeahpkg -c -- HStringTemplate
This ended up giving me a checksum error on the haskell-mtl package.
If I instead do the last step with the `./makeahpkg -c -- $(cblrepo build base | tail -n +2)` everything builds without a hitch. At first I
thought
I had to clean out all the previously built packages using `git clean -fd`, but that turns out to not be the case. Do I just need to include all the HStringTemplate dependencies when trying to build it?
Now things are a bit clearer to me :)
A few things that might clear things up a bit:
1. The packages in HABS are available pre-built in the [haskell-core] repo[^1]. 2. The chroot that `makeahpkg` creates is already pointing to [haskell-core] and thus will download any missing Haskell packages from there. 3. `makeahpkg` keeps two chroots, one 'root' and one 'build'. All packages are built in 'build'. 4. The argument '-c' will sync 'root' and 'build', i.e. any packages that have been built and installed in 'build' will effectively be removed by using `makeahpkg -c`. 5. If `makeahpkg` finds that a package has already been built, it will skip building and installing it again.
This means that you never really *need* to build all of HABS. It also means that if you are adding several packages but building them one at a time you really shouldn't use the '-c' argument, since you then will have to first remove any already built packages in the habs/ area, and then rebuild all dependencies for the package you really wanted.
I believe, but please correct me if I'm wrong, that the installing of the package at the end means the package ends up in the local pacman cache. If that's the case then what you see is explained by:
1. You build all of HABS locally, which means it's all in your local pacman cache. 2. You clean out the build chroot. 3. The package you want to build (HStringTemplate) now depends on uninstalled packages. 4. Pacman tries the locally cached packages, but finds they don't match what comes from [haskell-core] -- checksum error!
The reson that it works the second time is that the cache is cleansed of non-matching packages as they are found.
/M
[^1]: http://is.gd/DDV64T
-- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus@therning.org jabber: magnus@therning.org twitter: magthe http://therning.org/magnus
Most software today is very much like an Egyptian pyramid with millions of bricks piled on top of each other, with no structural integrity, but just done by brute force and thousands of slaves. -- Alan Kay

On Sun, Apr 27, 2014 at 03:18:34PM -0700, Richard Wallace wrote:
Aha! I understand now. I was overusing the -c option. Things are going much more smoothly now. Thanks!
Indeed! :) Possibly the help for -c (and maybe even -x too) can be improved. Please let me know if you think so, and how. /M -- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus@therning.org jabber: magnus@therning.org twitter: magthe http://therning.org/magnus Perl is another example of filling a tiny, short-term need, and then being a real problem in the longer term. -- Alan Kay
participants (2)
-
Magnus Therning
-
Richard Wallace