download all of Hackage?
Hi devs, Is there an easy way to download (but not compile) all of Hackage? I know of the hackager package, but that's about compiling. I just want a whole big load of Haskell code to play with. I thought I could find a link on Hackage to do this, but failed. Thanks! Richard
On Mon, Sep 14, 2015 at 10:43 AM, Richard Eisenberg <eir@cis.upenn.edu> wrote:
Is there an easy way to download (but not compile) all of Hackage? I know of the hackager package, but that's about compiling. I just want a whole big load of Haskell code to play with. I thought I could find a link on Hackage to do this, but failed.
There's hackage-mirror, but I note it says it mirrors to S3. -- brandon s allbery kf8nh sine nomine associates allbery.b@gmail.com ballbery@sinenomine.net unix, openafs, kerberos, infrastructure, xmonad http://sinenomine.net
Brandon Allbery <allbery.b@gmail.com> writes:
There's hackage-mirror, but I note it says it mirrors to S3.
It mirrors into a directory as well: hackage-mirror --from="http://hackage.haskell.org" --to="/some/dir" Further, it can incrementally update very quickly. John
Does anyone know approximately how much disk space all of hackage takes up when compiled? And about how long it takes to compile everything? On Mon, Sep 14, 2015 at 11:37 AM, John Wiegley <johnw@newartisans.com> wrote:
Brandon Allbery <allbery.b@gmail.com> writes:
There's hackage-mirror, but I note it says it mirrors to S3.
It mirrors into a directory as well:
hackage-mirror --from="http://hackage.haskell.org" --to="/some/dir"
Further, it can incrementally update very quickly.
John _______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
You will probably not be able to compile everything. If you want a compilable subset, you should probably look at stackage Alan On Mon, Sep 14, 2015 at 9:57 PM, Mike Izbicki <mike@izbicki.me> wrote:
Does anyone know approximately how much disk space all of hackage takes up when compiled? And about how long it takes to compile everything?
On Mon, Sep 14, 2015 at 11:37 AM, John Wiegley <johnw@newartisans.com> wrote:
> Brandon Allbery <allbery.b@gmail.com> writes:
There's hackage-mirror, but I note it says it mirrors to S3.
It mirrors into a directory as well:
hackage-mirror --from="http://hackage.haskell.org" --to="/some/dir"
Further, it can incrementally update very quickly.
John _______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Stack tool has an option of a docker image with everything compiled. I think they claim whole image is 8 or 10 GB, please check (and don't forget that's with GHC and other tools inside). 14 вер. 2015 22:57 "Mike Izbicki" <mike@izbicki.me> пише:
Does anyone know approximately how much disk space all of hackage takes up when compiled? And about how long it takes to compile everything?
On Mon, Sep 14, 2015 at 11:37 AM, John Wiegley <johnw@newartisans.com> wrote:
> Brandon Allbery <allbery.b@gmail.com> writes:
There's hackage-mirror, but I note it says it mirrors to S3.
It mirrors into a directory as well:
hackage-mirror --from="http://hackage.haskell.org" --to="/some/dir"
Further, it can incrementally update very quickly.
John _______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
On 2015-09-14 at 16:43:44 +0200, Richard Eisenberg wrote:
Is there an easy way to download (but not compile) all of Hackage? I know of the hackager package, but that's about compiling. I just want a whole big load of Haskell code to play with. I thought I could find a link on Hackage to do this, but failed.
It's quite easy, you can iterate through the list of package names and call 'cabal get' like e.g. (untested, but I've done this already -- you may need to protect against execution errors) for PKG in $(cabal list --simple | awk '{ print $1 }' | uniq); do cabal get $PKG;done another variant is to construct the URLs based on the output; you can also get a list of packages in JSON format via http://hackage.haskell.org/packages/.json there's many ways to accomplish what you want...
You could clone https://github.com/bitemyapp/hackage-packages Alan On Mon, Sep 14, 2015 at 5:17 PM, Herbert Valerio Riedel <hvriedel@gmail.com> wrote:
On 2015-09-14 at 16:43:44 +0200, Richard Eisenberg wrote:
Is there an easy way to download (but not compile) all of Hackage? I know of the hackager package, but that's about compiling. I just want a whole big load of Haskell code to play with. I thought I could find a link on Hackage to do this, but failed.
It's quite easy, you can iterate through the list of package names and call 'cabal get' like e.g. (untested, but I've done this already -- you may need to protect against execution errors)
for PKG in $(cabal list --simple | awk '{ print $1 }' | uniq); do cabal get $PKG;done
another variant is to construct the URLs based on the output;
you can also get a list of packages in JSON format via
http://hackage.haskell.org/packages/.json
there's many ways to accomplish what you want...
_______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
It's a little out of date, but I've been using that repo I made to do surveys of Haskell code and figure out how frequently things are used. I could really do with a Haskell-source-code-aware grep though. Being able to specify type, data, etc. would be really nice! On Mon, Sep 14, 2015 at 10:19 AM, Alan & Kim Zimmerman <alan.zimm@gmail.com> wrote:
You could clone https://github.com/bitemyapp/hackage-packages
Alan
On Mon, Sep 14, 2015 at 5:17 PM, Herbert Valerio Riedel < hvriedel@gmail.com> wrote:
On 2015-09-14 at 16:43:44 +0200, Richard Eisenberg wrote:
Is there an easy way to download (but not compile) all of Hackage? I know of the hackager package, but that's about compiling. I just want a whole big load of Haskell code to play with. I thought I could find a link on Hackage to do this, but failed.
It's quite easy, you can iterate through the list of package names and call 'cabal get' like e.g. (untested, but I've done this already -- you may need to protect against execution errors)
for PKG in $(cabal list --simple | awk '{ print $1 }' | uniq); do cabal get $PKG;done
another variant is to construct the URLs based on the output;
you can also get a list of packages in JSON format via
http://hackage.haskell.org/packages/.json
there's many ways to accomplish what you want...
_______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
_______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
-- Chris Allen Currently working on http://haskellbook.com
Thank you, this is exactly what I needed the other day to do a quick survey of language extensions. On 14/09/15 17:19, Alan & Kim Zimmerman wrote:
You could clone https://github.com/bitemyapp/hackage-packages
participants (9)
-
Alan & Kim Zimmerman -
Brandon Allbery -
Christopher Allen -
Herbert Valerio Riedel -
John Wiegley -
Kostiantyn Rybnikov -
Mike Izbicki -
Niklas Hambüchen -
Richard Eisenberg