Hi Alp,
Just wanted to say that there's interest here in Melbourne in Spark+Haskell
too and we'll definitely be trying this out to see what it's like.
One of the problems that some of the more exotic language-bindings to spark
have is that while they include RDD support, they lack a language-idiomatic
interpretation of DataFrames. Does Sparkle attempt to tackle this?
Many thanks to Tweag I/O for doing this. It must have been a lot of work!
Regards,
- Lyndon
On Fri, Feb 26, 2016 at 4:50 AM, Alp Mestanogullari
Hello -cafe!
Recently at Tweag I/O we've been working on sparkle, a library for writing (distributed) Apache Spark applications directly in Haskell!
We have published a blog post introducing the project (and some of its challenges) here: http://www.tweag.io/blog/haskell-meets-large-scale-distributed-analytics
The corresponding repository lives at https://github.com/tweag/sparkle
While this is still early stage work, we can already write non-trivial Spark applications in Haskell and have them run accross an entire cluster. We obviously do not cover the whole Spark API yet (very, very far from that) but would be glad to already get some feedback.
Cheers
-- Alp Mestanogullari
_______________________________________________ Haskell-Cafe mailing list Haskell-Cafe@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe