Hi Alp,

Just wanted to say that there's interest here in Melbourne in Spark+Haskell too and we'll definitely be trying this out to see what it's like.

One of the problems that some of the more exotic language-bindings to spark have is that while they include RDD support, they lack a language-idiomatic interpretation of DataFrames. Does Sparkle attempt to tackle this?

Many thanks to Tweag I/O for doing this. It must have been a lot of work!

Regards,

- Lyndon

On Fri, Feb 26, 2016 at 4:50 AM, Alp Mestanogullari <alpmestan@gmail.com> wrote:

Hello -cafe!

Recently at Tweag I/O we've been working on sparkle, a library for writing (distributed) Apache Spark applications directly in Haskell!

We have published a blog post introducing the project (and some of its challenges) here: http://www.tweag.io/blog/haskell-meets-large-scale-distributed-analytics

The corresponding repository lives at https://github.com/tweag/sparkle

While this is still early stage work, we can already write non-trivial Spark applications in Haskell and have them run accross an entire cluster. We obviously do not cover the whole Spark API yet (very, very far from that) but would be glad to already get some feedback.

Cheers

--
Alp Mestanogullari

_______________________________________________
Haskell-Cafe mailing list
Haskell-Cafe@haskell.org
http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe