Incredibly slow type-level Nub

Dear Cafe, I have faced a type-level performance problem (with GHC 7.10.3). I am trying to implement type-level Nub which removes duplicates from a type-level list. My implementation [1] with an example of a list of length 20 takes forever to compile. If you reduce the size of the example list (e.g. to 15 items), it will compile faster. Also, if you remove the Nub application from exampleVals, it compiles instantly (this is how I know the problem is in Nub). My question is how can I speed up type-level Nub? And less importantly why exactly is it this slow? The practical application for this is building automatic tests [2] for servant-swagger. There I am interested in generating exactly one test for each distinct type. Kind regards, Nick [1] https://gist.github.com/fizruk/06458fe8b62a1e562af1 [2] http://hackage.haskell.org/package/servant-swagger-1.0.2/docs/Servant-Swagge...

If you have a practical example of where GHC's current type-level reduction machinery is too slow, please post a bug report. We have only a few real examples of this, and so GHC's implementation is tuned for those examples. With more examples, we can tune more widely.
Thanks!
Richard
On Feb 7, 2016, at 8:37 AM, Nickolay Kudasov
Dear Cafe,
I have faced a type-level performance problem (with GHC 7.10.3). I am trying to implement type-level Nub which removes duplicates from a type-level list.
My implementation [1] with an example of a list of length 20 takes forever to compile. If you reduce the size of the example list (e.g. to 15 items), it will compile faster. Also, if you remove the Nub application from exampleVals, it compiles instantly (this is how I know the problem is in Nub).
My question is how can I speed up type-level Nub? And less importantly why exactly is it this slow?
The practical application for this is building automatic tests [2] for servant-swagger. There I am interested in generating exactly one test for each distinct type.
Kind regards, Nick
[1] https://gist.github.com/fizruk/06458fe8b62a1e562af1 [2] http://hackage.haskell.org/package/servant-swagger-1.0.2/docs/Servant-Swagge... _______________________________________________ Haskell-Cafe mailing list Haskell-Cafe@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe

Hi Nickolay,
I'm not sure why your version was *that* slow. But the algorithm was not
optimal. I translated the Haskell Report prelude version of nub to the type
level. That version compiles instantly with the long list. I tested with
GHC 7.10.2.
https://gist.github.com/roelvandijk/f115c6b85a3961e1b689
Regards,
Roel
2016-02-07 14:37 GMT+01:00 Nickolay Kudasov
Dear Cafe,
I have faced a type-level performance problem (with GHC 7.10.3). I am trying to implement type-level Nub which removes duplicates from a type-level list.
My implementation [1] with an example of a list of length 20 takes forever to compile. If you reduce the size of the example list (e.g. to 15 items), it will compile faster. Also, if you remove the Nub application from exampleVals, it compiles instantly (this is how I know the problem is in Nub).
My question is how can I speed up type-level Nub? And less importantly why exactly is it this slow?
The practical application for this is building automatic tests [2] for servant-swagger. There I am interested in generating exactly one test for each distinct type.
Kind regards, Nick
[1] https://gist.github.com/fizruk/06458fe8b62a1e562af1 [2] http://hackage.haskell.org/package/servant-swagger-1.0.2/docs/Servant-Swagge...

Roel, thanks, your solution works perfectly for me! I should've checked
that implementation myself.
Richard, since Roel's solution works for me, I think I should not file this.
I think type-list [1] is the place on Hackage for list-related type-level
functions.
I probably should send a PR adding Roel's Nub there.
Thanks for your help!
Nick
[1] https://hackage.haskell.org/package/type-list
On Sun, 7 Feb 2016 at 18:24 Roel van Dijk
Hi Nickolay,
I'm not sure why your version was *that* slow. But the algorithm was not optimal. I translated the Haskell Report prelude version of nub to the type level. That version compiles instantly with the long list. I tested with GHC 7.10.2.
https://gist.github.com/roelvandijk/f115c6b85a3961e1b689
Regards, Roel
2016-02-07 14:37 GMT+01:00 Nickolay Kudasov
: Dear Cafe,
I have faced a type-level performance problem (with GHC 7.10.3). I am trying to implement type-level Nub which removes duplicates from a type-level list.
My implementation [1] with an example of a list of length 20 takes forever to compile. If you reduce the size of the example list (e.g. to 15 items), it will compile faster. Also, if you remove the Nub application from exampleVals, it compiles instantly (this is how I know the problem is in Nub).
My question is how can I speed up type-level Nub? And less importantly why exactly is it this slow?
The practical application for this is building automatic tests [2] for servant-swagger. There I am interested in generating exactly one test for each distinct type.
Kind regards, Nick
[1] https://gist.github.com/fizruk/06458fe8b62a1e562af1 [2] http://hackage.haskell.org/package/servant-swagger-1.0.2/docs/Servant-Swagge...

I suppose that a problem is with "non-lazy type-level If".
This was discussed here
https://groups.google.com/forum/embed/#!topic/haskell-cafe/kthmX8VmcYs.
And there is https://ghc.haskell.org/trac/ghc/ticket/11113#ticket a
ticket with workaround.
Best regards,
Dmitry
2016-02-07 16:37 GMT+03:00 Nickolay Kudasov
Dear Cafe,
I have faced a type-level performance problem (with GHC 7.10.3). I am trying to implement type-level Nub which removes duplicates from a type-level list.
My implementation [1] with an example of a list of length 20 takes forever to compile. If you reduce the size of the example list (e.g. to 15 items), it will compile faster. Also, if you remove the Nub application from exampleVals, it compiles instantly (this is how I know the problem is in Nub).
My question is how can I speed up type-level Nub? And less importantly why exactly is it this slow?
The practical application for this is building automatic tests [2] for servant-swagger. There I am interested in generating exactly one test for each distinct type.
Kind regards, Nick
[1] https://gist.github.com/fizruk/06458fe8b62a1e562af1 [2] http://hackage.haskell.org/package/servant-swagger-1.0.2/docs/Servant-Swagge...
_______________________________________________ Haskell-Cafe mailing list Haskell-Cafe@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe

Hello,
I wonder if singletons https://hackage.haskell.org/package/singletons library
doesn't satisfy your requrements? Did you look at this opportunity? Here
https://hackage.haskell.org/package/singletons-2.0.1/docs/Data-Promotion-Pre...
is
a Nub implementation.
I am particulary interested in this because I am checking now this library
for usung it in my project. Had you some reasons to refuse it?
Best regards,
Dmitry
2016-02-07 16:37 GMT+03:00 Nickolay Kudasov
Dear Cafe,
I have faced a type-level performance problem (with GHC 7.10.3). I am trying to implement type-level Nub which removes duplicates from a type-level list.
My implementation [1] with an example of a list of length 20 takes forever to compile. If you reduce the size of the example list (e.g. to 15 items), it will compile faster. Also, if you remove the Nub application from exampleVals, it compiles instantly (this is how I know the problem is in Nub).
My question is how can I speed up type-level Nub? And less importantly why exactly is it this slow?
The practical application for this is building automatic tests [2] for servant-swagger. There I am interested in generating exactly one test for each distinct type.
Kind regards, Nick
[1] https://gist.github.com/fizruk/06458fe8b62a1e562af1 [2] http://hackage.haskell.org/package/servant-swagger-1.0.2/docs/Servant-Swagge...
_______________________________________________ Haskell-Cafe mailing list Haskell-Cafe@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe

Dmitry, Well, actually, I was not aware that singletons provide this functionality!
From what I see singletons seem to be an overkill for my use case.
Thanks for the hint though, I will look into singletons more to see if it
fits the bill.
Kind regards,
Nick
On Mon, 8 Feb 2016 at 13:21 Dmitry Olshansky
Hello,
I wonder if singletons https://hackage.haskell.org/package/singletons library doesn't satisfy your requrements? Did you look at this opportunity? Here https://hackage.haskell.org/package/singletons-2.0.1/docs/Data-Promotion-Pre... is a Nub implementation.
I am particulary interested in this because I am checking now this library for usung it in my project. Had you some reasons to refuse it?
Best regards, Dmitry
2016-02-07 16:37 GMT+03:00 Nickolay Kudasov
: Dear Cafe,
I have faced a type-level performance problem (with GHC 7.10.3). I am trying to implement type-level Nub which removes duplicates from a type-level list.
My implementation [1] with an example of a list of length 20 takes forever to compile. If you reduce the size of the example list (e.g. to 15 items), it will compile faster. Also, if you remove the Nub application from exampleVals, it compiles instantly (this is how I know the problem is in Nub).
My question is how can I speed up type-level Nub? And less importantly why exactly is it this slow?
The practical application for this is building automatic tests [2] for servant-swagger. There I am interested in generating exactly one test for each distinct type.
Kind regards, Nick
[1] https://gist.github.com/fizruk/06458fe8b62a1e562af1 [2] http://hackage.haskell.org/package/servant-swagger-1.0.2/docs/Servant-Swagge...
_______________________________________________ Haskell-Cafe mailing list Haskell-Cafe@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
participants (4)
-
Dmitry Olshansky
-
Nickolay Kudasov
-
Richard Eisenberg
-
Roel van Dijk