- Haskell-Cafe - Haskell.org

ANN: sandi 0.1.1 - a data encoding/decoding library
by Magnus Therning 29 Dec '12

29 Dec '12

The other day I released version 0.1.1 of sandi, a data encoding/decoding library supporting the following encodings: base16, base32, base32hex, base64, base64url, base85, quoted-printable, uuencode, xxencode, yEnc I believe it's reasonably fast, but I still have to look more closely at criterion to get some hard numbers confirming that :) More details can be found at http://hackage.haskell.org/package/sandi /M -- Magnus Therning OpenPGP: 0xAB4DFBA4 email: magnus(a)therning.org jabber: magnus(a)therning.org twitter: magthe http://therning.org/magnus Perl is another example of filling a tiny, short-term need, and then being a real problem in the longer term. -- Alan Kay

1 0

getting upload date from hackage-db?
by Patrick Pelletier 29 Dec '12

29 Dec '12

(Firstly, I apologize if this is not the right mailing list for this question. But haskell-cafe seems to be the place to go when in doubt.) I'm using the hackage-db package (Distribution.Hackage.DB) to analyze Hackage programatically. It parses 00-index.tar and provides a mapping from package name and version to a GenericPackageDescription. I've figured out how to get most of the information I want from the GenericPackageDescription. But one piece of information that's present on the Hackage web pages that I'd like to be able to get is "Upload date", but I can't find this information anywhere in the GenericPackageDescription. Am I missing it? It looks like the modification dates of the cabal files inside 00- index.tar correspond to the upload date. Is this correct? If so, I could parse this out of 00-index.tar myself (using the "tar" package). Is that the best way to do what I'm trying to accomplish, or is there a better, less "reinventing the wheel" way that I'm missing? Thanks, --Patrick

1 0

ANN: shelltestrunner 1.3
by Simon Michael 28 Dec '12

28 Dec '12

I'm pleased to announce the release of shelltestrunner 1.3. New in this release: * support latest Diff, cmdargs, test-framework; tested with GHC 7.6.1 (Magnus Therning) * fix unicode handling on GHC >= 7.2 shelltestrunner tests command-line programs (or arbitrary shell commands.) It reads simple declarative tests specifying a command, some input, and the expected output, and can run them run in parallel, selectively, with a timeout, in color, and/or with differences highlighted. shelltestrunner has been tested on gnu/linux, mac and windows; projects using it include hledger, berp, cblrepo and eddie. shelltestrunner is free software released under GPLv3+. Home: http://joyful.com/shelltestrunner Install: $ cabal install shelltestrunner

1 0

my Fasta is slow ;(
by Branimir Maksimovic 28 Dec '12

28 Dec '12

This time I have tried fasta benchmark since current entries does notdisplay correct output.Program is copy of mine http://benchmarksgame.alioth.debian.org/u64q/program.php?test=fasta&lang=gp… benchmark, but unfortunately executes more than twice time. Seems to me that culprit is in function random as I have tested rest of codeand didn't found speed related problems. bmaxa@maxa:~/shootout/fasta$ time ./fastahs 25000000 > /dev/null real 0m5.262suser 0m5.228ssys 0m0.020s bmaxa@maxa:~/shootout/fasta$ time ./fastacpp 25000000 > /dev/null real 0m2.075suser 0m2.056ssys 0m0.012s Since I am planning to contribute program, perhaps someone cansee a problem to speed it up at least around 3.5 secs which is speed of bench that display incorrect result (in 7.6.1). Program follows: {-# LANGUAGE BangPatterns #-}{- The Computer Language Benchmarks Game http://shootout.alioth.debian.org/ contributed by Branimir Maksimovic-} import System.Environmentimport System.IO.Unsafe import Data.IORefimport Data.Array.Unboxedimport Data.Array.Storableimport Data.Array.Baseimport Data.Word import Foreign.Ptrimport Foreign.C.Types type A = UArray Int Word8type B = StorableArray Int Word8type C = (UArray Int Word8,UArray Int Double) foreign import ccall unsafe "stdio.h" puts :: Ptr a -> IO ()foreign import ccall unsafe "string.h" strlen :: Ptr a -> IO CInt main :: IO () main = do n <- getArgs >>= readIO.head let !a = (listArray (0,(length alu)-1) $ map (fromIntegral. fromEnum) alu:: A) make "ONE" "Homo sapiens alu" (n*2) $ Main.repeat a (length alu) make "TWO" "IUB ambiguity codes" (n*3) $ random iub make "THREE" "Homo sapiens frequency" (n*5) $ random homosapiens make :: String -> String -> Int -> IO Word8 -> IO (){-# INLINE make #-}make id desc n f = do let lst = ">" ++ id ++ " " ++ desc a <- (newListArray (0,length lst) $ map (fromIntegral. fromEnum) lst:: IO B) unsafeWrite a (length lst) 0 pr a make' n 0 where make' :: Int -> Int -> IO () make' !n !i = do let line = (unsafePerformIO $ newArray (0,60) 0 :: B) if n > 0 then do !c <- f unsafeWrite line i c if i+1 >= 60 then do pr line make' (n-1) 0 else make' (n-1) (i+1) else do unsafeWrite line i 0 l <- len line if l /= 0 then pr line else return () pr :: B -> IO ()pr line = withStorableArray line (\ptr -> puts ptr)len :: B -> IO CIntlen line = withStorableArray line (\ptr -> strlen ptr) repeat :: A -> Int -> IO Word8repeat xs !n = do let v = unsafePerformIO $ newIORef 0 !i <- readIORef v if i+1 >= n then writeIORef v 0 else writeIORef v (i+1) return $ xs `unsafeAt` i random :: C -> IO Word8random (a,b) = do !rnd <- rand let find :: Int -> IO Word8 find !i = let !c = a `unsafeAt` i !p = b `unsafeAt` i in if p >= rnd then return c else find (i+1) find 0 rand :: IO Double{-# INLINE rand #-}rand = do !seed <- readIORef last let newseed = (seed * ia + ic) `rem` im newran = fromIntegral newseed * rimd rimd = 1.0 / (fromIntegral im) im, ia, ic :: Int im = 139968 ia = 3877 ic = 29573 writeIORef last newseed return newran where last = unsafePerformIO $ newIORef 42 alu :: [Char] alu = "GGCCGGGCGCGGTGGCTCACGCCTGTAATCCCAGCACTTTGG\ \GAGGCCGAGGCGGGCGGATCACCTGAGGTCAGGAGTTCGAGA\ \CCAGCCTGGCCAACATGGTGAAACCCCGTCTCTACTAAAAAT\ \ACAAAAATTAGCCGGGCGTGGTGGCGCGCGCCTGTAATCCCA\ \GCTACTCGGGAGGCTGAGGCAGGAGAATCGCTTGAACCCGGG\ \AGGCGGAGGTTGCAGTGAGCCGAGATCGCGCCACTGCACTCC\ \AGCCTGGGCGACAGAGCGAGACTCCGTCTCAAAAA" mkCum :: [(Char,Double)] -> [(Word8,Double)]mkCum lst = map (\(c,p) -> ((fromIntegral.fromEnum) c,p)) $ scanl1 (\(_,p) (c',p') -> (c', p+p')) lst homosapiens, iub :: C iub' = mkCum [('a',0.27),('c',0.12),('g',0.12),('t',0.27),('B',0.02) ,('D',0.02),('H',0.02),('K',0.02),('M',0.02),('N',0.02) ,('R',0.02),('S',0.02),('V',0.02),('W',0.02),('Y',0.02)] homosapiens' = mkCum [('a',0.3029549426680),('c',0.1979883004921) ,('g',0.1975473066391),('t',0.3015094502008)] iub = (listArray (0, (length iub')-1) $ map fst iub', listArray (0, (length iub')-1) $ map snd iub') homosapiens = (listArray (0, (length homosapiens')-1) $ map fst homosapiens', listArray (0, (length homosapiens')-1) $ map snd homosapiens')

2 4

Documentation operator
by Christopher Done 28 Dec '12

28 Dec '12

Hello chums, I've been playing around with an idea, something that has obvious pros and cons, but I'll sell it to you because there might be some positive ideas out of it. Consider the following operator: {-# LANGUAGE TypeOperators, DataKinds, KindSignatures #-} module Docs where import GHC.TypeLits type a ? (sym :: Symbol) = a First I'll describe how I'd want to use this and then what I think are the advantages and disadvantages. I call this (?) operator “the documentation operator”, to be used for: * Things that either don't belong or can't be encoded in the type system, or for things need to be in English. * Things that cannot be encoded in Haddock. The simple case of ye olde days: -- | Lorem ipsum dolor sit amet. Suspendisse lacinia nibh et -- leo. Aenean auctor aliquam dapibus. loremIpsum :: Int -> Int -> String Which has since been somewhat evolved into: loremIpsum :: Int -- ^ Lorem ipsum dolor sit amet. -> Int -- ^ Suspendisse lacinia nibh et leo. -> String -- ^ Aenean auctor aliquam dapibus. But could now be written: loremIpsum :: Int ? "Lorem ipsum dolor sit amet." -> Int ? "Suspendisse lacinia nibh et leo." -> String ? "Aenean auctor aliquam dapibus." Here is a contrived case I'll use later on: data Person = Person describeAge :: Int ? "an age" -> String ? "description of their elderliness" describeAge n = undefined personAge :: Person ? "a person" -> Int ? "their age" personAge = undefined One could also encode previously informal specifications more formally, so that -- | The action 'hFlush' @hdl@ causes any items buffered for output -- in handle @hdl@ to be sent immediately to the operating system. -- -- This operation may fail with: -- -- * 'isFullError' if the device is full; -- -- * 'isPermissionError' if a system resource limit would be exceeded. -- It is unspecified whether the characters in the buffer are discarded -- or retained under these circumstances. hFlush :: Handle -> IO () hFlush handle = wantWritableHandle "hFlush" handle flushWriteBuffer with type Throws ex (docs :: Symbol) = docs could now be written hFlush :: Handle ? "flush buffered items for output on this handle" -> IO () ? Throws IsFullError "if the device is full" ? Throws IsPermissionError "if a system resource limit would be exceeded. It is \ \unspecified whether the characters in the buffer are \ \discarded or retained under these circumstances." hFlush handle = wantWritableHandle "hFlush" handle flushWriteBuffer With this in place, in GHCi you get documentation "lookup" for free: > :t hFlush hFlush :: (Handle ? "flush buffered items for output on this handle") -> (IO () ? Throws IsFullError "if the device is full") ? Throws IsPermissionError "if a system resource limit would be exceeded. It is unspecified whether the characters in the buffer are discarded or retained under these circumstances." And you get function composition, or “documentation composition” for free: > :t describeAge . personAge describeAge . personAge :: (Person ? "a person") -> String ? "description of their elderliness" We could have a :td command to print it with docs, and otherwise docs could be stripped out trivially by removing the ? annotations: > :t describeAge . personAge describeAge . personAge :: Person -> String > :td describeAge . personAge describeAge . personAge :: (Person ? "a person") -> String ? "description of their elderliness" You could even add clever printing of such “documentation types”: > :t hFlush hFlush :: Handle — flush buffered items for output on this handle -> IO () Throws IsFullError if the device is full" Throws IsPermissionError if a system resource limit would be exceeded. It is unspecified whether the characters in the buffer are discarded or retained under these circumstances." Unfortunately it doesn't work with monadic composition, of course. So here are the advantages: * You get parsing for free (and anyone using haskell-src-exts). * You get checking for free (i.e. GHC can check that IsFullError exists for you). * You get a continuity of documentation through your operations including composition. * You can extend the "documentation language" easily by just defining some types (like the Throws I used above). SeeMore, Author, Deprecated, etc. Whatever. * You can print out some helpful looking documentation in GHCi based on these simple types. * There's no longer this informal "it might throw this exception" kind of pros we're forced to write. * It could also be used for annotations other than pure documentation, including testing. E.g. add a Testable "property" and then your test framework can search for functions with this Testable annotation. * Free of Haddock's syntax. Here are the disadvantages: * It doesn't work for types. * Writing big pros inside a string can be boring without a decent editor. * The neat composition trick only goes so far. * There might be a compilation overhead. * It would require an updated GHCi to strip them out when not wanted. * Requires GHC 7.6.1+. Conclusions: What we have now for documentation is pretty good, especially generated documentation. Compared to other languages Haskell is quite well documented, I feel. But we can do more with it. In some languages, documentation is built into the language. You can ask for documentation inside the REPL, it belongs to that piece of code. It shouldn't, I don't think, be left as a code comment which is essentially whitespace as far as the compiler is concerned. Two sweet ideas that I like from the above are: * The checking by GHC. * The extension of the "documentation language", with the ability to formalize things like what exceptions are thrown. * Composing functions generates "new" documentation that still makes sense. Thoughts? Ciao!

4 3

Non polymorphic numerals option -- avoiding type classes
by Rustom Mody 27 Dec '12

27 Dec '12

In haskell, we have Prelude> :t 4 4 :: Num a => a Prelude> This may be nice in its generality but it makes it hard (for me at least) when teaching a beginners course to teach polymorphic vs monomorphic types. The above leads to even more 'advanced' results like this: Prelude> :t [[1],2] [[1],2] :: (Num [t], Num t) => [[t]] Prelude> [[1],2] <interactive>:5:6: No instance for (Num [t0]) arising from the literal `2' Possible fix: add an instance declaration for (Num [t0]) In the expression: 2 In the expression: [[1], 2] In an equation for `it': it = [[1], 2] By contrast in gofer, numeric literals are monomorphic and no such peculiarities arise ? :t [[1],2] ERROR: Type error in list *** expression : [[1],2] *** term : 2 *** type : Int *** does not match : [Int] [[1],2] ERROR: Type error in list *** expression : [[1],2] *** term : 2 *** type : Int *** does not match : [Int] So is there any set of flags to make haskell literals less polymorphic? ie I want 3 to have type Int and 3.0 to have type Float. This is of course for beginning students to not see type classes too early

6 11

Decent docs to my visualization tools
by Eugene Kirpichov 27 Dec '12

27 Dec '12

Hi cafe, I just finally published a decent documentation website and binary distributions for my log visualization tools written in Haskell - http://jkff.info/software/timeplotters/ . I think now they might actually stand a chance of starting to be adopted by a wider circle than my friends :) Feedback and sharing would be very welcome. -- Eugene Kirpichov http://www.linkedin.com/in/eugenekirpichov

1 0

ANNOUNCE: haskell-docs - Given a module name and a name, it will find and display the documentation of that name.
by Christopher Done 27 Dec '12

27 Dec '12

Ahoy hoy, Just thought I'd announce a tool I whipped up these evening to take a module name and a name and output the installed Haddock documentation for it. Examples with my GHCi session: λ> :doc Data.List.Split split Split a list according to the given splitting strategy. This is how to "run" a Splitter that has been built using the other combinators. λ> :doc Control.Concurrent.MVar swapMVar Take a value from an MVar, put a new value into the MVar and return the value taken. This function is atomic only if there are no other producers for this MVar. λ> :doc Data.List sort Ambiguous module, belongs to more than one package: base haskell2010-1.1.0.1 Continuing anyway... Package: base The sort function implements a stable sorting algorithm. It is a special case of sortBy, which allows the programmer to supply their own comparison function. Please have a play with it, the package is at: http://hackage.haskell.org/package/haskell-docs It has installation instructions. Feel free to share any issues that you have, either here, or on the Github page: https://github.com/chrisdone/haskell-docs There are some issues to do with versioning that I'm not sure how to solve in a standard way. The obvious next step is to have a -package-conf flag so that it can be used with cabal-dev. The wizards on #haskell are currently thinking of a way to avoid having to write the module name and just use what's in scope. Ciao!

4 3

Virthualenv/HsEnv in Windows
by Kyle Hanson 27 Dec '12

27 Dec '12

Has anyone gotten this to work on Windows either native or on cygwin? Is there an alternative? Happy Holidays, Kyle Hanson

2 1

Type error when trying to adapt http-proxy to new conduit
by Pieter Laeremans 27 Dec '12

27 Dec '12

Hi, The http-proxy package isn't compatible any longer with the latest conduit. Since it is open source, I thought, I might as well try to adapt it and submit a patch. However I run into some difficulties. For example I get this type error when I'm trying to compile it : Network/HTTP/Proxy.hs:254:15: Couldn't match expected type `ResourceT IO (CIN.Pipe () () ByteString () (ResourceT IO) ())' with actual type `IO (CIN.Pipe () () ByteString () (ResourceT IO) ())' I can't figure it out. To me it reads like : Expected x, actual x. Anyone has a clue? thanks, Pieter -- Pieter Laeremans <pieter(a)laeremans.org> "The future is here. It's just not evenly distributed yet." W. Gibson

4 3