Ok, I got GHC compiled but running it is a tricky. It has trouble finding package.conf.

It looks like you've done 'make install'. On Windows, we don't support doing that, because it conflicts with the way we layout binary distributions. If you build GHC from source, just run it from the source tree, as ghc/compiler/stage2/ghc-inplace. Cheers, Simon