but isn't there a short text that describes in detail why foldl' is
different from foldl and why foldr is "better" in many cases? I thought
this faq would have been cached already :)

Perhaps you're thinking of http://haskell.org/haskellwiki/Stack_overflow ?

-Brent