Thanks for pointing out that virus scanners could be an issue. I found that Microsoft Security Essentials realtime scanning was on. I'll try disabling it and see if that helps with the -j5 case.
For what it's worth, I tried disabling the virus scanner, but it did not help, 4/8 validation runs segfaulted (-j5).