make check failures

[Toebs Douglass <toby at winterflaw dot net>]

So!

"make check" is not completely happy.

Summary of test results:
    266 FAIL
   1910 PASS
    200 XFAIL
      2 XPASS

Is this usual?  it is not entirely unknown for tests suites to never
fully pass, but this seems more than might be reasonably expected.

Also, what's the difference between FAIL and XFAIL?

I vaguely remember maybe reading "make check" should be run single
threaded (i.e. -j 1).  Is this known to be true?  (I'm about to try it -
but it will by its nature take a little while).

Is it possible to obtain any information on the error which led to each
failure?  the output files from the tests are not helpful, e.g.;

> cat /tmp/buildglibc/nptl/tst-rwlock10.test-result
FAIL: nptl/tst-rwlock10
original exit status 1

OTOH, the output from the glibc build seems right;

> file rpcgen
rpcgen: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically
linked, interpreter
/usr/local/glibc/glibc-2.21/lib/ld-linux-x86-64.so.2, for GNU/Linux
4.7.0, not stripped

The full list of "make check" failures is below;

FAIL: conform/ISO/errno.h/conform
FAIL: conform/ISO/float.h/conform
FAIL: conform/ISO/limits.h/conform
FAIL: conform/ISO/locale.h/conform
FAIL: conform/ISO/signal.h/conform
FAIL: conform/ISO/stddef.h/conform
FAIL: conform/ISO/stdio.h/conform
FAIL: conform/ISO/stdlib.h/conform
FAIL: conform/ISO/string.h/conform
FAIL: conform/ISO/time.h/conform
FAIL: conform/ISO11/errno.h/conform
FAIL: conform/ISO11/fenv.h/conform
FAIL: conform/ISO11/float.h/conform
FAIL: conform/ISO11/inttypes.h/conform
FAIL: conform/ISO11/limits.h/conform
FAIL: conform/ISO11/locale.h/conform
FAIL: conform/ISO11/math.h/conform
FAIL: conform/ISO11/signal.h/conform
FAIL: conform/ISO11/stdbool.h/conform
FAIL: conform/ISO11/stddef.h/conform
FAIL: conform/ISO11/stdint.h/conform
FAIL: conform/ISO11/stdio.h/conform
FAIL: conform/ISO11/stdlib.h/conform
FAIL: conform/ISO11/string.h/conform
FAIL: conform/ISO11/tgmath.h/conform
FAIL: conform/ISO11/time.h/conform
FAIL: conform/ISO11/wchar.h/conform
FAIL: conform/ISO99/errno.h/conform
FAIL: conform/ISO99/fenv.h/conform
FAIL: conform/ISO99/float.h/conform
FAIL: conform/ISO99/inttypes.h/conform
FAIL: conform/ISO99/limits.h/conform
FAIL: conform/ISO99/locale.h/conform
FAIL: conform/ISO99/math.h/conform
FAIL: conform/ISO99/signal.h/conform
FAIL: conform/ISO99/stdbool.h/conform
FAIL: conform/ISO99/stddef.h/conform
FAIL: conform/ISO99/stdint.h/conform
FAIL: conform/ISO99/stdio.h/conform
FAIL: conform/ISO99/stdlib.h/conform
FAIL: conform/ISO99/string.h/conform
FAIL: conform/ISO99/tgmath.h/conform
FAIL: conform/ISO99/time.h/conform
FAIL: conform/ISO99/wchar.h/conform
FAIL: conform/POSIX/errno.h/conform
FAIL: conform/POSIX/float.h/conform
FAIL: conform/POSIX/limits.h/conform
FAIL: conform/POSIX/locale.h/conform
FAIL: conform/POSIX/sched.h/conform
FAIL: conform/POSIX/signal.h/conform
FAIL: conform/POSIX/stddef.h/conform
FAIL: conform/POSIX/stdio.h/conform
FAIL: conform/POSIX/stdlib.h/conform
FAIL: conform/POSIX/string.h/conform
FAIL: conform/POSIX/tar.h/conform
FAIL: conform/POSIX/time.h/conform
FAIL: conform/POSIX2008/cpio.h/conform
FAIL: conform/POSIX2008/errno.h/conform
FAIL: conform/POSIX2008/fenv.h/conform
FAIL: conform/POSIX2008/float.h/conform
FAIL: conform/POSIX2008/inttypes.h/conform
FAIL: conform/POSIX2008/limits.h/conform
FAIL: conform/POSIX2008/locale.h/conform
FAIL: conform/POSIX2008/math.h/conform
FAIL: conform/POSIX2008/stdbool.h/conform
FAIL: conform/POSIX2008/stddef.h/conform
FAIL: conform/POSIX2008/stdint.h/conform
FAIL: conform/POSIX2008/stdio.h/conform
FAIL: conform/POSIX2008/stdlib.h/conform
FAIL: conform/POSIX2008/string.h/conform
FAIL: conform/POSIX2008/tar.h/conform
FAIL: conform/POSIX2008/tgmath.h/conform
FAIL: conform/POSIX2008/time.h/conform
FAIL: conform/POSIX2008/wchar.h/conform
FAIL: conform/UNIX98/cpio.h/conform
FAIL: conform/UNIX98/errno.h/conform
FAIL: conform/UNIX98/float.h/conform
FAIL: conform/UNIX98/fmtmsg.h/conform
FAIL: conform/UNIX98/limits.h/conform
FAIL: conform/UNIX98/locale.h/conform
FAIL: conform/UNIX98/sched.h/conform
FAIL: conform/UNIX98/stddef.h/conform
FAIL: conform/UNIX98/string.h/conform
FAIL: conform/UNIX98/tar.h/conform
FAIL: conform/UNIX98/time.h/conform
FAIL: conform/UNIX98/wchar.h/conform
FAIL: conform/XOPEN2K/cpio.h/conform
FAIL: conform/XOPEN2K/errno.h/conform
FAIL: conform/XOPEN2K/fenv.h/conform
FAIL: conform/XOPEN2K/float.h/conform
FAIL: conform/XOPEN2K/fmtmsg.h/conform
FAIL: conform/XOPEN2K/inttypes.h/conform
FAIL: conform/XOPEN2K/limits.h/conform
FAIL: conform/XOPEN2K/locale.h/conform
FAIL: conform/XOPEN2K/stdbool.h/conform
FAIL: conform/XOPEN2K/stddef.h/conform
FAIL: conform/XOPEN2K/stdint.h/conform
FAIL: conform/XOPEN2K/stdlib.h/conform
FAIL: conform/XOPEN2K/string.h/conform
FAIL: conform/XOPEN2K/tar.h/conform
FAIL: conform/XOPEN2K/time.h/conform
FAIL: conform/XOPEN2K/wchar.h/conform
FAIL: conform/XOPEN2K8/cpio.h/conform
FAIL: conform/XOPEN2K8/errno.h/conform
FAIL: conform/XOPEN2K8/fenv.h/conform
FAIL: conform/XOPEN2K8/float.h/conform
FAIL: conform/XOPEN2K8/fmtmsg.h/conform
FAIL: conform/XOPEN2K8/inttypes.h/conform
FAIL: conform/XOPEN2K8/locale.h/conform
FAIL: conform/XOPEN2K8/stdbool.h/conform
FAIL: conform/XOPEN2K8/stddef.h/conform
FAIL: conform/XOPEN2K8/stdint.h/conform
FAIL: conform/XOPEN2K8/stdlib.h/conform
FAIL: conform/XOPEN2K8/string.h/conform
FAIL: conform/XOPEN2K8/tar.h/conform
FAIL: conform/XOPEN2K8/time.h/conform
FAIL: conform/XOPEN2K8/wchar.h/conform
FAIL: conform/XPG3/cpio.h/conform
FAIL: conform/XPG3/errno.h/conform
FAIL: conform/XPG3/float.h/conform
FAIL: conform/XPG3/locale.h/conform
FAIL: conform/XPG3/stddef.h/conform
FAIL: conform/XPG3/tar.h/conform
FAIL: conform/XPG4/cpio.h/conform
FAIL: conform/XPG4/errno.h/conform
FAIL: conform/XPG4/float.h/conform
FAIL: conform/XPG4/fmtmsg.h/conform
FAIL: conform/XPG4/limits.h/conform
FAIL: conform/XPG4/locale.h/conform
FAIL: conform/XPG4/stddef.h/conform
FAIL: conform/XPG4/string.h/conform
FAIL: conform/XPG4/tar.h/conform
FAIL: conform/XPG4/time.h/conform
FAIL: debug/tst-backtrace2
FAIL: debug/tst-backtrace3
FAIL: debug/tst-backtrace4
FAIL: debug/tst-backtrace5
FAIL: debug/tst-backtrace6
FAIL: debug/tst-chk4
FAIL: debug/tst-chk5
FAIL: debug/tst-chk6
FAIL: debug/tst-lfschk4
FAIL: debug/tst-lfschk5
FAIL: debug/tst-lfschk6
FAIL: dlfcn/bug-atexit3
FAIL: elf/check-abi-libc
FAIL: localedata/tst-setlocale3
FAIL: nptl/tst-barrier3
FAIL: nptl/tst-basic3
FAIL: nptl/tst-basic4
FAIL: nptl/tst-cancel-self
FAIL: nptl/tst-cancel-self-cancelstate
FAIL: nptl/tst-cancel-self-canceltype
FAIL: nptl/tst-cancel-self-testcancel
FAIL: nptl/tst-cancel1
FAIL: nptl/tst-cancel10
FAIL: nptl/tst-cancel11
FAIL: nptl/tst-cancel12
FAIL: nptl/tst-cancel13
FAIL: nptl/tst-cancel14
FAIL: nptl/tst-cancel15
FAIL: nptl/tst-cancel16
FAIL: nptl/tst-cancel17
FAIL: nptl/tst-cancel18
FAIL: nptl/tst-cancel2
FAIL: nptl/tst-cancel20
FAIL: nptl/tst-cancel21
FAIL: nptl/tst-cancel22
FAIL: nptl/tst-cancel23
FAIL: nptl/tst-cancel24
FAIL: nptl/tst-cancel25
FAIL: nptl/tst-cancel3
FAIL: nptl/tst-cancel4
FAIL: nptl/tst-cancel5
FAIL: nptl/tst-cancel6
FAIL: nptl/tst-cancel7
FAIL: nptl/tst-cancel8
FAIL: nptl/tst-cancel9
FAIL: nptl/tst-cancelx10
FAIL: nptl/tst-cancelx11
FAIL: nptl/tst-cancelx12
FAIL: nptl/tst-cancelx13
FAIL: nptl/tst-cancelx14
FAIL: nptl/tst-cancelx15
FAIL: nptl/tst-cancelx16
FAIL: nptl/tst-cancelx17
FAIL: nptl/tst-cancelx18
FAIL: nptl/tst-cancelx2
FAIL: nptl/tst-cancelx20
FAIL: nptl/tst-cancelx21
FAIL: nptl/tst-cancelx3
FAIL: nptl/tst-cancelx4
FAIL: nptl/tst-cancelx5
FAIL: nptl/tst-cancelx6
FAIL: nptl/tst-cancelx7
FAIL: nptl/tst-cancelx8
FAIL: nptl/tst-cancelx9
FAIL: nptl/tst-cleanup0
FAIL: nptl/tst-cleanup0-cmp
FAIL: nptl/tst-cleanup1
FAIL: nptl/tst-cleanup3
FAIL: nptl/tst-cleanup4
FAIL: nptl/tst-cleanupx0
FAIL: nptl/tst-cleanupx1
FAIL: nptl/tst-cleanupx3
FAIL: nptl/tst-cleanupx4
FAIL: nptl/tst-cond-except
FAIL: nptl/tst-cond20
FAIL: nptl/tst-cond21
FAIL: nptl/tst-cond22
FAIL: nptl/tst-cond25
FAIL: nptl/tst-cond3
FAIL: nptl/tst-cond7
FAIL: nptl/tst-cond8
FAIL: nptl/tst-default-attr
FAIL: nptl/tst-eintr1
FAIL: nptl/tst-execstack
FAIL: nptl/tst-exit2
FAIL: nptl/tst-exit3
FAIL: nptl/tst-fini1
FAIL: nptl/tst-join1
FAIL: nptl/tst-join5
FAIL: nptl/tst-join6
FAIL: nptl/tst-key3
FAIL: nptl/tst-mutex7
FAIL: nptl/tst-mutex7a
FAIL: nptl/tst-mutex8
FAIL: nptl/tst-mutexpi7
FAIL: nptl/tst-mutexpi7a
FAIL: nptl/tst-mutexpi8
FAIL: nptl/tst-once2
FAIL: nptl/tst-once3
FAIL: nptl/tst-once4
FAIL: nptl/tst-oncex3
FAIL: nptl/tst-oncex4
FAIL: nptl/tst-robust1
FAIL: nptl/tst-robust2
FAIL: nptl/tst-robust3
FAIL: nptl/tst-robust4
FAIL: nptl/tst-robust5
FAIL: nptl/tst-robust6
FAIL: nptl/tst-robust7
FAIL: nptl/tst-robust8
FAIL: nptl/tst-robustpi1
FAIL: nptl/tst-robustpi2
FAIL: nptl/tst-robustpi3
FAIL: nptl/tst-robustpi4
FAIL: nptl/tst-robustpi5
FAIL: nptl/tst-robustpi6
FAIL: nptl/tst-robustpi7
FAIL: nptl/tst-robustpi8
FAIL: nptl/tst-rwlock10
FAIL: nptl/tst-rwlock11
FAIL: nptl/tst-rwlock8
FAIL: nptl/tst-rwlock9
FAIL: nptl/tst-sem11
FAIL: nptl/tst-sem12
FAIL: nptl/tst-sem14
FAIL: nptl/tst-stack4
FAIL: nptl/tst-tsd5
FAIL: rt/tst-cpuclock2
FAIL: rt/tst-mqueue8
FAIL: rt/tst-mqueue8x
FAIL: stdio-common/bug22
FAIL: stdio-common/test-vfprintf
FAIL: stdio-common/tst-sprintf