GNU coreutils 9.11: Detailed Test report 06/04

[sylvestre]

This catalogues the remaining GNU coreutils 9.11 test-suite failures so they
can be tracked and worked on individually. Totals from the aggregated run:
~690 tests — 625 PASS / 55 FAIL / 9 SKIP / 1 ERROR.

Tests that cannot pass for structural reasons (they intercept glibc calls via
LD_PRELOAD, or drive uutils through gdb breakpoints) are separated into the
INCOMPATIBLE section, since they depend on internal implementation details we
do not match. A few entries are marked (intermittent) — they are listed in
.github/workflows/ignore-intermittent.txt and fail only sporadically.

---

FAILED Tests

• cat/splice.sh: cat splice() syscall code paths
• chmod/only-op.sh - PR chmod: always call chmod(2) even when mode bits are unchanged #13213 : chmod must still call chmod(2) even when the mode bits are unchanged
• cp/debug.sh - PR cp: Added error handling for printing debug message #12710: cp --debug output format
• cp/preserve-mode.sh - PR cp: don't open FIFOs/devices when preserving timestamps #13351: cp produces files with the correct modes
• cut/cut.pl - PR cut: support multibyte characters in non-UTF-8 locales #13194 : general cut behavior
• cut/mb-non-utf8.sh: cut in non-UTF-8 multibyte locales
• date/date.pl: comprehensive date parsing
• date/date-debug.sh: date --debug output
• dd/partial-write.sh: partial writes are properly diagnosed
• df/sync.sh: PR df: Syncing when paths are provided #12707 df --sync
• du/files0-from.pl - PR du: don't deduplicate --files0-from entries #13177 : du --files0-from
• env/env-signal-handler.sh - PR env: GNU-compatibility fixes #12657: env --default-signal=PIPE12657
• expand/mb.sh: expand with multibyte input
• fold/multiple-files.sh - PR fold: continue processing files after an open error #12668: fold with multiple files / pseudo-devices
• install/install-C.sh PR install: allow -C with --preserve-timestamps #13176: install -C (compare) mode
• ln/non-utf8-src.sh - PR ln: accept non-utf8 source names in target-dir modes #11403: ln non-UTF-8 source names in target-dir mode
• ls/quoting-utf8.sh - PR ls: use Unicode quotes for locale/clocale styles in UTF-8 locales #12675: --quoting-style=locale/clocale Unicode quotes in UTF-8 locales
• ls/stat-free-symlinks.sh: ls should not stat a symlink in this unusual case
• misc/close-stdout.sh: programs run with stdout initially closed
• misc/getopt_vs_usage.sh: every supported option is mentioned in usage
• misc/read-errors.sh: programs diagnose read errors
• misc/responsive.sh: programs stay responsive to input
• misc/selinux.sh: SELinux-related options
• misc/stdbuf.sh: stdbuf line/block buffering (intermittent)
• misc/usage_vs_refs.sh - PR Removing usage_vs_refs from comparison gnu test suite #10896: every supported option has references in docs
• misc/warning-errors.sh: failure to write warnings is handled gracefully
• misc/write-errors.sh: programs promptly diagnose write errors
• mkdir/smack-no-root.sh: SMACK labels for mkdir/mknod/mkfifo
• mktemp/write-error.sh: mktemp when it fails to write the name to stdout
• mv/dir2dir.sh - PR mv: use 'cannot overwrite TARGET: Directory not empty' for non-empty dir target #12124: diagnostic for a dir→dir move into a non-empty dir
• mv/mv-exchange.sh: mv --exchange
• mv/mv-special-2.sh: mv non-standard copies across file systems
• nl/multibyte.sh: nl with multibyte section delimiters
• nproc/nproc-quota-systemd.sh - PR nproc: PASS nproc-quota-systemd.sh (manually parse cgroups2 quota) #12871 -: nproc honoring cgroup quotas + systemd scheduler
• od/od-float.sh: od on floating-point values
• od/od-j.sh: od -j N skips N bytes of input
• pr/bounded-memory.sh: pr on files larger than memory (intermittent)
• pr/pr-tests.pl: comprehensive pr page-formatting tests
• ptx/ptx-overrun.sh - PR ptx: fix panic caused by improper assert #10916: ptx input overrun panic
• pwd/argument.sh: PR pwd: ignore non-option arguments, drop getcwd disabling from pwd-long test #12610: pwd given an argument
• pwd/pwd-long.pl: PR pwd: ignore non-option arguments, drop getcwd disabling from pwd-long test #12610: pwd run from a very deep directory
• rm/dash-hint.sh: PR rm: hint to use ./-foo when removing a dash-prefixed file #12608 rm -foo gives a hint to the user
• rm/one-file-system.sh - PR rm: one-file-system #12819: rm --one-file-system
• sort/sort-merge-fdlimit.sh - PR sort: deduplicate file descriptors in merge mode #11961: sort avoids exceeding its fd limit when merging
• split/split-io-err.sh - PR split: fix I/O error handling for device full conditions #11239: split handles I/O errors (via /dev/full)
• tail/debug.sh: tail --debug output
• tail/follow-name.sh: --follow=name must not imply --retry (intermittent)
• tail/inotify-rotate-resources.sh: tail -F must not leak inotify resources
• touch/empty-file.sh - PR touch: do not hang on a reader-less FIFO #12735: touch sets mtime on an empty file (avoid O_TRUNC)
• touch/fifo.sh - PR touch: do not hang on a reader-less FIFO #12735: touch works on fifos without hanging
• touch/no-rights.sh - PR touch: do not hang on a reader-less FIFO #12735: touch updates times on a non-readable/non-writable file
• truncate/multiple-files.sh: PR truncate: process all files when one fails #12734 truncate processes all arguments
• unexpand/mb.sh: unexpand with multibyte input

---

SKIPPED Tests

• id/gnu-zero-uids.sh: id must fail for processes with zero UIDs
• printf/printf-surprise.sh: detect printf(3) failure even without a stream error indicator
• sort/sort-locale.sh: locale-aware sort ordering

---

INCOMPATIBLE Tests

Tests using LD_PRELOAD or gdb breakpoints cannot be fixed without matching
internal implementation details:

• cp/nfs-removal-race.sh (LD_PRELOAD): NFS client removal race during cp S D
• dd/fail-ftruncate-fstat.sh (LD_PRELOAD): dd must stop copying when ftruncate/fstat fail
• df/skip-duplicates.sh (LD_PRELOAD): duplicate mount-list entry injection
• nproc/nproc-quota.sh (LD_PRELOAD): cgroup-quota injection for nproc
• rm/r-root.sh (LD_PRELOAD + gdb): tries to remove / recursively
• rm/rm-readdir-fail.sh (LD_PRELOAD) - PR rm: overriding the libc call when implementation does not match gnu coreutils exactly #9604: simulates readdir failures
• tail/inotify-race.sh (gdb): append-during-initial-read race
• tail/inotify-race2.sh (gdb): file-replaced-during-initial-read race

---

ERROR Tests

• cp/cp-a-selinux.sh: cp -Z, -a and --preserve=context on a writable NFS partition

[oech3]

cat/splice.sh requires to carch EIO of splice which will never be returned https://man.archlinux.org/man/splice.2.en . I think we should change test suite itself.

[sylvestre]

sounds good, would you like to do it?

[oech3]

I'l talk with GNU instead of patching tests at here.

[oech3]

Ok. Out cat does not have write error: even for read/write code path. It takes many refactoring to fix.

[oech3]

smack-no-root.sh: regressed at #11431 (comment) .
This is CI's issue instead of compatibility issue.