jdupes vs rmlint

jdupes is a free utility for finding and handling exact duplicate files on Linux, macOS, and Windows. It identifies files that are fully identical rather than matching images, sounds, or other formats by similarity. Matching can use file size, hashes, and byte-for-byte comparison, with optional partial-hash matching. The project says it checks matching data after hashing to reduce the chance of false matches from hash collisions. Found duplicates can be reviewed before deletion, deleted without prompting, linked, summarized, or handled through copy-on-write deduplication. On Linux and Unix, the instructions use command-line directory paths; the project also provides a native Windows port, including support for Unicode. Docker use is documented, and standard output can feed shell scripts. A database can retain scan metadata for repeat runs, though the project labels that feature as under development and notes quirks. The README warns that quick matching skips byte-for-byte checks and can classify non-duplicates as duplicates. It also warns that disabling file-change checks creates a security vulnerability, especially when linking or deleting. jdupes is distributed under the MIT License.

rmlint is free GPLv3 software that finds duplicate files and other filesystem waste, then offers candidates for removal. It scans local paths, mounted volumes and file lists supplied through standard input. Searches can identify duplicate files and directories, nonstripped binaries, broken symbolic links, empty files and directories, and files with broken user or group IDs. Duplicate checks support several hash methods and exact byte-by-byte comparison, with optional basename or extension matching. The documentation says scans can handle millions of files. Numerous output formats are available, and a previous run can be stored so later scans check only new files. File previews and automatic selection are provided. A Python graphical frontend, Shredder, ships with rmlint from version 2.4.0 onward. Shredder rechecks files before deletion, but its interface remains in development and should be used cautiously. Linux is the main target; the project also names FreeBSD, Darwin and Solaris. There is no built-in Recycle Bin or Trash.