A command-line tool for deduplicating entries in a file or stream.

一个基于深度学习特征和余弦相似度的高性能图像去重工具，能够快速、准确地从海量图像中找出并移除重复或高度相似的图片。

yet another file deduplicator

Sift duplicate whitespaces away!

Project to take two similar zipfiles, and to dedupe files that have the same tiemstamp in the older file.

Duplicate file finder and de-duplicator. A tool that detects duplicate files and replaces them with symlinks to a shared file in a special shared files folder.

Analyse 2 paths to found identical files and hard link them to save space

A NiFi processor that deduplicates incoming data using an existing Redis connection pool service.

CloneReaper is a high performance deduper/deduplicator for Windows, and Linux. With hardlink/symlink support, it enables you to keep files in the same place while saving space. Supports reporting in TXT, JSON, and CSV with optional emails.

File de-duplicator written in Rust.

A web app that finds and removes duplicates in your Spotify playlists.

GraphQL response deduplication by mapping entities.

Utility for automatic Git repository deduplication