The One-Stop Guide to DeDuck
A complete, layman-friendly reference manual for cataloging drives, removing duplicates, curating master libraries, and establishing 3-2-1 backup protection without ever risking your originals.
Core Philosophy & The 5 Golden Rules of Safety
Most computer utilities rush to delete files to show immediate disk space gains. DeDuck is built on the opposite philosophy: evidence before action, and preservation above all else.
Whether you have 20 years of family photos scattered across five external hard drives, dusty USB thumb drives in desk drawers, or complex camera SD cards, DeDuck acts as an impartial auditor and patient curator. It inventories your drives, proves beyond any mathematical doubt which files are duplicates, and helps you organize them into clean rows without ever endangering your precious originals.
1. Read-Only by Default
Scanning, analyzing, comparing, and reporting never modify a single byte of your files or drive directories. Everything DeDuck learns is stored inside its own local database.
2. Zero Permanent Deletion
DeDuck never permanently unlinks or destroys your files. Cleanup actions strictly move redundant copies to the native Operating System Trash or isolated Quarantine.
3. Source-Volume Trash Awareness
Files on external drives or USB sticks are moved to that specific drive's native Trash (.Trashes). They are never slowly copied across your bus to clog your internal computer SSD.
4. Full Audit Trail Logs
Every single cleanup and folder reconciliation generates an immutable timestamped CSV audit log recording exact filenames, file paths, file sizes, modification dates, and actions taken.
The Golden Keeper Guarantee
DeDuck will never allow a duplicate group to be emptied. When 4 identical copies exist, DeDuck strictly ensures that at least 1 verified master copy ("The Keeper") remains securely preserved in place.
Getting Started & Your First Folder Scan
Getting started takes less than two minutes. DeDuck is completely portable and requires no account registration, no cloud login, and no background tracking daemons.
Download and Launch
Download the installer for your operating system (macOS .dmg or Windows .exe). On macOS, drag DeDuck to your Applications folder. When prompted on macOS, grant Full Disk Access in System Settings → Privacy & Security so DeDuck can read files on connected external drives.
Add Your First Folder or Drive
Click on the SCAN tab in the top navigation bar. Click the amber “Add folder…” button. A standard native system dialog will open. Select any folder, photos directory, USB thumb drive, or external hard drive volume. DeDuck begins indexing immediately.
Monitor Live Scan Progress
The persistent top banner displays live progress: the number of files scanned, total gigabytes walked, current scanning speed, estimated time remaining (ETA), and instant Pause and Stop controls. You can safely stop a scan at any point without losing progress.
Lightning-Fast Incremental Rescans
When you reconnect a drive weeks later and click “Rescan all…”, DeDuck uses file signature caching. Unchanged files are recognized in milliseconds and skipped automatically, scanning hundreds of thousands of files in just seconds.
Pro-Tip: Removing a Folder from DeDuck
If you click the × button next to a folder card on the Scan tab, DeDuck removes only its internal database index. It never deletes your folder or your files from your hard drive. You can re-scan it anytime.
Scan Tab: Deep Inventory & Smart Categorization
DeDuck's Scan tab is much more than a file list. It is an intelligent inventory engine designed to separate your genuine treasures from digital clutter and technical system files.
Modern applications, cameras, and operating systems create hundreds of hidden metadata sidecars and cache files. In inferior tools, these technical files clutter your search or lead to accidental deletion. DeDuck categorizes every file with context-aware precision into 8 distinct categories:
| Category | Typical Extensions | What It Represents & Why It Matters |
|---|---|---|
| Images | .heic, .jpg, .png, .raw, .cr3, .nef |
Photos and graphic assets. Scanned for EXIF capture dates, camera models, and GPS coordinates. |
| Videos | .mov, .mp4, .m4v, .avi, .mkv |
Video recordings and movies. Typically the largest consumers of disk storage space. |
| Audio | .mp3, .m4a, .flac, .wav, .aac |
Music albums, voice memos, podcasts, and sound recordings. |
| Documents | .pdf, .docx, .xlsx, .pages, .txt |
Office work, spreadsheets, reports, scanned receipts, and written notes. |
| Metadata | .aae, .xmp, .thm |
Apple iPhone photo edit instructions (.aae) and Lightroom sidecars (.xmp). Protected so you don't lose photo edits! |
| System Clutter | .lrprev, .ds_store, Thumbs.db, ~$* |
Lightroom preview caches, OS index caches, and temporary files that can be reclaimed safely. |
| Code & Scripts | .py, .js, .html, .sh, .json |
Programming source files, configuration scripts, and web development assets. |
| Archives & Other | .zip, .tar, .dmg, .iso |
Compressed containers, disk images, installer files, and miscellaneous binary formats. |
Exploring Your Files: On the right side of the Scan tab, the “All Files” browser lets you search filenames instantly, filter by category pills, switch between List, Icon, and Thumbnail views, and sort by file size or last modified date. Below the main browser, you will find cards displaying your Largest Files, Largest Folders, and Collections.
Every scanned folder card includes a direct “Reveal folder in Finder / Explorer” button so you can instantly open that exact disk path in your operating system with one click.
Dedupe Tab: 5-Level Detection & Transparent Keepers
Two files having the same name does not mean they are duplicates. And two files with completely different names might be 100% identical. DeDuck does not guess; it proves identity through five escalating levels of certainty.
Level 1: Byte-Size Filter
If two files differ by even a single byte in length, they mathematically cannot be identical. Millions of non-duplicates are eliminated instantly without touching disk contents.
Level 2: xxHash64 Fast Fingerprint
A lightning-fast non-cryptographic checksum calculated over file sample blocks. Narrows down suspected duplicates with minimal CPU and disk consumption.
Level 3: Full SHA-256 Cryptographic Hash
The entire content of each suspected file is hashed using military-grade SHA-256. If the hashes match, the files are mathematically proven byte-for-byte clones.
Level 4: Media Header & Codec Validation
For photos and videos, DeDuck inspects container structures and decoded streams to verify that files aren't corrupt or truncated zero-byte placeholders.
Level 5: Perceptual Visual Similarity (Look-Alike Photos)
When you tick “Include Similar Photos”, DeDuck generates a perceptual visual hash (pHash). It groups photos that look identical to human eyes—such as camera burst shots, photos resized for Instagram or email, or pictures with slight exposure tweaks. Exact duplicates and Similar photos are kept in separate statistic cards and never overlap!
Transparent Keeper Selection & Pre-Library Decision
When duplicates are discovered, DeDuck marks one copy as The Keeper based on your preference (Newest modified, Oldest original, or Shortest file path). The keeper is indicated with a clean badge. You can change the keeper to any other copy with a single click at any time.
Pre-Library Decision: When you decide to build a Master Library from folders containing duplicates, DeDuck offers a clear choice: you can review and clean up duplicates first, or choose “Build Library as-is”. Building as-is automatically de-duplicates files inside the new library copy while leaving your original source folders completely untouched.
Compare Tab: Folder Matching, Conflicts & Persistent Undo
Compare is DeDuck's side-by-side reconciliation powerhouse. It is designed for real-world scenarios: comparing a camera SD card against your laptop's photo folder, or checking if Backup Drive B has everything from Drive A.
Content-Hash Matching
DeDuck compares files by their cryptographic hash, not just filenames. If you renamed IMG_001.JPG to Sunset_Rome.JPG on Drive B, DeDuck recognizes that the file already exists on both sides!
Filter Categories at a Glance
The “Show” dropdown lets you view: All, Unmatched (files missing on the other side), Conflicts (files sharing the same relative path but different contents), or Matched.
Additive Reconciliation Modes
When copying files across folders to reconcile them, DeDuck is strictly additive. It never deletes or overwrites existing files. Copies mirror the source folder structure perfectly:
- Make A = B (Two-Way Sync): Copies missing files from B into A, and missing files from A into B. Both sides now contain the union of all files.
- Fill A (A &sup877; B): Copies files present in B that are missing in A across to folder A. Folder B is not altered.
- Fill B (B &sup877; A): Copies files present in A that are missing in B across to folder B. Folder A is not altered.
- Selective Row Copying: Tick individual files in either pane and click “Copy selected →” to copy only chosen items.
Instant Auto-Refresh & Persistent Undo
The moment any reconciliation copy completes, Compare auto-refreshes both tables. A prominent, persistent “Undo” button appears next to Clear All and in the top status bar. Clicking Undo safely moves the copied destination files to Trash, leaving all original source files 100% untouched.
Conflict Handling with ~from: If both folders have a file named Notes.txt but their contents are different, DeDuck refuses to overwrite either copy. It preserves the destination file and copies the source file with a safe suffix (e.g., Notes~from_FolderA.txt) so you can review both versions at your leisure.
Library Tab: Multi-Folder Curation & Disk Sync
A DeDuck Master Library (DDL<n>_<name>) is a dedicated, pristine copy of your files, neatly filed and deduplicated. Your original scanned folders are never modified, moved, or deleted.
In DeDuck 1.1.0, the Library tab has been completely redesigned with powerful batch workflows, multi-selection capabilities, and real-time disk synchronization.
Multi-Selection & Bulk Actions
Checkboxes on scanned folders and existing libraries let you perform batch operations. Select multiple folders and use the action bar to [Scan], [Compare], [Create Library], or [Merge...] with one click.
The Semantic Guarantee
“Nothing happens to an unselected folder.” Single-folder actions operate strictly on that folder. Multi-selection actions operate strictly on the checked folders. You are always in control.
Flexible Organization Schemes
Choose how files are organized inside the library: By Asset Type (Photos, Videos, Docs), Chronologically (Year / Month), Flat, or by Preserving Original Folder Structure.
Safe Database Removal vs. Deletion
Clicking “Remove from DeDuck” removes only DeDuck's catalog records. The physical library folder and all files on disk remain completely untouched.
Synchronizing Changes Made on Disk (Finder / Explorer)
If you reorganize files, add new photos, or delete files directly inside a Library folder in macOS Finder or Windows Explorer, DeDuck detects the discrepancy. Clicking “Refresh from folder on disk” triggers sync_library_from_disk, which updates DeDuck's database to mirror disk reality without requiring a full rebuild.
Restoring Existing Libraries: If you move to a new computer or reinstall your operating system, click “Restore…” on the Library tab. DeDuck scans your disk for existing DDL folders and re-registers them into your catalog with their full history intact.
Recent Scans Panel: Directly on the Library tab, a Recent Scans section shows your latest cataloged roots with one-click buttons to Rescan, Compare, Create Library, or Safely Remove.
Backups Tab: 3-2-1 Protection & AES-256 Encryption
Organizing your files is only half the battle. If your drive crashes tomorrow, organization won't save your memories. DeDuck implements the industry gold-standard 3-2-1 Backup Strategy directly into its workflow.
3 Copies of Data
Keep your primary Master copy (on your computer or DeDuck Library) plus at least two independent backup duplicates.
2 Different Media
Store your copies on at least two distinct storage formats (e.g., your computer's internal SSD and an external USB hard drive or NAS).
1 Offsite Copy
Keep at least one copy in a geographically separate location (such as secure cloud storage) to protect against fire, theft, or flood.
Symmetrical Source & Destination Architecture
DeDuck features a symmetrical backup setup: you can select any Master Source (a curated DeDuck Library or any scanned folder) and pair it with any Backup Destination (an external volume, network drive, or cloud provider). DeDuck's protection engine audits your entire archive and produces a clear status report showing which files have verified local and offsite coverage, and which files remain at risk.
Client-Side AES-256 Encryption for Cloud Backups
When you sync your backups to offsite cloud destinations using DeDuck's backup tools (scripts/deduck_offsite_backup.sh), files are encrypted with military-grade AES-256 encryption using your private passphrase before they leave your machine. Cloud storage providers receive only scrambled ciphertext—they can never see your photos, filenames, or documents.
Cloud Reconciliation: Bypassing macOS Dataless Bugs
Modern cloud desktop applications (like Google Drive and OneDrive) use "Files On-Demand" or File Provider placeholders to save local disk space. Unfortunately, this creates severe problems for file management utilities.
In macOS Finder, dataless cloud placeholders often appear as empty files reporting 0 files / 0 Bytes. Standard file cleaners mistakenly report that your folders are empty, or fail completely when trying to verify backups.
The Dataless Placeholder Problem
If you inspect a Google Drive folder in Finder, macOS File Provider may report 0 files because the actual file bytes are stored in the cloud. Attempting to copy or verify files locally can cause system timeouts or false reports.
The Google Drive Direct API Reconciliation Engine
DeDuck solves this permanently by connecting directly to the Google Drive API using a secure, strictly read-only metadata scope (drive.metadata.readonly). DeDuck bypasses macOS File Provider limitations entirely, querying the authoritative cloud inventory directly.
DeDuck compares your local recovery folder against the cloud inventory using cryptographic MD5 checksums and classifies every file into one of 5 Reconciliation Buckets:
- Already in Cloud: The file is present locally and identical in the cloud. Safe and protected.
- Local Only: The file exists on your local machine but has not yet been uploaded to the cloud. Needs backup!
- Cloud Only: The file exists in your Google Drive cloud archive but is not on your local machine (a dataless placeholder or cloud-only file).
- Conflicts: The file exists in both places under the same path, but the contents or modification timestamps differ.
- MD5 Verified: Cryptographic checksum confirmation that cloud bytes and local bytes match 100%.
Strictly Read-Only Guarantee: Cloud reconciliation never modifies, overwrites, deletes, or uploads files. It provides transparent audit visibility without any risk of accidental cloud alteration.
Activity, Audit Logs & Digital Clutter Reports
DeDuck believes in absolute accountability. Every operation performed within the app is recorded in an audit log, and you can generate executive-level shareable reports on demand.
Digital Clutter Report
Generates a beautiful, shareable HTML report with an overall tidiness grade (A through F), reclaimable space tally, storage breakdown by category, and biggest duplicate groups. Save as PDF or print with 1 click.
Quarantine Manager
Files moved to Quarantine are isolated in ~/Documents/DeDuck Assets/Quarantine. The Activity tab allows you to inspect quarantined batches, restore them to their original location, or purge them when satisfied.
Bit-Rot & Integrity Checks
Over time, storage drives degrade (bit-rot). DeDuck can re-verify stored hashes against physical drive files to confirm that your files have not suffered silent corruption.
Automatic Retention Preferences
In Settings → Reports & History, you can configure retention policies (Keep newest 10, 20, 50, 100, or Everything) to automatically prune older logs while keeping recent audits clean.
How DeDuck Handles Deleted Files (Zero Deletion Guarantee)
Many users are terrified of duplicate cleaners because one bug can wipe out years of irreplaceable memories. Here is exactly how DeDuck handles file cleanups with absolute mechanical safety:
The 6 Pillars of DeDuck Cleanup Safety
- Zero Permanent Deletion: DeDuck NEVER permanently deletes your personal files. Cleaned-up files are moved strictly to the Operating System Trash.
- Native OS APIs: DeDuck invokes native operating system trash services (macOS
NSWorkspace/FileManagerand Windows Shell APIs). - Source-Volume Isolation: Files on external drives, USB sticks, and memory cards are moved to that specific drive's native Trash (
.Trashes). They are never copied across volumes to your internal startup drive. - Pre-Flight Validation: Before touching anything, DeDuck tests the target drive for write permissions, trash support, and filesystem health. Read-only or write-protected media are aborted safely.
- Absolute No-Fallback Safety: If moving a file to Trash fails for any reason (permissions issue or file lock), the file remains completely untouched in its original location. DeDuck never falls back to unlinking or permanent deletion.
- Drive Disconnection Resilience: If an external drive disconnects mid-cleanup, DeDuck halts operations safely without corrupting remaining files.
Offline Operation & Multi-Device Licensing
DeDuck is software you buy once and own forever. There are no monthly subscriptions, no mandatory cloud sync, and no surprise lockouts.
100% Offline Capability
Scanning, hashing, duplicate detection, library building, and local cleanup work entirely offline without requiring an internet connection. Your filenames and file contents never leave your device.
14-Day Offline Grace Period
When traveling or working in field locations without Wi-Fi, DeDuck caches your verified license locally for up to 14 days, verifying quietly in the background only when internet is available.
Cross-Platform Support
The same license key unlocks DeDuck on both macOS and Windows. Pro covers 2 of your devices; Studio covers up to 5 devices for creators and families.
1-Click Self-Serve Deactivation
Upgraded your Mac or bought a new PC? Open Settings → License, Devices & Upgrades and click “Deactivate this device” to immediately free up your slot. No support emails required.
Layman's Glossary & Troubleshooting Guide
A quick, plain-English reference guide for terms used throughout DeDuck:
| Term | Plain-English Definition |
|---|---|
| Cryptographic Hash | A digital fingerprint generated from the exact bytes of a file. If two files have the same hash, they are 100% identical, even if their names or dates are different. |
| The Keeper | The designated primary copy in a duplicate group that DeDuck preserves in place while other identical copies are cleaned up. |
| Master Library (DDL) | A DeDuck-managed directory containing a deduplicated, organized copy of your files, leaving your source originals completely untouched. |
| Quarantine | A safe, isolated holding folder where files can be temporarily moved instead of Trash. Fully restorable with 1 click in Activity. |
| Metadata Sidecar | A companion file (such as an iPhone .aae or Lightroom .xmp) that contains editing adjustments without modifying the original photo. |
| Dataless Placeholder | A ghost file created by cloud services (Google Drive / OneDrive) that stores content in the cloud, appearing as 0 KB locally until downloaded. |
| Bit-Rot | The slow, silent decay of data on magnetic or solid-state drives over years, leading to unreadable or corrupt files. |
| 3-2-1 Backup | The rule of keeping 3 copies of important files, on 2 separate media types, with at least 1 copy offsite in the cloud. |
Need Additional Assistance or Have Feedback?
We are dedicated to building private, reliable tools for your digital life. If you encounter an unusual drive format, have questions about your archive, or need assistance, visit our Contact Us page or email us directly at hello@deduck.app.
Download DeDuck for macOS & Windows, or upgrade to Pro to unlock unlimited cleanup, master libraries, and 3-2-1 backup protection.
for your digital life