lucalanziani / duplicates

Find duplicate files

Hi there 👋

duplicates's Issues

Create 'purge()' method in Indexer

Right now when you re-index a directory the indexer skip files already present in the previous index.

Currently the indexer doesn't check if some files in the index actually still exist in the directory. Implement this function with the purge() method.

Avoid the need of indexing both the directories when using --difference --intersection

As now both the directories have to be indexed to compare them.
We can change this indexing one of the directories on the fly using --index --no-store and use the inmemory store to compare the content.

Write README.md

Add the aim of the project and some example on how to run it and use it

"--show-indexed" option not implemented

The --show-indexed option is listed in the help message but never implemented in the code.

Using said option doesn't print anything, leading to think the directory has not been indexed yet, when in reality it could have been.

Fix --progress counter

Running the following command I've got 118.06%, something is evidently wrong here

(env)> $ bin/duplicates --progress --index /run/media/lucalanziani/Backup/Foto *.jpg *.nef *.CR2
71571/60620/71165 (118.06%) files

To add some context the folder already had a .duplicates.json.gz file

Show duplicated content of a directory in tsv format

This can simplify the piping into other bash command.

Better representation of diff and intersection

Sometime whole directories can be in common or missing, if that is the case don't output all the common/missing files but just the directory containing them