fdupes

To remove all but the first of a number of duplicate files in a subfolder on Linux, use:

yes 1|fdupes -rd <folder>

Fdupes Examples

1) fdupes -r ./stuff > dupes.txt

Then, deleting the duplicates was as easy as checking dupes.txt and deleting the offending directories. fdupes also can prompt you to delete the duplicates as you go along.

2) fdupes -r /home/user > /home/user/duplicate.txt

Output of the command goes in duplicate.txt

fdupes will compare the size and MD5 hash of the files to find duplicates