Tag Archives: duplicates

Double File Scanner ~ WinXP Thru Win10 Scanning

Posted by tom2tec on

The purpose of this tool is scanning the selected directory or directories for duplicate files, i.e. files with identical content. Duplicate files are identified by first calculating the SHA-1 digest of each file and then looking for values that appear more than once. In particular, files with identical content are guaranteed to have the same SHA-1 digest, while files with differing content will have different SHA-1 values with very high certainty.

All computed SHA-1 values are stored in a hash table, so collisions are found quickly and we do NOT need to compare every digest to every other one. Also, the files are processed concurrently in multiple “worker” threads in order to parallelize and speed-up the SHA-1 computations on multi-core processors. On our test machine it took ~15 minutes to analyse all the ~260,000 files on the system drive (~63.5 GB). During this operation ~44,000 duplicates were found.

Once the scan is completed, the program provides commands to review, rename or delete the duplicate files manually. Alternatively, the “automatic clean-up” wizard may be invoked in order to remove ALL redundant files at a single blow. Optionally, the list of duplicates can be exported to the XML or INI format.

double file scanner interface

github.com/lordmulder/DoubleFilerScanner

Similarity ~ Refines Music Collections

Posted by tom2tec on

As an active music fan you surely know how difficult it sometimes may be to keep your music collection ordered. The more sound files you have, the more time and effort it takes to clean out duplicates, low-quality files and purify the entire collection of any musical garbage it contains. That’s where Similarity comes in handy!

Similarity rapidly scans your music collection and shows all duplicate music files you may have. The comparison, powered by “acoustic fingerprint” technology, considers the actual contents of files, not just tags or filenames, and thus ensures the extreme accuracy of similarity estimation. Moreover, the comparison isn’t audio file format dependent; the application supports almost every file format in full.

Alongside eliminating musical doubles, Similarity also provides advanced quality control functions. Really, who wants a collection full of low-bitrate music, badly remastered compositions and songs full of noise? Similarity analyzes files and calculates a quality score basing on various technical parameters of that recording, such as: bitrate, frequency, amplitude cut value, amplitude average value, amplitude maximum and many others. The program automatically detects all common problems with audio files and assigns a corresponding quality mark to each file. A quick sort – and you’ve got files with the highest quality at the top and files you can delete without doubts at the bottom.

Similarity

www.similarityapp.com