Short: Find all duplicates in any set of files Author: Fulvio Peruggi Uploader: Fulvio Peruggi Version: 2.2 Type: util/rexx Requires: util/cli/ALeXcompare.lha Distribution: Aminet *==========================================================================* | | | Main improvement in this version: EqFiles.rexx now is VERY FAST !!! | | | +==========================================================================+ | | | A hard disk partition containing 10866 files in 550 directories (total | | size 505.8 Megabytes) was scanned in 3 minutes and 43 seconds finding | | 281 pairs of equal files. The previous Aminet release of EqFiles.rexx | | spent about 15 hours to find the same result. | | | *--------------------------------------------------------------------------* EqFiles.rexx finds all duplicates in any collection of files. It lists all files in one or two directories (or directory trees); compares any pair of files having the same size; and finds all pairs whose files have the same contents, even if they have distinct filenames. You know the problem. You have huge collections of files (pictures, music modules, etc.) downloaded from different sites or extracted from distinct CD-ROMs. Often you have one or more duplicates of certain files, because distinct sources used different filenames for the same file. You can find duplicate files manually, but actually this is convenient only in a small collection. When your collection is formed by hundreds or thousands of files the only reasonable way to find duplicates is a program that does the job for you. As far as I know, all usual "compare" programs make comparisons between files having the same filename, and so they are useless in the present case. Here is the point where EqFiles.rexx comes in handy. EqFiles.rexx is carefully optimized for maximum speed. Almost all the processing time is used by external programs called by the routine. In fact the interpreted version of EqFiles.rexx is as fast as the compiled version (not distributed). With EqFiles.rexx it is also possible to delete automatically all duplicate files found in a search. EqFiles.rexx can be used from within Directory Opus. Major changes in V2.2 since the previous Aminet release (V1.8) ŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻ - New file management algorithm for ultrafast scanning. - Most code reorganized and/or rewritten from scratch. - Added progress indicator. - Added directory pattern matching. - Added filename pattern matching with independent inclusion and exclusion patterns. - Added automatic exclusion of icon files (can be disabled). - Added selectable exclusion of files smaller than a given size. - Added selectable storing of the results into a file. Author: ŻŻŻŻŻŻŻ Fulvio Peruggi Via Consalvo 150, isolato 5 80126 Napoli Italy E-Mail: peruggi@unina.it ============================= Archive contents ============================= Original Packed Ratio Date Time Name -------- ------- ----- --------- -------- ------------- 2062 1176 42.9% 03-Apr-99 11:42:58 EqFiles.info 38976 12192 68.7% 30-May-99 11:15:54 +EqFiles.guide 1796 1095 39.0% 28-Feb-97 22:58:54 +EqFiles.guide.info 3373 1326 60.6% 30-May-99 11:10:54 +EqFiles.readme 1443 983 31.8% 04-Oct-98 23:02:14 +EqFiles.readme.info 12902 3524 72.6% 30-May-99 11:12:56 +EqFiles.rexx 213 159 25.3% 05-May-99 17:24:30 File_id.diz -------- ------- ----- --------- -------- 60765 20455 66.3% 01-Jun-99 21:46:12 7 files