DupDel

Freeware Delete Duplicates AREXX script

This script will scan the current directory and create
an MD5SUM for every file. This can take a while, be patient :)

It then sorts the checksums and steps through them comparing
the current one with the next one, if they're the same the
next one is deleted.

As usual, use this at your own risk.

Installation:

Copy the files to S:ARexx.

Dopus5 usage:

I use this in the lister menu:
On your DOpus5 screen press RAmiga-2 to call up the Lister
menu editor.
In the Menu column Click Add, Enter 'Delete Duplicates" then
click Edit or double click 'Delete Duplicates'

In the Function Editor click Add, Set the Cycle Gadget to Arexx
and Enter S:Arexx/DupDel.rexx in the sting gadget next to it

In Flags turn on CD Source, Output Window & Rescan Source
If you want to see the results turn on window close button

Click Save then Save in the Lister Menu window.

Repeat for the recursive version if needed changing the menu
and file names.

CLI/Shell usage:

CD to the directory you want to scan and enter:
DupDel.rexx<return>

Recursive test results on 23GB of data:

  133539 files checked, 16120 duplicates found.
  Time taken: 1973.689118 (just under 33 minutes)

History:

V1.0
  Initial release.

V1.1
  Added a recursive version.
  Shortened the filenames.