Deduplicator

Deduplicator removes duplicates from a list with optional fuzzy-matching. Simply paste your list into Deduplicator and hit ‘Find Duplicates’. Deduplicator will identify duplicate items and show them in a preview window. Hit ‘Remove Duplicates’ to proceed. Your list has now been deduplicated and contains only unique elements. To account for variation in capitalisation and spelling, you may wish to use fuzzy matching. Moving the fuzziness slider one notch towards ‘fuzzy’ will result in a case-insensitive comparison.

Examples

• ‘DAVE’ will be treated as a duplicate of ‘Dave’; moving the slider another notch towards ‘fuzzy’ will result in a spelling-insensitive comparison
• ‘Jenni’ will be treated as a duplicate of ‘Jenny’; moving the slider all the way towards ‘fuzzy’ will greatly reduce the strictness of the matching algorithm
• ‘Bob’ will be treated as a duplicate of ‘Bobby’

With some experimentation on the range between ‘strict’ and ‘fuzzy’, the operator should provide a satisfactory level of deduplication.