Tools

Line deduper

Drop duplicate lines in your browser. Keeps the first copy. Optional trim, empty drop, ignore case. Nothing is uploaded.

Paste lines, then Dedupe.

How to use the Line deduper

  1. Paste the list.
  2. Turn on ignore case if Alpha and alpha should count as one.
  3. Click Dedupe. The first time a line appears is kept.

First wins

Later copies are dropped. Order of first seen is preserved, so this is not a sort. Trim and drop empty run before the uniqueness check. Email audience lists should still use the email hasher, which also normalizes addresses.

Nothing is uploaded

Dedupe is local. 1.5 MB, 100,000 lines.

Line deduper FAQ

Does this sort?

No. Pair it with the line sorter if you want unique and ordered.

Blank lines?

Drop empty is on by default.

CSV rows?

Whole-line equality only. Two rows that differ in one cell both stay.

Related tools