- Home
- All tools
- Text & writing tools
- Duplicate line remover
Duplicate line remover
Paste a list and get it back with every repeat gone, and a count of how many came out. Built for the merged lists, exported columns and pasted logs where the same row appears three times.
- Runs on your device
- Counts what it removed
- Optional sorting
Remove duplicate lines
Nothing is uploaded — your text stays in this tab
One line per entry — case, whitespace and sorting are all optional
Three steps, about a minute
Paste your list
One entry per line: email addresses, product codes, names, URLs, log lines. Nothing leaves this tab.
Set the matching rules
Case sensitivity and whitespace trimming decide what counts as the same line. Turning trimming on catches entries that differ only by a stray space.
Remove and copy
You get the unique lines plus three counts: how many you started with, how many are left, and how many were removed.
Made for lists, not paragraphs
- Whitespace trimming catches the invisible ones. A trailing space makes two identical-looking rows different. Trimming is why the count is usually higher than you expected.
- Case sensitivity is yours to choose. Leave it off and Smith and smith collapse together; turn it on when the case is part of the value, as with codes and passwords.
- Sorting is optional, not forced. Plenty of tools sort as a side effect and scramble an order you needed. Here it only happens if you ask.
- The three counts tell you what happened. Original, unique and removed, so you can sanity-check the result before you paste it back.
About this tool
How is this different from the duplicate text remover?
This one works line by line, for lists. The duplicate text remover works word by word and reports which words repeat, which is what you want for prose. Use this for a column of data, that one for a paragraph.
Does it keep the first occurrence or the last?
The first. The order of the lines you keep is the order they first appeared, unless you turn sorting on.
Why did two lines that look identical not merge?
Almost always invisible whitespace — a trailing space or a tab at the end of one of them. Turn on Trim whitespace and run it again. A non-breaking space pasted from a web page can also do it; the text cleaner will strip those first.
Can it handle a very long list?
Yes. The work happens in your browser, so tens of thousands of lines are fine; the limit is your device’s memory rather than any cap we set.
Is my list uploaded anywhere?
No. Everything happens in your browser, so the list never leaves your device and nothing is stored or logged — which matters if the lines are email addresses or customer records.
Related writing tools
Your text, your device
The comparison runs in your own browser. Nothing is uploaded, stored, or logged — closing the tab is all the cleanup there is.
Missing a setting?
Tell us what this tool should also do. Suggestions decide most of what we build next.
124 more tools where this came from
PDF, writing, image, SEO, research, and calculators — all free, all without an account.