Toolstia / Remove duplicate lines
Remove duplicate lines from a list
Paste a list and get back every line once. You can ignore upper and lower case, ignore extra spaces, drop empty lines and sort the result. It can also do the opposite and show only the lines that appear more than once.
Paste some lines to start.
How it works
- Paste your list, one item per line.
- Choose the options you need.
- Copy the cleaned list.
Which copy is kept
The first time a line appears it is kept, and later copies are removed. With case ignored, "Apple" and "apple" count as the same line and the first spelling you wrote is the one that stays.
Spaces and empty lines
Lines that differ only by a space at the end look identical but are not equal to a computer. Turn on the space option to treat them as the same. Empty lines can be removed too, or one empty line is kept.
Finding what repeats
Switch to "Only the lines that repeat" to see which entries appear more than once. Each repeated line is listed a single time. This is useful for checking mailing lists and keyword lists.
Sorting
Sort A to Z, Z to A or shortest first after the duplicates are gone. Sorting uses your browser's language rules, so accented and Bangla text sorts sensibly.
Questions
How many lines can it handle?
Tens of thousands of lines work fine on a normal computer.
Does it keep the original order?
Yes, unless you choose a sort order.
Is anything uploaded?
No. Your list stays in your browser and is never sent anywhere.
Does it work with Bangla?
Yes. Any text is compared exactly as written.