Remove repeated lines from a list
Remove duplicate lines from pasted text while keeping the first occurrence of each value in its original position. Use it to dedupe a list of identifiers, names, tags, or addresses, with separate controls for surrounding spaces, blank lines, and case-sensitive comparisons.
Duplicate-removal examples
Keep the first occurrence
Input
pear apple pear plum apple
Result
pear apple plum
The result preserves the order in which each value first appeared. It does not alphabetize the list or choose the last occurrence. Use Sort lines afterwards if you need the remaining values in a different order.
Treat capitalized versions as the same value
Input
London london LONDON Paris
Result
London Paris
Turn on Ignore case when comparing. London stays because it appeared first; the tool does not rewrite that surviving spelling. Leave this option off when uppercase and lowercase identifiers are intentionally different.
Clean spaces before comparing
Input
red red blue blue
Result
red blue
Keep Trim surrounding spaces and Remove blank lines enabled. The values are trimmed before duplicate comparison, so padded copies match. Spaces inside a value are not collapsed or otherwise rewritten by this cleanup.
How to dedupe your text
- Paste one item per line, drop a text file into the editor, or select Open file. Keep a copy of your original if you need to compare changes.
- Choose whether to trim surrounding spaces and remove blank lines. Decide whether differences in letter case should count as different values.
- Read the resulting list and the removal summary. Turn off Update as I type when you prefer to run cleanup manually.
- Copy or download the unique lines. To alphabetize them, choose Use output as input and switch to Sort lines without leaving the text workspace.
Questions about unique lines
Does deduplication upload my list?
No. The comparisons run on your device, and opened files are read locally. MySafeInfo does not receive your input through this tool. It is free to use, with no ads and no Data Pass required.
Can I remove duplicates from just one CSV column?
First copy that column as one value per line. This tool compares entire lines, not individual CSV fields. Two rows with the same name but different other fields are different lines and will both remain.
Are similar spellings merged?
No. This is duplicate removal, not fuzzy matching. Ignoring case can merge London and london, but it will not merge misspellings, abbreviations, punctuation differences, or names that merely look similar.
What happens with an oversized list?
The text input limit is 10 MiB, with up to 250,000 values. The page reports an error instead of silently returning a partial list when a limit is exceeded. Process smaller batches if necessary, then check for duplicates across batches.
What duplicate removal leaves alone
It does not validate addresses, identify people, or deduplicate spreadsheet records by a selected key; only complete line values are compared.