Remove Duplicate Lines
Remove exact duplicate lines while preserving the first occurrence order.
How to use
- Enter a line list with duplicates and run the tool.
Capabilities and scope
A JavaScript Set keeps the first copy of each exact line string, so case and surrounding whitespace remain significant.
How it works
The line array is passed through [...new Set(lines)] and joined with newlines.
Example
a b a becomes a b.
Useful for
- Keep one copy of each exact log or list entry
Before you use it
- It does not ignore case or trim lines before comparison, and an empty line is a distinct value.
Frequently asked questions
Are A and a considered duplicates?
No. The current Set comparison is case-sensitive.