Guide

THE TOOLBOX / TEXT UTILITIES

Clean up lists,
one line at a time.

Remove duplicate lines from email lists, server logs, CSV columns, or keyword sets instantly in your browser. Supports keep-first, keep-last, show-duplicates-only, frequency counts, sorting, and substring filtering.

INPUT LINES & RULES6 lines
Up to 1M chars · 100% local
CLEANED OUTPUT & FREQUENCY

Deduplication updates live as you type or toggle options.

Input
6
Output
4
Removed
2 (33%)
Repeated Keys
2

DEDUPLICATION MODES

Choose exactly how duplicate lines should be handled.

ModeBehaviorBest For
Keep first occurrenceKeeps the first copy of each line and drops later repeatsEmail lists, keyword lists, CSV IDs
Keep last occurrenceKeeps the final copy of each line in orderChronological logs, env overrides
Show duplicates onlyOutputs only lines that appeared 2 or more timesAuditing double entries or repeated IPs
Keep strictly unique onlyDrops every line that appeared more than onceFinding one-off anomalies in logs

1. Instant Frequency Counter

Find your noisiest IP addresses, most repeated error strings, or duplicate SKUs in one click under the Frequency tab—complete with CSV export.

2. Include & Exclude Filtering

Filter your cleaned list to keep only lines containing a domain or keyword, or drop noisy lines matching an unwanted substring before exporting.

Frequently Asked Questions

Are my email lists, logs, or text files uploaded to a server?

No. Every deduplication, frequency count, sort, and filter runs 100% locally in your browser with zero network requests.

What is the difference between Keep First, Keep Last, Duplicates Only, and Unique Only?

Keep First preserves the original order of each item’s first appearance. Keep Last is ideal for config or log overrides where the newest line wins. Duplicates Only extracts lines that appeared 2 or more times, while Unique Only keeps lines that never repeated.

Can I see how many times each duplicate line appeared?

Yes. Switch to the Frequency tab on the right panel to inspect exact occurrence counts sorted from most repeated to least repeated, and export the breakdown as CSV.

How do Ignore Case and Trim Whitespace work together?

Trim whitespace strips leading and trailing spaces before matching, and Ignore case treats "OPS@acme.dev" and "ops@acme.dev" as the same entry.

What is the maximum input size?

The tool handles up to 1,000,000 characters smoothly in browser memory and supports uploading local .txt, .csv, or .log files.