1. Instant Frequency Counter
Find your noisiest IP addresses, most repeated error strings, or duplicate SKUs in one click under the Frequency tab—complete with CSV export.
THE TOOLBOX / TEXT UTILITIES
Remove duplicate lines from email lists, server logs, CSV columns, or keyword sets instantly in your browser. Supports keep-first, keep-last, show-duplicates-only, frequency counts, sorting, and substring filtering.
Deduplication updates live as you type or toggle options.
DEDUPLICATION MODES
| Mode | Behavior | Best For |
|---|---|---|
| Keep first occurrence | Keeps the first copy of each line and drops later repeats | Email lists, keyword lists, CSV IDs |
| Keep last occurrence | Keeps the final copy of each line in order | Chronological logs, env overrides |
| Show duplicates only | Outputs only lines that appeared 2 or more times | Auditing double entries or repeated IPs |
| Keep strictly unique only | Drops every line that appeared more than once | Finding one-off anomalies in logs |
Find your noisiest IP addresses, most repeated error strings, or duplicate SKUs in one click under the Frequency tab—complete with CSV export.
Filter your cleaned list to keep only lines containing a domain or keyword, or drop noisy lines matching an unwanted substring before exporting.
Sort bibliographies in Alphabetical & Bibliography Sorter, convert CSVs in JSON ↔ CSV Converter, or test patterns in Regex Tester.
No. Every deduplication, frequency count, sort, and filter runs 100% locally in your browser with zero network requests.
Keep First preserves the original order of each item’s first appearance. Keep Last is ideal for config or log overrides where the newest line wins. Duplicates Only extracts lines that appeared 2 or more times, while Unique Only keeps lines that never repeated.
Yes. Switch to the Frequency tab on the right panel to inspect exact occurrence counts sorted from most repeated to least repeated, and export the breakdown as CSV.
Trim whitespace strips leading and trailing spaces before matching, and Ignore case treats "OPS@acme.dev" and "ops@acme.dev" as the same entry.
The tool handles up to 1,000,000 characters smoothly in browser memory and supports uploading local .txt, .csv, or .log files.