Here is exactly what we do, including the parts that throw work away.
A trend tool that only charts terms someone already thought of is a search box with extra steps. Every run reads the complete Wikimedia pageview dump for English Wikipedia — every article, every month — and scores the entire corpus. Roughly two million articles clear the traffic floor and get scored. Nothing is on a watchlist; the corpus proposes the candidates.
The candidate pass compares each article's recent quarter against the same quarter one year earlier, and against what that article did between those same two quarters last year. An article that climbs every July does not get credit for climbing this July. That one comparison removes most of what would otherwise look explosive.
Survivors get their full daily history pulled and put through five transformations:
This is the test that matters most, and it is a test of the floor, not the peak. Take the lowest 28-day median in the last 90 days. If that trough is still well above the old baseline, attention has permanently relocated — the thing is genuinely bigger now. If the trough has fallen back, something happened and then stopped happening.
Alongside it we measure concentration — how much of the recent excess attention landed in the
single busiest week — and decay, how far the series has already fallen from its peak. A death,
an award, a court ruling or a viral post scores high on concentration, high on decay, and flat
on the floor test. Those are classified spike and never enter the index.
Wikimedia already strips known crawlers, but a lot of automated traffic gets through as "user". Human attention has a weekly rhythm. We compute the weekend-to-weekday ratio and the day-to-day coefficient of variation; a series that is implausibly flat, or that has no weekly pattern at all, is dropped regardless of how good its growth looks.
Wikipedia will hand you a drug's generic name, its brand name and its mechanism as three separate rising topics. Two entries are merged only when their week-over-week shapes correlate above 0.86 and they share vocabulary or three or more Wikipedia categories. Shape alone would merge unrelated things that happened to rise in the same month.
Position on the curve is derived from three numbers: level against baseline, current slope, and where the topic sits relative to its own all-time high. "Up 300%" means something very different for a topic at 40% of its record than for one setting a new record this week.
Hacker News post volume for the term (via Algolia), this quarter against the same quarter last year; npm and PyPI monthly downloads when the topic has an exact package-name match; GitHub stars when a token is configured. Corroboration raises a topic's confidence score. It is never required — most consumer, health and culture trends leave no trace in developer data, and demanding a second source would quietly turn this into a software-only index.