Methodology v4.0
How we rank 9,962+ software tools
Rankings built from external review strength, media momentum, and editor picks, plus a public worked example so you can see exactly which signals move a tool up. This is the version of the methodology you can hold us to.
The short version
- 1.Category rankings are a composite score built from three observable signals: external review strength, media momentum, and editor-featured picks.
- 2.That composite is a sort key, not a star rating. We never show it as a /100 on tool pages because a private internal number with no transparent review corpus behind it would be misleading.
- 3.A separate profile-completeness score gates indexing: tools with too little verified data are deindexed and kept out of guide top picks.
- 4.What you do see on tool pages: the external rating aggregated from G2, Capterra, App Store, and Play Store, plus our written editor's take and the verified community reviews.
- 5.Sponsorships, paid placements, and vendor outreach never move a ranking. The full list of things that do not count is in section 6.
1. Two numbers you can see, one you cannot
Toolradar surfaces two numbers on tool pages: an external rating aggregated from public review sites, and a community rating from verified Toolradar reviews. Behind the scenes there is also an internal composite ranking we use to sort lists, plus a completeness score that gates which tools are eligible to appear in guides. Those internal numbers are intentionally private.
External rating
The number shown on every tool page. Aggregated from G2, Capterra, Trustpilot, the Apple App Store, the Google Play Store, and the Chrome Web Store where available. We show the source and review count next to it so you can verify.
- Backed by a public review corpus
- Source named on the tool page
Community rating
Calculated from verified Toolradar reviews. Each review is email-confirmed, manually moderated, and flagged if it shows the patterns we associate with review bombing or vendor astroturf.
- Verified by email plus moderation
- Updates as new reviews land
Internal ranking and completeness scores (not shown on tool pages)
The composite ranking decides which tools sort highest in a category and which qualify for the editor's top picks in a guide. A separate 0 to 100 completeness score decides which tools are indexed at all: profiles too thin to vet in good faith get deindexed. Showing either as a star rating on tool pages would imply a precision we cannot defend without a public review corpus behind every digit, so we keep them backstage and use the external rating in the UI instead.
2. How a category ranking is built
The composite ranking that orders a category combines three signals that are all observable in the wild, not editor opinion. Review volume and media counts are log-scaled so a handful of tools with huge review corpora do not flatten everything else, and so a tool with thirteen reviews cannot outrank an established brand on volume alone.
External review strength
Public review volume from G2, Capterra, Trustpilot, and the app stores, multiplied by the aggregate star rating. Volume-weighted on a log scale: a 4.5 from tens of thousands of reviewers contributes far more than a 4.9 from a dozen. We normalize every source to a real 0 to 5 scale before it counts, so a scraper hiccup cannot inflate a small tool.
Media momentum
How often the tool is mentioned across the 477+ press, blog, and newsletter sources we track. Recent mentions are weighted roughly twice as heavily as older ones, so momentum today counts for more than coverage from two years ago. Currently 11,615 mentions logged across 477+ sources.
Editor-featured pick
A fixed boost when the editor has hand-selected a tool as a category standout after a written review. It nudges a tool up when the external signals are close, but it is a small, bounded lever, not an override. It never depends on any commercial relationship (see section 6).
Profile completeness (indexing gate, separate from ranking)
A separate 0 to 100 score for whether the Toolradar profile has verified pricing, a written editor's take, structured pros and cons, categories assigned, a working website, and a real logo. It does not push a tool up the ranking. It decides eligibility: profiles too thin to vet in good faith are deindexed and left out of guide top picks.
What the ranking decides
Deindexed tools are excluded from category sitemaps and guide consideration. They remain accessible via direct URL so the data we have stays public.
3. A worked example: Linear
Linear is an issue tracker for software teams. Here is how each ranking signal reads against the same public inputs you can verify on its Toolradar profile. We keep the raw internal number backstage (see why above) and describe the evidence instead.
That ranking is what we use to decide Linear shows near the top of the issue tracker category and qualifies for the editor's top picks in the related guides. What you actually see on the Linear page is the external rating from G2, Capterra, and the App Store, with the source named next to it.
4. Review verification
The community rating shown on tool pages is computed only from reviews that pass every step below. We would rather have ten honest reviews than a thousand we cannot stand behind.
Email confirmation
Every reviewer must verify a working inbox before the review goes live.
Account age threshold
New accounts cannot review on day one. The minimum age catches the most obvious astroturf pattern.
Professional verification
A reviewer who confirms a company email domain gets a verified-buyer label next to their review.
Manual moderation
Every approved review has been read by the editor or a designated moderator before publication.
Pattern detection
Bursts of one-star reviews around a release, identical wording across accounts, and IP clustering all get flagged.
Reader reports
Any reader can flag a review. Flagged reviews get re-moderated within 48 hours, the editor signs off on the outcome.
5. How often things get refreshed
Weekly for the top 500 tools by traffic, otherwise on every guide rebuild or when a vendor flags a change.
Daily ingest from 477+ tracked sources, scored at write time, then decayed weekly so recent coverage outweighs old hits.
Re-pulled monthly from G2, Capterra, and the app stores. We do not cache stale stars.
Refreshed when a vendor ships a major release, when reader pushback forces a rethink, or on the annual category sweep.
Reviewed quarterly. 401 categories live today, pruned when overlap gets confusing for readers.
This page is reviewed every quarter. Material changes get a version bump at the top and a note in the changelog.
6. What does not influence a ranking
- ×Sponsorship in the Dupple newsletter network. A tool sponsoring Techpresso or any other Dupple newsletter does not get a ranking bump. We disclose the overlap on the relevant guide section but the order stays put.
- ×Paid placements. Sponsored slots on Toolradar are always labeled and sit outside the editorial ranking. They do not change which tools appear in the editor's top picks.
- ×Vendor outreach. Emails asking us to "take another look" or PRs pitching a new feature do not move a ranking. We use those as input for the next editor pass and that is it.
- ×Affiliate revenue. Some outbound links are tracked for analytics. None of them pay us per click in a way that would shift a ranking. Our full revenue breakdown lives at /how-we-make-money.
- ×Social media noise. A viral tweet does not produce a ranking change. A measurable spike in tracked press coverage does, through the media-momentum signal, on its own merits.
- ×Editor sympathy. If the editor likes a vendor personally, that does not move the order. The signals are the signals. Personal opinion goes in the editor's take where readers can see it and argue with it.
7. Methodology changelog
Rewrote this page to describe the ranking exactly as the code computes it: a composite of external review strength, media momentum, and editor-featured picks, with profile completeness as a separate indexing gate. Removed the fixed-percentage editorial rubric, which no longer matched the live system.
Replaced the import-time editorial score as the primary category sort with the composite ranking, because the old score was set once at import and routinely promoted obscure tools above well-known brands. Introduced the media-momentum signal backed by the 477+ tracked source network.
Split community rating from external rating. Added profile completeness so tools with thin data stop appearing in guide top picks.
Toolradar launches with an import-time editorial score and aggregated external ratings.
Think a ranking is wrong? Tell us why.
Methodology disputes go to toolradar@dupple.com. Bring the URL plus a primary source or a concrete counter-example. We re-review and document the outcome.