Metrics
Reply rate, positive reply rate and why your cold email numbers never match
By Klaroh · 8 min read · Published
The short answer
Cold email numbers rarely match across tools because the same words are used for different calculations. Reply rate can be divided by emails sent or by prospects contacted. Replies may or may not include out-of-office messages. “Positive” can mean a share of replies or a share of prospects. None of these is wrong, but a report that does not say which one it uses is easy to misread.
Pick a definition for each metric, write it next to the number, apply it to every client, and do not compare your figures with someone else’s benchmark unless you know how that benchmark was calculated.
One campaign, three reply rates
Here is a made-up campaign to show the effect. These numbers are illustrative, not real data.
- 1,000 prospects received the first email.
- Across the whole sequence, 2,400 emails were sent.
- 40 prospects replied. Of those, 6 were automatic out-of-office replies.
- 8 prospects are marked as opportunities.
| Calculation | Working | Result |
|---|---|---|
| Replies ÷ emails sent, auto-replies included | 40 ÷ 2,400 | 1.7% |
| Replies ÷ emails sent, auto-replies excluded | 34 ÷ 2,400 | 1.4% |
| Human replies ÷ prospects contacted | 34 ÷ 1,000 | 3.4% |
Same campaign, same replies, and the headline figure more than doubles depending on the definition. Nobody made an error. A client comparing your 3.4% with a benchmark built on emails sent would conclude you are far ahead, and the comparison would be meaningless.
What Instantly’s documentation says
Instantly’s analytics help page defines the terms as follows (quoted or closely paraphrased from the page when we read it for this article):
- Reply rate: the percentage of recipients who replied to a sequence email, calculated as replies ÷ total sent.
- Opportunities: replies your team has marked as an opportunity, usually a meeting booked or a qualified lead.
- Positive reply rate: the percentage of replies marked as an opportunity, calculated as opportunities ÷ replies.
- Auto-replies: counted in reply rate by default. A setting excludes them, and the page says the setting applies to the current device only.
- Time zone: reporting is in UTC.
Two practical consequences. First, the auto-reply toggle is a per-device view setting, so two people on your team can look at the same campaign and see different reply rates. Second, “positive reply rate” in Instantly answers “of the people who replied, how many were interested?”, which is a different question from “of the people we contacted, how many were interested?”
Choosing your denominator
There is no single correct choice. There are trade-offs, and your clients should know which one you made.
| Denominator | Good for | Watch out for |
|---|---|---|
| Emails sent | Judging the sequence as a whole; matches tools that divide by sent. | Longer sequences send more emails per person, so the rate drops without performance changing. |
| Prospects contacted | Answering “what share of the people we targeted engaged?” in terms a client understands. | Someone in two campaigns can count twice; mid-sequence prospects haven’t had every follow-up yet. |
| Total replies (for positive rate) | Judging reply quality: how many replies were interested. | A campaign with few replies swings wildly. Four positives out of eight replies is 50%. |
Our recommendation: report the share of prospects contacted, because it is the easiest for a client to picture, and show the raw counts next to it so anyone can recompute it. This is an opinion, not a standard.
Open rate and bounce rate: the two numbers to treat carefully
Open rate
Instantly’s own article on open tracking (March 2026) says Apple pre-loads images through proxy servers whether or not the recipient reads the email, and that when security gateways scan a message, no human is involved when the tracking pixel fires. The article recommends reply rate and booked meetings as more reliable measures. Instantly sells cold email software, so weigh the framing accordingly, but the mechanisms it describes are why many agencies leave open rate out of client reports.
Bounce rate
Instantly’s help page describes workspace bounce rate as the average of each workspace’s percentage of emails sent that bounced. Whether a count of bounces refers to bounced prospects or bounced emails changes what a percentage means. Klaroh shows the bounce count and withholds a bounce rate for exactly this reason: we have not been able to confirm which unit Instantly’s count uses. If a tool gives you a rate without saying what it divides, ask.
Small samples, date ranges and sync timing
Small samples
A rate from 40 prospects moves a lot when one person replies. Say so in the report. Klaroh flags campaigns with fewer than 100 prospects contacted as low volume and shows emails-per-positive only from five positive prospects. Those thresholds are our own judgement calls, not industry rules; choose your own and write them down.
Date ranges
Instantly lets you choose a date range; its help page notes that longer windows give a more complete picture of a campaign. A tool that shows lifetime-to-date figures will not match a dashboard filtered to last week. Klaroh currently shows lifetime-to-date only, so when comparing the two, set Instantly to a range that covers the whole campaign.
Sync timing
If numbers are copied or synced from Instantly into another tool, they are only as fresh as the last sync. A reply that arrived this morning may not be in a report built last night. Klaroh syncs on a daily schedule and when you open the app, and shows the last sync time. It is not real-time.
A checklist before you send a report
- Every rate has its numerator and denominator written or one click away.
- The auto-reply setting is the same for every client and is stated.
- The time range and time zone are stated.
- “Positive” says who decided: your team, a tool, or the prospect.
- Low-volume campaigns are labelled as such.
- Open rate is absent, or accompanied by the caveat that it can be inflated by software.
- The report shows when the data was last updated.
- You are not comparing against an outside benchmark whose method you cannot see.
How Klaroh defines its numbers
Klaroh reads the raw counts from Instantly and defines every business metric in one place. Today these are the definitions it uses:
| Metric | Klaroh’s definition |
|---|---|
| Reply rate | Human replies ÷ prospects contacted. Automatic replies, as classified by Instantly, are excluded. |
| Positive rate | Prospects currently marked positive in Instantly (interested, meeting booked, meeting completed or won) ÷ prospects contacted. A lead can be marked positive without an email reply. |
| Emails per positive | Emails sent ÷ positive prospects. Shown from five positives. |
| Bounce rate | Withheld until the unit of Instantly’s bounce count is confirmed. The count is shown. |
| Open rate, meetings, revenue | Not shown. |
“Positive” is whatever is marked in Instantly, set by your team or by Instantly itself. Klaroh does not classify replies. Because the denominator differs from Instantly’s headline reply rate, Klaroh’s reply rate will usually not equal the figure on Instantly’s dashboard. That is by design, and the definitions are shown in the product.
Want to see the definitions in context? Explore the product tour, or join the beta waitlist.
Sources and limits
Product statements about Klaroh were checked against its current code on October 10, 2026. Vendor pages change, so check them again before relying on a figure.
- Instantly help center: AnalyticsPrimary documentation. Reply rate, opportunities, positive reply rate, auto-reply setting (current device only), UTC, date ranges, workspace bounce rate. Shows a relative “updated” label, no absolute date.
- Instantly: email open tracking and why your open metrics may be wrongVendor article, published March 2026. Source for Apple Mail Privacy Protection and security scanner effects on opens.