Six checks your platform skips
Adobe Target gives you a conversion rate, a lift and a confidence number, one activity at a time. It never checks whether the traffic split was honest, whether the winner survives the other comparisons you ran that week, or whether the test could ever have detected anything. Upload one export covering everything you have live. Every activity comes back ranked worst first.
runs in your browser · nothing is uploaded
This is the real engine running on invented data. Click any row to see the full working. Bring your own export further down and it runs on that instead, in your browser.
One row per experience, and it does not matter which platform made the file. If it has an activity name, an experience name, visitors and conversions, this will read it. Revenue and end dates switch on the revenue and pace checks too.
Adobe Target, Adobe Analytics, Optimizely, VWO, AB Tasty, Dynamic Yield, GA4, or a spreadsheet you built by hand. Columns are detected for you, and you can correct any of them.
Every one of these is computable from the export you already have. None of them appear in the report your platform hands you, and none of them appear in the deck your agency builds from it.
| Check | Adobe Target | Optimizely | AB Integrity |
|---|---|---|---|
Sample ratio mismatch Did the traffic actually split the way you configured it? If not, nothing else in the test means anything. |
no | partial | yes |
Multiple-comparison correction Four experiences against five metrics is twenty chances to find a winner by luck. Both platforms report every cell as if it were the only one you looked at. |
no | partial | yes |
Achieved power The smallest lift this sample could ever have detected. Without it, "no significant difference" is indistinguishable from "we did not measure". |
no | no | yes |
Winner's-curse correction A barely significant winner is nearly always smaller than it looks. This is why shipped tests underdeliver against the deck six months later. |
no | no | yes |
Conversion against revenue More orders at a smaller basket is a loss wearing a win's clothes. Reported side by side, never reconciled. |
no | no | yes |
Pace to close At today's traffic, will this test reach an answer before its end date? Nobody computes this, so tests close on the calendar instead of on the data. |
no | partial | yes |
One ranked view across everything Not a list of tests. A list of the tests that need you today, worst first. |
no | no | yes |
On the comparison. Adobe Target reports confidence from a two-tailed Welch's t-test as 1 minus the p-value, and its documented CSV download contains raw data only, without lift or confidence. Neither its reporting documentation nor Optimizely's describes a sample ratio check on the results view or a correction across experiences and metrics. Optimizely's sequential testing does control error under repeated looks and its export reports samples remaining to significance, which is why it scores partial on three rows rather than no. Marked as of July 2026 against published documentation. If a platform ships one of these, this table gets corrected.
On the method. Significance is a two-proportion z-test on the pooled standard error. The multiple-comparison bar is Šidák at a family-wise 5%, counting every variant against every metric in the file, which assumes the comparisons are independent and is therefore a touch conservative when your metrics correlate. Sample ratio mismatch is a chi-square goodness-of-fit test against the configured split, flagged hard below p = 0.01. The honest lift is a posterior mean under a skeptical normal prior of 15% relative on the true effect. Power is the smallest relative effect detectable at 80% with the sample collected. Every one of these is the same math as the free tools on this site, run across your whole portfolio at once instead of one test at a time.
Every calculator on this site stays exactly where it is: free, no account, nothing uploaded. What costs money is not having to run them one test at a time. Upload once a week, get the whole portfolio triaged, and know which three tests to open before your Monday meeting.
The seven tools, plus Instant Analysis on a single test. Everything runs in your browser.
Your whole portfolio, triaged from one file. Priced to go on a company card without a procurement conversation.
The demo above is the real engine on invented data. Bring your own export and it runs on that instead, in your browser, before you pay anyone anything.