TestsDoes a story beat the product in a subject line?
Northline asked it once. Every send that ran the split joined the same Test, and each one is read on its own.
Story opener led in 3 of 5 sends.
Guided demo · Northline Outfitters
How that question gets answered.
Run the same split three times and the first result is a screenshot in Slack, the second is in a spreadsheet, and nobody agrees what the third showed. A Test is the home for the question, so every send is read against it.
Ask it once, in writing.
Two approaches, one metric. Every send in the Test is read against this.
Press Add the sends
Story or product first?
What a Test won’t do for you.
It won’t call a winner
Each send shows which variation did better. Whether that adds up to an answer is your call, written in your words.
It won’t turn five small sends into one big result
The combined figure shows the direction across these sends. Adding them together doesn’t make them one large test.
It won’t guess which variation was which
Sendfire can’t see how Klaviyo split a send. You name which variation went where, and the row still reads “Split not verified” whenever Sendfire couldn’t check the split itself.
The answer outlives the Test.
Accept the proposal and it becomes a line in Brand Memory, with the Test as its receipt. The next brief starts from it.
Story openers have had the higher click-to-open in three of five sends.
Learned · 5 sends, observed