Ad campaigns intended to reach millions of people are not working, making identifying ROI even tougher in the fund marketing world.
TL;DR: formally test your largest channels only.
Yahoo’s economists have analysed 25 advertising lift experiments, finding most lacked the statistical power to differentiate a profitable campaign from a loss-making one. In fact, the uncertainty around measured ROI spanned more than 100 percentage points.
As a recommended response, firms should concentrate testing to the two or three channels that absorb the most spend, run larger and longer experiments, set a minimum detectable effect before launch, and treat underpowered results as directional.
So, what does this mean for fund marketers?
If campaigns that are set to reach millions still struggle to produce reliable answers, fund marketers have even larger steps to climb.
Their typical institutional campaigns may only target a few thousand individuals. Conversions are in short supply, and arrive after multiple sales conversations a year or two since first contact.
Even if applying consumer-style A/B testing and channel ROI calculations to that data could not be statistically meaningful, fund marketers will still be tasked to justify budgets in exactly those sorts of terms.
The risk for marketers goes beyond wasted analysis if funds cut channels that are working, or double down on ones that are not, based on ‘noise’. When marketing budgets are under pressure, misreading small numbers carries crucial costs.
Plus, the same compliance discipline of clear or misleading communications applies to internal evidencing. Marketing leaders become more credible with boards and distribution heads that way.
In this light, a roadmap for testing ad channels could look like this.
Stop over-testing small campaigns
Reserve formal tests for only your largest channels, accepting that a lot of smaller marketing activities cannot be measured with the same precision.
Report ranges
When presenting any results to leadership, the uncertainty figures should be presented alongside the headline data for a holistic picture.
Measure leading indicators that fit the audience
Engagement from named target accounts, meeting requests, factsheet downloads and database activity are usually more informative than last-click conversions.
Join-up your data in the CRM
Tie digital engagements to opportunities and flows in the CRM so that the impact on asset-raising can be observed over time, even if it cannot be proven campaign to campaign.
Source
Karan Dhir Substack, “Yahoo’s Economists Ran 25 Ad Experiments and Could Not Tell Profit From Loss” (via TLDR Marketing)






