Analytics that’s Metrics Centred, with Allan Wille

Allan Wille

Episode 219

Up to the 18th century, making and trading things was harder than it needed to be. You had to deal with a bewildering patchwork of local constants and norms. It was actually the French Revolution & administrators who came out of it that started to codify how we measure things. The standards they adopted were ultimately formalized in 1875 at a Convention  whose name you may recognize, the Metre – or should I say Meter –  Convention. 

The Standard set at the convention spread beyond France to most of Europe, removing friction in commerce and everyday life. Engineers could spec parts to the same tolerances; pharmacists could dose reliably across borders; food producers could print consistent nutritional labels; shipbuilders and container makers could agree on common dimensions; and architects and builders could order materials that matched on site. Over decades that shared language of measurement turned local guesswork into dependable infrastructure for industry, science and trade. Today, About 95% of the world’s population lives in countries that have officially adopted the metric system.

“Metric” in that sense solved disagreement about how much — it replaced local guesswork with a shared language of measurement so engineers, traders and regulators could trust one another.

Businesses face the same problem today — only the units have changed. Instead of metres and kilograms, modern organizations trade in clicks, sessions, impressions, cost, conversions and revenue. These are the metrics that power decisions, budgets and boardroom arguments. If one team’s “conversion” counts form submissions, another’s counts purchase intents, and a third’s counts paid signups, you get the same mess Europe lived with before standardization: wasted effort, mistrust, and bad decisions.

That’s why the digital-era equivalent of adopting the metric system matters: a single, governed vocabulary of business metrics (clear definitions, lineage, owners and calculational rules). Give everyone the same definition of “revenue,” “LTV,” or “ROAS” — and the same ability to trace where those numbers came from — and you turn noisy arguments into aligned action. In short: standardize the units, restore trust in the numbers, and your dashboards start to behave like the modern factories that metrication once enabled for Europe.

Turn to how many marketing teams are now constrained by the disparate marketing measures we have – it’s the choke-point preventing us from sharing dashboards between groups, asking bigger questions, and getting full bang for money spent on our analytics infrastructures. If we’re going to keep our sanity, we must get on with Metricizing our metrics. Going down a path where business metrics are treated as standardized units opens up possibilities as big as the Metric System opened up for our global economy. 

Our guest is a Proud Swiss-Canadian, technologist and entrepreneur. In 2001 he co-founded analytics software company Klipfolio, one of whose products aims to address metric management. Note that I’m having him on today to give his personal perspective – there’s no sponsor or affiliate relationship here. When he’s not working in or talking about analytics, you’ll find him cycling in the city we both call home. Let’s go talk to Allan Wille. 

 Timestamp Chapters

0:00:00 Standardizing Digital Metrics: A Modern Metric System
0:03:44 The Spreadsheet Era: Data Insights and Hidden Dangers
0:07:43 Leveraging APIs for Consistent and Mature Data Pipelines
0:11:39 Why Data Governance is Crucial for Trust in Metrics
0:19:29 Elevating Metrics: From Raw Data to Business Contracts
0:25:14 Bridging the Gap: Metric Catalogs for Data Teams
0:29:49 How AI is Standardizing Metric Definitions and Trust
0:37:44 Navigating Data Architecture: Semantic Layers and Power Metrics
0:44:26 Finding Your North Star: Metrics for Business Success



Listen to episode

People, products or concepts mentioned on the show:

Allan Wille on LinkedIn

Allan’s Metrics Stack Podcast

Powermetrics.app

MetricHQ.org

The meaning of Ontology is found in the Definition section of this blog.

Wayne Eckerson

Glenn and Allan recording

Optimizing Marketing with Statistics, with Ateeq Ahmad

Optimizing Marketing with Statistics, with Ateeq Ahmad

Episode 213

Sometimes, to reach a solution, we must take unfamiliar paths. 

In the early 1940s, a brilliant mathematician named Abraham Wald left his homeland in Hungary fleeing the spectre of war. He moved to the United States, and became part of a team at Columbia University tasked in 1942 with an aspect of the war where the Allies were losing badly to the Nazis. It involved the many Allied planes that would leave from England but never return to their bases, having been shot down somewhere over Europe. These B‑17 and B‑24 bombers had 10-man crews, weighed up to 30-32 tonnes, had wingspans of 100-110 feet, and were defended by machine guns planted along the plane’s entire length. Despite all this, they would lose planes every day, presumably because they’d taken enemy fire and  either crashed during their campaign or as they headed back over the English Channel. 

Wald’s team had to determine how to minimize bomber losses. They had been poring over aircraft returning from missions, mapping out the distribution of bullet holes across their fuselages. Their plan seemed logical — reinforce the areas with the most damage. But Wald saw what others missed.

Wald realized their sample set of data represented the survivors — the aircraft that had taken hits and still managed to return safely. There were other planes they weren’t examining, ones at the bottom of the channel or in occupied territory, that didn’t  make it back. This lack of data could be biasing them to look at the problem backward. The planes they couldn’t sample could have  been struck in areas that were more critical. Maybe the fact they were hit in those vulnerable spots was the reason behind them crashing and that the lack of damage in those spots on the surviving bombers simply meant they’d been lucky! the returning planes weren’t the rule, they were the exception. 

Having flipped the problem around, the planes received reinforcements where the damage must be catastrophic, and from them on many more B17s and B24s completed their missions, helping the allies to victory in Europe. Some people call what Wald showed intuition, but that’s not what saved the allied bombers. Even though his approach seemed counterintuitive, data guided Wald to the solution. 

This is Funnel Reboot, the podcast for analytically-minded marketers. Today’s episode goes outside our comfort zone, showing statistical tools in the hopes we’ll get a bit more comfortable using them.

Our guest today is someone who uses the same kind of critical reasoning – and statistics – to make sense of their product marketing problems. He is both someone who implements analytics tools, having configured over 500 sites, and one who posts prolifically about what he’s learned. He has also taught analytics at several New York colleges, and speaks at regional MeasureCamp events. After earning his MBA from Pennsylvania Western University, he spent about 20 years in corporate analytics. Then in 2017 with the support of his wife and three daughters, he set up his own firm, Albany Analytics. Listen now as he teaches you some tools that might help in your own marketing programs.

Let’s now go hear from Ateeq Ahmad.



Listen to episode

People, products and concepts mentioned in the show

Contact Ateeq via AlbanyAnalytics.com  

Ateeq on LinkedIn

Albany Analytics on X

Ateeq on Instagram

Reactions to an Ad at each successive impression:

The 1st time people look at an ad, they don’t see it.

The 2nd time, they don’t notice it.

The 3rd time, they are aware that it is there.

The 4th time, they have a fleeting sense that they’ve seen it before.

The 5th time, they actually read the ad.

The 6th time, they thumb their nose at it.

The 7th time, they get a little irritated with it.

The 8th time, they think, “Here’s that confounded ad again.”

The 9th time, they wonder if they’re missing out on something.

The 10th time, they ask their friends or neighbors if they’ve tried it.

The 11th time, they wonder how the company is paying for all these ads.

The 12th time, they start to think that it must be a good product.

The 13th time, they start to feel the product has value.

The 14th time, they start to feel like they’ve wanted a product like this for a long time.

The 15th time, they start to yearn for it because they can’t afford to buy it.

The 16th time, they accept the fact that they will buy it sometime in the future.

The 17th time, they make a commitment to buy the product.

The 18th time, they curse their poverty because they can’t buy this terrific product.

The 19th time, they count their money very carefully.

The 20th time prospects see the ad, they buy what it is offering.

Related Funnel Reboot Episode with Tim Wilson

Statistical tests:

Correlation – are two metrics related

T-tests – when and how to use them

Chi-Square Tests and their uses

RFM Modeling – best for email marketers

Market Basket Analysis – Products bought together

Yours truly with Ateeq, co-leading a MeasureCamp session

From Armageddon to GA4 Alignment, with Neil Shapiro

Neil Shapiro

Episode 210

Since July 1st, 2023, the world of web analytics has undergone a seismic shift—and if you’re still reeling from the transition to Google Analytics 4, you’re not alone. In this episode, we unpack what many are calling the ‘Armageddon’ of digital measurement. You’ll hear why GA4 isn’t just a new version of an old tool, but a completely different ecosystem

In human years, GA4 is still a toddler. But it is growing  rapidly and some are giving it a chance to mature. 

Many marketers took their licks in the forced transitioning to GA4 and there are still some raw emotions about how this tool was rolled out. But our guest says that even though change is hard, he guest believes GA4 is the change we didn’t know we needed. 

Our guest grew up in the New York tri-state area, which gave him two passions. The first one is hockey and watching people grow up playing the game they love – he’s a lifelong Islanders fan. Working in Manhattan, he also worked a lot with numbers. Over time, he morphed from analyzing financial data to analyzing digital marketing, in tools like Google Analytics And  Adobe Analytics. He built this expertise at industries giants like American Express travel and entertainment’s NBC Universal. Wanting to use these skills without the constraints of being in a big corporation, he went independent and relocated to Las Vegas, where he now gives all kinds of companies insights into their analytics data. 

Let’s go talk to Neil Shapiro.

Shownotes:

CDP – Customer Data Platform

Neil on LinkedIn

Neil’s consultancy: Zen Digital Analytics



Listen to episode

Neil & Glenn at an analytics conference
Neil & Glenn at an analytics conference

The AI Playbook, with Eric Siegel

The AI Playbook

Episode 199

Today’s topic is AI and ML, and though you may think this doesn’t concern marketing, we need to acknowledge how it’ll shift things.

Up to now, marketing was done on the premise that for a given audience shown a message, some  average percentage, would act on it. With AI, we’re now able to look at individual audience members and predict how each of them would act upon a message, and at the opportune moment we could have the message show up to each one of them. Goodbye analyzing what happened with crude audience averages, Hello to using detailed data to predict what’s likely to happen. 

With AI holding such promise, why don’t more companies hand things over to AI? I had thought it’s held up by a lack of technical people who know how to do this, but our guest says we’ve had enough technical expertise – He himself was previously one of those data people, and his expertise wasn’t enough to do the job.  He says AI initiatives are held back by those running business functions like marketing who haven’t made the business case and collaborated with the data people to implement this. 

My guest is a leading consultant and former Columbia University and UVA Darden professor. He is the founder of the long-running Machine Learning Week conference series, a frequent keynote speaker, and author of the bestselling Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die. In 2023 he authored “The AI playbook”

Let’s talk to Eric Siegel.

Timestamps/Chapters:

0:00:00 Intro
00:01:37 Welcome Eric Siegel
00:01:56 Barrier we face isn’t technical know-how
00:06:05 Despite a strong start – AI’s been slow to spread
00:11:17 Process a business needs to implement ML
00:27:41 building a custom algorithm
00:29:45 PSA
00:52:32 The human-side of the switchover
00:54:03 Contacting Eric

People, products or concepts mentioned in the show:

Eric speaks at: Generative AI Applications Summit and at Machine Learning Week

Reviews of The AI Playbook and book’s site

Eric works at Gooder.ai

Geek Professor Drops Rap Video, Tries to Dance

The AI Playbook | Eric Siegel, author | bizML

Clayton Christiansen

Malcolm Gladwell

 

 



Listen to episode

AI playbook diagram

Partnering on Customer Acquisition, with John Wright

John Wright Partnering on Customer Acquisition

Episode 197

Today, we are going to talk about how those of us who sell things find new buyers once we’ve exhausted our own audiences. We involve partners, and we can do this in a few ways. These partners may have high-traffic sites or be social media influencers. We are trying to use someone else’s channel to reach their audience, hoping they will buy from us.

Alternatively, we might be the ones who are influential or have a large audience that brands want to reach, so they pay us to be their marketing channel. The name for teaming up like this is affiliate marketing.

Today’s guest came to affiliate marketing through dabbling in online gambling. He watched the incentives sites put out to attract players, and then in 2010, he created a website that reviewed gambling affiliate programs called Gaming Affiliates Guide. This site’s traffic led him to become, you guessed it, an affiliate. Over time, he managed several gambling affiliate sites.

As you progress in this field, you always hit a ceiling with this marketing channel. No matter whether you’re the one needing traffic and paying for it, or the one who has traffic and is turning it into money, everyone gets a headache tracking it. As our guest was deeply involved at this point, getting paid to manage affiliate sites, he saw numerous problems in this industry and saw a way to solve them.

There were already applications that reported affiliate activity, but he saw these technologies’ shortcomings. With his engineering degree from the University of Toronto, which had taught him how to develop things, he joined up with partners to create a SaaS tool of their own: StatsDrone.

Having scratched an itch he experienced earlier in his career, he now heads a team whose tool addresses affiliate challenges.

Let’s go to Montreal and hear from John Wright.

 

 

Chapter Timestamps:

0:00:00 Intro

00:03:35 Welcome John Wright

00:06:57 Difficulty with Affiliate tracking

00:11:27 Postbacks and tracking methods

00:18:48 tracking dynamic variables

00:23:14 PSA

00:23:54 Tracking affiliate dollars

00:42:13 Contacting John

People, Products and Concepts mentioned in Show:

statsdrone.com

John@statsdrone.com

StatsDrone on Instagram

 



Listen to episode