We needed some help regulating and validating our podcast (and models), so we invited Henry Innis - Co-Founder of Mutinex - to help out.Listen in to this lovely chat about the quirky differences between the American and Australian markets, challenges and realities of MMM, and the future of media measurement and regulation. Buckle up for the hot takes.00:00 Casual Catch-Up and Thanksgiving Stories01:08 Topic Introduction - Marketing Mix Modeling01:34 Guest Introduction and Background03:00 Differences in Marketing Practices: US vs Australia06:27 Innovative Applications and Hackathon Projects09:51 Marketers and Money Conference Overview13:32 Challenges and Realities of Marketing Mix Modeling16:36 Campaign Varying Model and Its Impact24:30 Future of Media Measurement and Regulation28:09 Introduction to Industry Insights28:33 Integrating Work's Knowledge into Mate30:02 The Role of MMM in Marketing32:53 Challenges in Data-Driven Decision Making34:48 Partnering with WARC for Effectiveness35:53 Common Questions Asked to MAITE38:34 Validating Outputs and Handling Errors49:33 Open MMM Validation Framework54:40 The Impact of Google and Meta on MMM55:22 Conclusion and Future Discussions

Version A: Join Simon and Jim as they babble about button colors while the experts tell them what really matters in experimentation.

Version B: Have you ever wondered what makes for a great experimentation culture?

(Let us know in the comments which version you prefer!)

We were lucky to talk with Kelly Worthham and Ton Wesseling, both experts in decision science and experimentation.We cover the transition from traditional conversion rate optimization (CRO) to broader growth engineering, organizational transformation for better decision-making, and the impact of AI on experimentation.

Discover how conferences like Experimentation Island and Conversion Hotel foster deep, meaningful conversations and collaborations within the community.

Links from the show:

The Conference known as Conversion Hotel

The Conference known as Experimentation Island

Test & Learn Community

No Hacks Podcast

Experimentation Culture Awards

00:00 Introduction and Casual Banter

00:52 Halloween Candy Stories

02:27 Introducing the Special Guests

02:41 Kelly Worthham's Background

03:58 Todd's Background and Contributions

05:18 Experimentation Island Conference

13:57 Conversion Optimization vs. Growth Optimization

25:07 The Risk of Imitating Big Brands

25:22 Helping Businesses Make Data-Driven Decisions

27:02 Building Effective Experimentation Processes

30:22 Challenges in Replicability and Experimentation

34:54 The Role of AI in Experimentation

40:52 Future of Experimentation and AI

48:32 Concluding Thoughts and Recommendations

Ever wonder how Walmart, Kroger, Home Depot, and Instacart are different from a guy in a trench coat? They ask for consent before exposure! Join Simon and Jim as they dive into the often misunderstood world of retail media networks with Sky Frontier, EVP at Incremental.Discover why retail media is the Wild West of advertising, how it's moving up the funnel, and the unique challenges it poses. Learn about Sky's journey from philosophy to advertising, and why your branded search strategy might need a rethink. Plus, we tackle Amazon's recent Google Shopping mystery – did they just pull off the greatest experiment of all time?

Links from the show:

Skye Frontier on LinkedIn

IncrementalShow Notes:00:00 Welcome Back and Summer Catch-Up00:34 AI Measurement Solutions and Future Prospects01:10 Retail Media Networks: An Introduction02:21 Guest Introduction: Sky Frontier04:15 Defining Retail Media Networks06:46 Challenges in Retail Media Measurement14:12 Incrementality in Retail Media18:42 Operational Challenges and Clean Rooms22:55 Challenges in Retail Media Experimentation23:41 Econometrics and Granularity in Retail Media25:18 Synthetic Experimentation and Difference-in-Differences Analysis28:30 Future Trends in Retail Media32:28 Amazon's Strategic Shift in Advertising41:55 Concluding Thoughts on Retail Media Measurement