• GenAI Evaluation: One Model, Three Goals - Deepshikha, Anamika Mukhopadhyay
    Nov 19 2026
    GenAI evaluation turns into a question of better or worse once every answer a model gives could be correct, and that is where Deepshikha and Anamika Mukhopadhyay begin. We talk about why one model needs three different definitions of good as a customer bot, a clinical summarizer and a coding agent, and why most teams they meet in workshops measure whatever their tools give them by default. A faithfulness score like 0.87279 left a room of CXOs asking whether it was a rounding problem; a 12 percent drop in issue resolution and 200 extra tickets did not. And a prepared Reddit post shows how an indirect prompt injection slips past an agent that had blocked every direct one.
    Show More Show Less
    28 mins
  • Contract-Driven Testing in Banking: Realistic Mocks - Phil Royston
    Nov 12 2026
    Contract-driven testing lets a tester work against a realistic mock instead of waiting for 50 integrated systems to behave, and that is what Phil Royston is bringing into a large bank. We talk about why mocks built on a developer's imagination produce unreliable tests, how agreed contract tests turn into mocks for API consumer and provider, and why the pitch to senior management fits on one slide while the middle managers hold the veto. Phil also explains why approved business requirements were not testable ones, what he means by parasitic end-to-end testing, and why his advice to any test manager is to wait for the crisis.
    Show More Show Less
    30 mins
  • Building Trust in Teams: Start Small - Michael Kutz, Linda Van De Vooren
    Nov 5 2026
    Building trust in teams starts with far smaller things than a team-building event, and that is what I talk through with Michael Kutz and Linda Van De Vooren. Michael brings Stephen Covey's waves of trust, from self-trust outward, and his rule that a kept promise about one issue in the code base is one of the Lego stones trust is built from. Linda talks about the inner critic she has practiced with for over ten years, about limitless honesty with a new client, and about why rest and fun come first. We also get into a 50,000 credit limit that became 500,000 through one extra zero, who owns the fix after that, and what makes an app trustworthy when it tells you what went wrong.
    Show More Show Less
    43 mins
  • Ard Kramer
    Oct 29 2026
    19 mins
  • Testing AI Models as Magic Boxes: Why Checks Fail - Michael Bolton
    Oct 22 2026
    Testing AI models means testing a magic box: nobody has the source code, and the behavior is neither controlled nor understood. Michael Bolton calls that strongly magical, and with him I talk about what follows from it. His principles are simple: if something matters very much, don't depend on magic, and if you use it anyway, responsibility demands that you test it and maximize testability. Simple output checks don't stand a chance against a language model, so testing becomes experiencing, exploring and experimenting, like peeling an onion. And Penn and Teller's clear plastic cups show why we fall for these models in the first place: the insight we see in their text comes from us.
    Show More Show Less
    28 mins
  • Dark Side of Testing: The Failures We Cause Ourselves - Bart Knaack
    Oct 15 2026
    Testing is supposed to prevent failures in production, yet sometimes the test itself is what breaks things. Bart Knaack calls this the dark side of testing, and we talk about test data leaking out of poorly protected environments, test systems that give attackers a look at your code, and why testing in production needs a risk assessment of its own. Bart would rather ask questions than hand out checklists, because a ticked box stops people thinking. He also tells the story of a team with 10,000 end-to-end test cases that ended up needing only 50.
    Show More Show Less
    19 mins
  • Quality Hunting: Testing for Information Instead of Bugs - Rik Marselis
    Oct 8 2026
    Quality hunting grew out of Rik Marselis's frustration with bug hunting, and I wanted to know how it works when the goal is information about quality. Rik walks me through a session: teams of about four people, three hours of exploratory testing and a goal agreed up front by asking stakeholders what would help them sleep well at night. He explains why the report structure comes first, why the prize should stay small and why the point just before several sprints go to production suits a hunt well.
    Show More Show Less
    18 mins
  • On-Site Testing Conferences: Why Networking Needs Presence - Okan Çakmak
    Oct 1 2026
    What does it take to turn a risky one-time event into a conference that testers travel across borders for? With Okan Çakmak I talk about how the Istanbul Software Testing Conference grew out of something missing: after the pandemic, the big Turkish testing events stayed online, and people lost the chance to meet, network and hug each other in person. He tells me how the team wondered whether 50 or 100 people would come, then welcomed 200, and how the "light in their eyes" of those first participants convinced them to keep going.
    Show More Show Less
    17 mins