No AI model has cracked 60% on real-world contract review, even as the legal tech industry keeps announcing new launches. In this month’s recap, host Phillip Vaden breaks down an independent study from Ivo and MicroOne that tested seven models on 350 attorney-scored contract tasks, with Grok leading at 58.3%, just ahead of Claude Opus 5.5 and Kimi K3. He also looks at how Anthropic is expanding Claude for Legal with a gallery of ready-to-use artifacts, including tools built by Goodwin, Foley and Lardner, and PwC, plus more than 60 legal data connectors added since May. Other stories include Conceal, a local desktop app from Sprint Four that masks client information before it reaches ChatGPT or Claude at a price aimed at solo and small firms, and Davis Wright Tremaine’s peer learning pilot to get about 70 attorneys using AI well. Vaden also covers Google and Meta in-house counsel reporting that AI-drafted patent applications are often rated as good as or better than human drafts in blind tests, and closes with the American Legal Technology Awards, where Open Laws took the AI category. Resources: Anthropic Adds Ready-to-Use Legal Artifacts Gallery to Claude (Unite.AI) Anthropic moves further up the legal tech stack with launch of Claude for Legal Artifacts (Legal IT Insider) Anthropic Increases Legal Vertical Push With ‘Artifacts’ (Artificial Lawyer) Conseal, a New On-Device Privacy App, Masks Sensitive Client Data Before It Reaches AI Tools Like ChatGPT and Claude (LawSites) Grok Top For Contracts, AL on Hols, Harvey Agents + (Artificial Lawyer) DWT Advances AI Strategy (Davis Wright Tremaine) Tech In-House Attys Say AI Rivals Humans At Writing Patents (Law360 Pulse) American Legal Technology Awards Honor 2026 Winners Who ‘Ask Why’ (LawSites) Transcript: Phillip Vaden Hey everyone. Welcome to a special tech update edition of the AI Sidebar, where we talk all things AI and legal tech with an eye towards dehyping a very hyped space. I'm Phillip Vaden, Partner Manager at InfoTrack. Let's dive in. A lot happened over the past month. A major move from Anthropic into legal-specific tooling, a promising new security tool, an independent benchmark that should humble anyone who thinks AI has fully solved contract review, and a few stories about how firms are actually getting their people to use this stuff. Let's get into it. So Anthropic goes deeper into legal. We'll start with what may be the single most important story of the month. Anthropic, the company behind Claude, significantly expanded its legal offering. Back in May, Anthropic launched Claude for Legal, which came with more than 20 model context protocol connectors and a dozen practice area plugins. Late last month, they built on with a gallery of ready-to-use artifacts specifically for legal work. Think interactive tools and dashboards, not just chat responses. Anthropic built 6 of these themselves, but here's the part I find more interesting. 4 more of these tools were built by outside partners and shipped inside Claude. Goodwin built an AI governance benchmark. Hardy built an intake tool. Foley and Lardner built an obligations checker, and PwC built a subpoena response tool, with more reportedly coming from Legora and Oric. On top of that, Anthropic is funding a batch of access to justice tools, things like an immigration papers reader and a record sealing screener built with legal aid organizations, which I think is a great thing. And since May, Anthropic says it's added more than 60 legal data connectors covering things like Bloomberg Law, Filevine, and Legora. The takeaway here is that Anthropic isn't just offering a general purpose model that happens to be useful for lawyers anymore. It's actively building out a legal ecosystem with named practice groups, implementation partners like Accenture, Deloitte, and KPMG, and direct relationships with legal legal tech vendors. That's a meaningfully different posture from where they were just six months ago. All right, next up we're going to talk about a privacy shield for solo and small firms. So here's a story that I think matters a lot for anyone running a smaller practice. A company called Sprint Four launched a desktop app called Conceal that runs entirely on your own device and masks sensitive client information before. Before it ever reaches tools like ChatGPT or Claude. The pitch is simple: a lightweight AI model runs locally, it detects client names, addresses, and case details in whatever you're typing or whatever document you're working with, and either redacts that information permanently or it swaps it for placeholder labels that you can restore later from a local mapping file. Nothing about the actual document content leaves your machine. It works inside ChatGPT and Claude desktop apps directly, and it's priced at under $30 a device per month, which is an incredibly attractive price point. Sprit4 is explicitly targeting solo and small firms here, pointing to ABA data that, that ...
Show More
Show Less