The shift to agentic AI demands far more than just a powerful GPU. To meet the needs of AI agents, NVIDIA rethought traditional processor design with the Vera CPU. By focusing on powerful custom Olympus cores rather than maximizing core counts, NVIDIA says Vera can deliver twice the performance of a traditional x86 architecture.

NVIDIA's strategy is outlined by Dion Harris, the Senior Director of HPC and AI Hyperscale Infrastructure Solutions for NVIDIA. In our discussion, Harris speaks with Data Center Richness editor Rich Miller to trace the rapid evolution of AI, and what each shift has meant for the hardware, power, and cooling inside AI factories.

A key theme is how NVIDIA's rapid rollout of powerful new hardware is driving big changes in the data center, especially the transitions to high-density racks, liquid cooling and 800-volt DC power distribution.

Dion also shares why NVIDIA is entering the market for Land, Power and Shell for Data Center Campuses.

Here's an overview of our conversation:

00:00 Welcome and the evolution of AI: from training to reasoning to agentic AI
04:26 Vera: NVIDIA's CPU built for AI agents
07:35 Hardware cadence, CUDA compatibility, and why older GPUs keep their value
11:21 Getting data centers ready: DSX and data center-scale power management
15:49 DSX Flex: tapping stranded grid power through flexibility
20:27 Why mixture of experts made liquid cooling essential, from Blackwell to Vera Rubin
25:54 Does the rack remain the rack? Scale-up domains and the shift to the pod
29:10 Scale-up, scale-out, and scale-across: networking AI across data centers
31:55 The transition to 800 VDC power
35:15 Closing thoughts

-----------------------------------------------------------------------

At Data Center Richness we demystify technology and explain why data centers matter, and what comes next for the Internet, cloud computing and AI. Host Rich Miller is a journalist and analyst who has been covering the data center sector for 25 years.

Subscribe to our channel for more insights:
https://www.youtube.com/@DataCenterRichness?sub_confirmation=1

VISIT OUR SITE:

Data Center Richness Substack:
https://datacenterrichness.substack.com/

LINKS FROM THIS SHOW

NVIDIA Data Center Solutions
https://www.nvidia.com/en-us/data-center/

NVIDIA Developer Blog: Vera CPU
https://developer.nvidia.com/blog/nvidia-vera-cpu-boosts-ai-factory-throughput-to-accelerate-agentic-workloads/

Dion Harris on LinkedIn
https://www.linkedin.com/in/dionharris/

Rich Miller on LinkedIn
https://www.linkedin.com/in/datacenterfrontier/

RELATED VIDEOS:

Engineering the Future With NVIDIA's Most Advanced Racks
https://youtu.be/SmjqVekN93o?si=CJzewN2dT6zA-EjU

Vera Rubin NVL72 Has Arrived
https://datacenterrichness.substack.com/p/coreweave-vera-rubin-nvl72-has-arrived

All video by Data Center Richness.

Supplemental music via Epidemic Sound https://share.epidemicsound.com/60o8qx

Loudoun County in Northern Virginia has long been the center of gravity for the data center industry. It is the home of Data Center Alley, a section of Ashburn where all the major networks meet, making it the world's primary destination for Internet traffic.

As a result, Loudoun County has been on the front lines of just about every major trend in the data center sector. That includes the data center boom, and more recently the controversies involving data centers and community pushback. There have been plenty of headlines about resistance to the data center industry, most notably the Loudoun supervisors calling for a pause in development as they refine local regulations.

But Loudoun County's history tells a larger story about data centers and communities. And no one knows this better than Buddy Rizer, the executive director of economic development for Loudoun County. In our discussion, I asked Buddy to talk about what data centers have meant to the Loudoun County, including some interest metrics on economic impact, and water usage by data centers (a hot topic these days).

00:00 - On the Front Lines of the Internet Boom
01:30 - How Data Center Alley Came About
05:16 - The Conversation Beyond Loudoun
07:27 - The Data Center Industry Response
09:00 - Data Centers and Water: The Loudoun Experience

-----------------------------------------------------------------------

At Data Center Richness we demystify technology and explain why data centers matter, and what comes next for the Internet, cloud computing and AI. Host Rich Miller is a journalist and analyst who has been covering the data center sector for 25 years.

Subscribe to our channel for more insights:
https://www.youtube.com/@DataCenterRichness?sub_confirmation=1

VISIT OUR SITE:

Data Center Richness Substack:
https://datacenterrichness.substack.com/

LINKS FROM THIS SHOW

Loudoun County Economic Development
https://loudounpossible.com/

Buddy Rizer on LinkedIn
https://www.linkedin.com/in/buddyrizer/

Rich Miller on LinkedIn
https://www.linkedin.com/in/datacenterfrontier/

The Godfather of Data Centers - WSJ
https://www.wsj.com/finance/the-godfather-of-data-centers-making-offers-big-tech-cant-refuse-6c52d301

The Next Data Center Constraint: Trust
https://www.datacenterfrontier.com/site-selection/podcast/55397375/the-next-data-center-constraint-trust

RELATED VIDEOS:

How Google Built the Future of Data Centers
https://youtu.be/F33oE34X0j4?si=WKOehcvCzUSEmLAi

Can Data Centers Be Good Neighbors?
https://youtu.be/syRpAj9aCSg?si=lWeQjlca2sfq7Fdt

Why Data Centers Are Moving to Power-Rich Locations
https://youtu.be/AlIwlsiLa5M?si=X4bHMu1s6Da-VOzy

All video by Data Center Richness.

Supplemental music via Epidemic Sound
https://share.epidemicsound.com/60o8qx

Liquid cooling has become one of the most important technologies in the rise of AI. Powerful new AI server hardware throws off a lot of heat, pushing past the limits of most traditional air cooling. This has driven a surge of acquisitions in the cooling sector, and none bigger than Ecolab's $4.75 billion deal to acquire liquid cooling specialist CoolIT Systems.

In this episode of Data Center Richness, host Rich Miller sits down with Jason Walker, Director of Product Marketing for Data Centers at Ecolab, to break down the CoolIT acquisition.

Walker discusses how Ecolab is pairing decades of industrial fluid management with CoolIT's cold plates, CDUs, and manifolds to solve critical operational bottlenecks. Learn why fluid health and monitoring matter during commissioning, how joint R&D at CoolIT's 6MW Calgary facility aims to extend single-phase cooling limits for extreme densities, and how integrated hardware and chemistry simplify lifecycle operations for hyperscalers and multi-tenant colocation operators.

Here's an overview of the conversation:

00:00 - Introduction: The CoolIT Acquisition and AI Cooling
01:42 - Ecolab's Mission in Data Centers and Fluid Management
04:00 - Strategic Fit: Why Ecolab Acquired CoolIT
05:56 - Navigating Startup Risks and Direct-to-Chip Fluid Health
09:06 - In-Line Testing and 3D TRASAR Real-Time Monitoring
10:32 - Deploying Side-Stream Controllers and BMS Integration
12:09 - Connecting Hardware Monitoring and Fluid Data
13:40 - Integration Progress and Cultural Alignment Post-Close
16:40 - Calgary Testing Facility and Joint R&D Capabilities
19:28 - Extending Single-Phase Liquid Cooling Limits
23:01 - Customer Base: Hyperscalers vs. Colocation Operators
26:10 - Fluid Health and Multi-Tenant Hybrid Cooling Challenges
28:21 - Where to Connect with Jason Walker and Learn More

-----------------------------------------------------------------------

At Data Center Richness we demystify technology and explain why data centers matter, and what comes next for the Internet, cloud computing and AI. Host Rich Miller is a journalist and analyst who has been covering the data center sector for 25 years.

Subscribe to our channel for more insights:
https://www.youtube.com/@DataCenterRichness?sub_confirmation=1

VISIT OUR SITE:

Data Center Richness Substack:
https://datacenterrichness.substack.com/

LINKS FROM THIS SHOW

Ecolab Data Center Solutions
https://www.ecolab.com

CoolIT Systems
https://www.coolitsystems.com

Jason Walker on LinkedIn
https://www.linkedin.com/in/jason-j-walker-mba/

Rich Miller on LinkedIn
https://www.linkedin.com/in/datacenterfrontier/

RELATED VIDEOS:

The Future of Liquid Cooling
https://youtu.be/JGL4Bi6Vrn4?si=d5UPjeEfEDu7qfFd

Liquid Cooling Has Finally Arrived
https://youtu.be/sZM6MZBOeho?si=HrDgXB345zn51-XL

A Closer Look at Two-Phase Liquid Cooling
https://youtu.be/w_Us94JgYzc?si=wMd1TUS7bMJjqjew

All video by Data Center Richness.

Supplemental music via Epidemic Sound
https://share.epidemicsound.com/60o8qx

If you enjoyed this conversation, please like the video, leave your thoughts in the comments, and subscribe to Data Center Richness for deep dives into AI infrastructure, power, and high-density computing.