Home
cover of episode NVIDIA's Jensen Huang on AI Chip Design, Scaling Data Centers, and his 10-Year Bets

NVIDIA's Jensen Huang on AI Chip Design, Scaling Data Centers, and his 10-Year Bets

2024/11/7
logo of podcast No Priors: Artificial Intelligence | Technology | Startups

No Priors: Artificial Intelligence | Technology | Startups

Chapters

Jensen Huang discusses NVIDIA's long-term bets on computing, focusing on scaling performance and reducing costs and energy consumption.
  • NVIDIA aims to double or triple performance every year at scale.
  • The company is moving beyond Moore's Law to a 'hyper-Moral's Law' curve.
  • NVIDIA's approach involves both chip design and data center scale.

Shownotes Transcript

In this week’s episode of No Priors, Sarah and Elad sit down with Jensen Huang, CEO of NVIDIA, for the second time to reflect on the company’s extraordinary growth over the past year. Jensen discusses AI’s takeover of datacenters and NVIDIA’s rapid development of x.AI)’s supercluster. The conversation also covers Nvidia’s decade-long infrastructure bets, software longevity, and innovations like NVLink. Jensen shares his views on the future of embodied AI, digital employees, and how AI is transforming scientific discovery.

Sign up) for new podcasts every week. Email feedback to [email protected]

Follow us on Twitter: @NoPriorsPod) | @Saranormous) | @EladGil) | @Nvidia)

Show Notes: 

00:00 Introduction

1:22 NVIDIA's 10-year bets

2:28 Outpacing Moore’s Law

3:42 Data centers and NVLink

7:16 Infrastructure flexibility for large-scale training and inference 

10:40 Building and optimizing data centers 

13:30 Maintaining software and architecture compatibility 

15:00 X.AI)’s supercluster 

18:55 Challenges of super scaling data centers

20:39 AI’s role in chip design 

22:23 NVIDIA's market cap surge and company evolution 

27:03 Embodied AI

28:33 AI employees

31:25 Impact of AI on science and engineering 

35:40 Jensen’s personal use of AI tools