Chapters
Shownotes Transcript
Support for NPR and the following message come from Edward Jones. What is rich? Maybe it's less about reaching a magic number and more about discovering the magic in life. Edward Jones Financial Advisors are people you can count on for financial strategies that help support a life you love. Edward Jones, member SIPC. This is Planet Money from NPR.
All right, we have a riddle for you. See if you can guess what we're talking about today. I was born at a Denny's restaurant. My name is Latin for envy. I played a lot of video games in my younger years. Today, I'm more into poetry and translation. I'm 31 years old, and I've been down and out so many times that my unofficial motto is that I'm 30 days from going out of business.
Still don't have it? What if we said, for a moment, I was the most valuable company on the planet? Yeah, that's right. The answer is the computer chip designer, NVIDIA.
And NVIDIA's chips are the leading choice for artificial intelligence developers. In the last couple of years, NVIDIA's sales have shot up like a jet plane. Its stock price? More like a rocket. But there are several chip companies out there, like AMD and others. So why is NVIDIA the one dominating the AI scene?
Hello and welcome to Planet Money. I'm Darren Woods. And I'm Waylon Wong. NVIDIA went from selling niche graphics cards for gaming to becoming one of the biggest companies in the world with help from another tech giant. Today on the show, two stories about innovators who went up against the status quo and in the process helped transform an industry we've all come to rely on.
This message comes from Capital One. Banking with Capital One helps you keep more money in your wallet with no fees or minimums on checking accounts. What's in your wallet? Terms apply. See CapitalOne.com slash bank for details. Capital One N.A. Member FDIC.
Support for NPR and the following message come from Edward Jones. What does it mean to be rich? Maybe it's less about reaching a magic number and more about discovering the magic in life. Edward Jones Financial Advisors are people you can count on for financial strategies that help support a life you love. Because the key to being rich is knowing what counts. Learn
Learn about this comprehensive approach to planning at edwardjones.com/findyourrich. Edward Jones, member SIPC. NVIDIA is often called a chip maker. That's a bit of an oversimplification. First of all, NVIDIA doesn't actually manufacture the semiconductor chips. That's done by companies like TSMC and Samsung. NVIDIA does the designing, like where the circuits all go on the chip.
It also makes the software so that developers can work with those chips. This combination has its roots in 1992. Jensen Huang and two other engineer friends met at a Denny's restaurant in San Jose. Their idea was to improve video games by building specialized chips for rendering 3D graphics.
This decision would become incredibly lucrative. One person who's spent a lot of time unearthing NVIDIA's history is David Rosenthal. David is one half of the tech podcast Acquired, which made this epic series of podcasts on the company's history. NVIDIA Corporate Communications got in touch and said,
Who were your sources? Who told you all this in the company? And we're like, well, nobody. We just, you know, we watched a lot of YouTube videos with Jensen. We read a lot of papers. This led to an in-person interview with Jensen Huang towards the end of last year. When did you realize that only he were going to work? I realized I didn't learn about it until it was too late. By all accounts, working for Jensen is super intense and not for everybody. Failures are shared publicly, for example, but
But David says those who stay are loyal. Jensen is truly singular in Silicon Valley. And I think, I mean, the man is 60 years old. Nobody from his generation is still running their company in the same way that he is. He is probably more engaged in every detail at NVIDIA than any of those other founders ever were at their companies. David says the way that Jensen is involved in the details is one key to why NVIDIA rode the AI wave so astutely. He started NVIDIA.
moving the NVIDIA ship in the direction that it is today with AI and machine learning, starting in like 20 years ago. It's incredible foresight. You know, it's obviously way before ChatGPT, but it's even before driverless cars or even voice recognition. How did he...
See this coming. Well, I think this is the key to Jensen. If you were to say that sentence to him, I think he would respond and say, no, it was not before all those things. All of those things were happening. They were just happening in the deep scientific computer science research community. He was so deeply plugged into all of this that he knew...
the principal actors who now are some of the true leaders in AI research at OpenAI and Anthropic and elsewhere these days. He knew them personally. He was reading the white papers. He was visiting them at universities all back in the mid-2000s.
At this time, NVIDIA was mainly known by 15-year-olds upgrading their gaming computers. But in the early 2000s, Jensen essentially made a huge bet on selling supercomputing power to a wider range of people. And as part of this, the company launched a software development framework called CUDA. CUDA acts kind of like a middleman between the software developer and the chip. And the system would be crucial for AI after a turning point in 2012. This was...
the big bang moment that kicked off research and investment at a commercial scale into artificial intelligence. It was at this annual competition for researchers to submit AI systems that could recognize images from a massive database. The database was called ImageNet, and progress had been gradual. Entries could correctly identify what a majority of images were,
but would typically have an error rate of around 25 or 30%.
That year, a team from the University of Toronto submits this entry that they call AlexNet. It blows away the rest of the field. So the percentage of images it got wrong was around 15%. This was a quantum leap. The team used an existing method of AI called a neural network, which was powerful, but had always been limited by how much computing power it required to train.
To overcome this, AlexNet did something different. The standard approach had been to train these models using central processing units, or CPUs, the generalist brains in your computer. But these calculate their instructions sequentially. You can think of it like one calculation, then another. So instead, this team ran these training calculations using graphics processing units, GPUs, what you would play video games with. A graphics card handles tens of thousands of...
instructions at a time. I've really widened the pipe of the amount of compute that I can stuff through this thing at any given point in time. And who makes graphics cards? NVIDIA, of course. People at Google and people at Facebook said...
Holy crap. You could use, they realized, these image classification systems to build way better social media feed recommenders. So for image recognition, programmers were training the software to notice patterns in, say, pictures of cats, whiskers, fur, four legs.
And similarly, the big social media companies realized they could train software to notice patterns in what kinds of pictures and posts and movies people like on the Internet. That was, you know, billions and billions and billions of dollars of profits. So there was a good 10-year run where, like...
Nothing else mattered. And that meant that places like YouTube and Facebook and Instagram were hiring a lot of AI talent. And David says this was actually part of the motivation for Elon Musk and Sam Altman to found OpenAI. They were really worried that Google and Facebook had just become a duopoly of all the AI development and research talent because it was the only, you know, economically viable use case.
OpenAI's launch of ChatGBT in late 2022 was the next hinge moment for AI and for NVIDIA. It woke investors and everyday people to advancements in AI that got them dreaming about the future. It's where NVIDIA suddenly started its journey, becoming one of the most valuable companies on the planet. In the parlance of tech investing, NVIDIA has this giant moat.
David reckons it's protected from competition in the foreseeable future because of CUDA, that development system. DAVID BAKER: These systems build on top of themselves over time and get more and more complex and powerful. So it would be like somebody going and starting a new phone operating system from scratch and saying, OK, what are all the list of things we need to build to make this phone operating system viable to compete with Android and iOS?
Yeah, that's a tall order. David says network effects are also important. Now, millions of other developers use CUDA. So if you're a college student, that's the language you're going to learn. It's a self-reinforcing cycle. This moat is something that has gotten people speculating about government action. News outlets like the New York Times have reported that the Department of Justice has cleared the way for
possible antitrust action against NVIDIA. Jensen, though, has said he doesn't like the word moat and prefers to think of the company as working alongside the entire AI ecosystem.
Whichever words you use to describe it, NVIDIA is standing on top of the world right now. Though even with all its chip sales, its stock price is very highly priced by conventional measures. One misstep and there is a long way to fall. All the way into the moat filled with barracudas. Barracudas! That's quite funny.
If you want to hear more on NVIDIA, check out our next Planet Money bonus episode, which is out in a couple of weeks. It'll feature my extended interview with David, where we go into more detail on the company, on CUDA and Jensen Huang. That's just for Planet Money Plus supporters. It's one of the perks you get for signing up, including sponsor-free listening and access to exclusive merch. Go to plus.npr.org slash planetmoney for more.
After the break, another unlikely origin story that made NVIDIA's rise possible: how America's advanced chip making ended up in Taiwan.
This message comes from NPR sponsor, American Express. Take your business further with the smart and flexible American Express Business Gold Card. It offers flexible spending capacity that adapts to your business. You can also earn up to $395 in annual statement credits on eligible purchases at select business merchants. That's the powerful backing of American Express. Terms apply. Learn more at americanexpress.com slash business gold card.
Support comes from our 2024 lead sponsor of Planet Money, Amazon Business. Everyone could use more time. Amazon Business offers smart business buying solutions so you can spend more time growing your business and less time doing the admin. You'll see why they call it smart. Learn more about smart business buying at amazonbusiness.com.
This message comes from NPR sponsor Dell Technologies. During their back-to-school event, learn how Dell is helping underserved communities around the world. Make a difference with Dell and shop AI-ready PCs powered by Snapdragon X series processors at dell.com slash deals.
This message comes from NPR sponsor, Quince. Even on a budget, you still deserve nice things. Scoop up timeless high-quality goods for 50 to 80% less than similar brands with Quince. Go to quince.com slash style for free shipping and 365-day returns.
I'm Adrian Ma. And I'm Darian Woods. If you have the latest iPhone, you'll find inside it a computer chip with parts so fine-grained that you can measure them in atoms. That processing chip contains 16 billion transistors.
The iPhone chip and most cutting-edge chips for computers and cars are made in a handful of factories on a small island in the Pacific, in Taiwan. And the story of how Taiwan came to make the most advanced chips in the world can basically be told through the story of one man, Morris Chang.
He's like a founding father of the chip-slash-semiconductor industry. It's not an exaggeration to say that Morris' personal career obstacles and what he chose to do about them helped shape the balance of power between the U.S. and the world. When Morris Chang grew up in China and Hong Kong, he fled three wars and saw a lot of poverty around him. So when he got into Harvard at age 18, he had one goal, to make money.
And he looked around at what a middle-class kid from China could do to make a lot of money back in 1950.
Engineering. So he left Harvard for MIT, which actually had an engineering program. I really wasn't all that interested in mechanical engineering or in engineering at all. But he's in it for the bucks, right? That's right. That is Morris Chang speaking in an interview with Stanford's president in 2014. And Morris eventually gets a job at electronics company Texas Instruments. And Morris is promoted really quickly because
By the early 1970s, he's vice president. But pretty soon, he finds his career stalling, and he can't get promoted further. Cheng Tai-she is an economist at the University of Chicago who was born in Taiwan. And at one point, he even worked at the same organization that Morris once led. Cheng Tai says in the early 1970s, all chip design, manufacturing, testing, and packaging was done in the U.S.,
And the U.S. was so dominant because semiconductors were invented here. It was prohibitively expensive to get into this industry. You had to come up not only with the expertise to put together the design, but then you also had to spend several billion dollars
putting up the manufacturing capacity. Just a couple of details about how hard it is to manufacture semiconductors. Your building has to be constructed so that it doesn't vibrate down to just nanometers. You cannot build a facility where there's any dust that can fall on your chips. It has to be a thousand times cleaner than a hospital operating theater.
But there were a few things other companies could do. In the 1970s, Morris Chang realized he could save his company a lot of money by outsourcing simple tasks like packaging and testing to Taiwan. In Taiwan, incomes were only about a tenth of American incomes.
And Morse supercharged the company's growth by pioneering new ways of pricing the computer chips that would, you know, result in a loss now, but capture the market share as the cost of making chips got cheaper and cheaper.
Oh, and he also ran the division that invented the speak-in spell. Chang Tai-she says that despite Morris Chang's achievements, for the next decade, his career kind of hit a wall. He wanted to be chief executive. And this is something that he has said publicly. He felt that given the nature of the culture at Texas Instruments, he would never become the CEO. Why not?
Because he's Asian. I mean, that's what he has said, that it was a very white company. There was a culture there in which people like him don't get promoted. Then in 1983, after a couple of years of agonizing, and after 25 years with Texas Instruments, Morris Chang decided to leave the company. And before long, the premier of Taiwan recruits Morris to run this thing called the Industrial Technology Research Institute. Basically, the goal is to turn Taiwan into a tech powerhouse.
Think of it as an organization that's part research, part government investing in new companies. The culture very much was that of a startup.
Cheng Tai worked here in 1990. It wasn't a typical government bureaucracy. They were working 12-hour days. In two-box apartments, people get paid nothing. But there's this dream that it's a combination of getting rich and that you're going to change the world. And before long, the government of Taiwan realizes, wait, we have the semiconductor superstar right in front of us, someone who could have been CEO at one of the very few companies in the world who can make cutting-edge chips. So they say, how about
But instead of helping out other companies, you run your own, a semiconductor company. And I want to pause here for a second because this is a pretty bold decision. It's a possibly foolish idea because history books are full of cases where a government says we want to make whatever, cars, spaceships, cell phones, and then it just fails spectacularly. It costs an immense amount of money, doesn't turn a profit most of those times.
But Taiwan decides to do it with one of the absolute hardest types of businesses to start, both then and now. So Morris looks around and he realizes there just are not enough scientists who know how to design chips to build, you know, essentially the Taiwanese version of Texas instruments. So Morris says, let's try something different. He thinks, what do we have?
Well, we've got cheap labor that's getting more and more skilled at advanced manufacturing. We've got solid supply lines for factories. And then he thinks about how America almost has the reverse problem. It's got too many people who can design chips. So many people who would start their own semiconductor company, but building the factory in the U.S. is too expensive. His basic idea was to say, you know, why don't we develop a company that would only serve other customers?
in which we completely get out of the design business. We only do the manufacturing part of the business. And this would allow us to serve lots of customers that at the time their needs weren't being met. And this simple decision, this decision to separate manufacturing from design completely changed the chip industry.
In 1987, Morris Chang founded Taiwan Semiconductor Manufacturing Company, TSMC. And over the years, more and more companies started to use TSMC. Some big chip makers even sold off the manufacturing parts of their businesses, knowing that, you know, they could design the chips and TSMC could make them. And with the advent of TSMC and its Taiwanese competitor UMC, some startup founder could have a great idea for a new chip, like a new graphics card for gaming.
But they didn't need hundreds of millions of dollars. This is exactly what happened with NVIDIA. It designed semiconductors in America, but TSMC makes them. A company like NVIDIA would not have existed.
So on the one hand, yes, TSMC took a lot of the chip manufacturing business away from America, but it also allowed entrepreneurial dreams from Silicon Valley to come true. Now, TSMC is the most important semiconductor manufacturing company and the eighth largest company in the world.
It makes the vast majority of the world's most advanced chips. It's so critical for global supply chains that U.S. lawmakers are nervous. In August of 2022, President Joe Biden passed a bill called the Chips Act, which means $39 billion for companies making computer chips in America. Which is so much money, right?
It's not that much money relative to how much is needed to build it because each semiconductor plant is about $28 billion. Okay. So you might got to build two plants maybe. I guess my prediction is that this is going to be another boondoggle. And so this money is supposed to light a fire under the collective butts of the chip manufacturing industry, right? Like what the U.S. is trying is something that the Taiwanese government tried about 35 years ago and
And it worked for Taiwan because Morris had the skills and saw a slice of the market. He could take it just the right time. And the government funded it like a business investment, right? Not a handout to a company. I would say that the only plausible case for something like the CHIPS Act is if at some point in the future, there's war between Taiwan and China.
And TSMC is either destroyed or TSMC is taken over by the Chinese Communist Party. Up to $6.6 billion of the CHIPS Act money has been allocated in direct funding for a TSMC factory. This one is being built in Arizona. CHIP production is set to start in 2028.
And the irony is, in another world where Morris Chang found more open doors in the US, a company like TSMC could have been American to begin with.
On the next Planet Money, 40 years ago, an airline CEO had a novel idea. Our concept was everybody wants to get from A to B. They don't go on an airplane to get food. That sounds a lot like my airplane experience. Well, please don't compare us to the Spirit. The story of the first national budget airline and why flying has become the way it is today. That's next time on Planet Money.
These stories originally aired on The Indicator from Planet Money and were originally produced by Julia Ritchie and Viet Le with help from Nikki Ouellette. They were edited by Kate Kincannon and engineered by Sina Lofredo and James Willits. Fact-checking was done by Tyler Washington and Sierra Juarez. Our Planet Money edition was produced by Willa Rubin, edited by Jenny Lawton, fact-checked by Sophia Shukina and engineered by Neil Rauch. Alex Goldmark is our executive producer. I'm Darian Woods. This is NPR. Thanks for listening.
This message comes from NPR sponsor Twilio, a customer engagement platform that makes interacting with your customers on the right channel, at the right time, in the right way, easy. Twilio powers meaningful customer interactions for more than 300,000 brands. Plus, Gartner just named the company a leader for the second time in its 2024 Magic Quadrant for CPaaS. Learn more at twilio.com slash Gartner.
This message comes from NPR sponsor, Capella University. Capella's programs teach skills relevant to your career, so you can apply what you learn right away. See how Capella can make a difference in your life at capella.edu.