Paul Atkins is pro-crypto and has experience drafting best practices for crypto trading platforms, which aligns with Trump's deregulatory agenda and support for innovation in the crypto space.
xAI has built the world's largest supercomputer with over 100,000 GPUs, enabling the testing of AI scaling laws with Grok 3. This could lead to significant advancements in AI capabilities if scaling laws hold.
The U.S. is increasing its electricity production capacity from one terawatt to two, while China is scaling from two terawatts to eight. This disparity highlights China's rapid growth in energy infrastructure, which is critical for economic and technological advancement.
Saylor's strategy relies on Bitcoin's value continuously increasing, but if Bitcoin's price stagnates or declines, the interest expenses on the debt could become unsustainable for MicroStrategy, posing a risk to the company's financial health.
Defense technology is crucial in maintaining U.S. military superiority and countering China's advancements. Investments in drones, lasers, and AI-driven systems are essential to modern warfare and national security.
Elon's xAI supercomputer, Colossus, is the largest in the world with 100,000 GPUs, surpassing previous limits. If scaling laws hold, Grok 3 could become a significant advancement in AI, potentially surpassing OpenAI's models.
The murder of the UnitedHealth CEO, linked to terms like 'deny, defend, and depose,' suggests a personal vendetta related to the company's insurance practices, highlighting the intense public anger over healthcare denial controversies.
The debate centers on whether AI scaling laws are breaking down, as no one has tested clusters larger than 32,000 GPUs. Grok 3's performance on Colossus will provide critical data on whether scaling laws still hold.
AI tools like Notion and Zoom's AI summaries enhance productivity by automating tasks, generating summaries, and enabling individuals to build applications without traditional coding knowledge.
In the future, AI could allow users to describe desired applications in natural language, which the AI would then build, test, and deploy, revolutionizing software development and reducing the need for traditional programming.
Hey, everybody. Hey, everybody. Before we drop this week's amazing episode, just some quick information for you. Sax and Chamath both had the week off. So we had two amazing friends of the pod on Gavin Baker from Atreides and Joe Lonsdale from 8VC. What a treat to have them on the program. But there is some big news, huh, Freeberg? Yeah, well, the news dropped after we recorded, so it's not going to be referenced and the show might feel a little stale, but
Here we go. Our friend, David Sachs, is the White House AI and crypto czar of the United States of America. Congratulations to our boy. Amazing. Super thrilled. That is a big reason why he wasn't able to join us for the show. He was in the middle of getting this news ramped up. Yes. It came out. We had already recorded. Yeah, take that into account as we go into the show. Yes. And according to Trump's Truth Social Post, Sachs will, quote,
guide policy for the administration in artificial intelligence and cryptocurrency. He will also lead the Presidential Council of Advisors for Science and Technology. How great is that, Freebird? Wow, science corner in the White House? Can't wait. It's going to be fun. It's going to be amazing. Pretty exciting. Pretty awesome. I have no announcements. The rumors about me becoming press secretary are obviously premature, but if asked to serve, I will serve.
my country. Okay, let's get to it. Don't worry, besties all in isn't going anywhere. We'll be here every week for you except maybe Thanksgiving or a holiday now and again. All right, let's start the show. Huh? Freebar. Great episode. Let's go. All right, everybody. Welcome to the all in podcast. I am your host, Jason Calacanis. How are you doing Friedberg? I'm hanging in there. I'm waiting for the tsunami to hit. It's gonna we're about 40 minutes away.
I'm a little anxious right now. More anxious than normal is what you're saying. Like on a scale of one to Freeburg, this is like as anxious as you get with the tsunami? I don't know what's going to happen. This current warning shows a five foot water rise or five meter. I can't tell. God, I really hope we don't publish this episode and there's like a total...
disaster that would be uh we're not going to make light of it we get warnings once in a while just to give everybody a little perspective here i'm at david sacks house
I've taken over. As you can see, I got my Montclair hat on, Freeburg. I found Sax's robe. See this here? It was Sax's robe, but I got a red sharpie and I just crossed it out and I just put J-Cal on it. And then I went down and I was talking to Chef. Does Sax know that you're staying at his house? He knows I'm staying here, but... Does he though? He doesn't know that I found the actual caviar. Rain Man, David Saxon.
With us today, Chamath couldn't make it this week. Chamath had surgery and now he looks like Gavin. Okay, yes. And Sax is taking a day off. He's got the day off today. I think he's just winning too much with us. Two substitutes to jump in here for the team. Caps,
cackling you can hear the cackling Joe Lonsdale there's Joe Lonsdale take my mom Claire had off here and take out I am also winning too much but I'm happy to be here last minute as a sub for David Jake Jake how Joe Lonsdale people don't know is to the right of David Sachs he is a venture capitalist and he started a couple of companies you might have heard of them Palantir
I mean, what are the other greatest hits? Adapar? Adapar just crossed $7 trillion. I was reported on it this month. It's a good real company too. Yeah. The open gov sold this year. We saw it started a bunch of good. Yeah. Joe gets, he said you're a little bit lower profile than all these accomplishments. It's pretty incredible. Co-founded how many billion dollar companies have you co-founded now? I don't know, maybe six or so. Six or so. Also with us, Gavin Baker from Atreides. He,
He is a hedge fund manager. He does private, he does publics. One of the smartest guys I know. Great analyst. Welcome to the program, Gavin, friend of the pod. Thank you, J. Cal. Happy to be here. Great to see everybody. Yeah. We are experiencing a huge Trump bump. The election is over. The cabinet is being assembled and we're seeing Doge, the Department of Government Efficiency,
as well as maybe regulations being pulled down. And we'll get to our first topic about our new SEC chair. But just generally speaking, Gavin, as a market participant for a living, what's your take on what we've seen over the last three weeks since the election results came in? So if they execute unstated plans, and there are some of the world's greatest execution machines involved, um,
You know, Elon generally does what he says he is going to do. Like, this is going to be awesome for America, for markets, for the world. And the analogy I keep coming back to is Satya Nadella taking over as CEO of Microsoft. Microsoft was a monopoly, incredibly advantaged. It had just been horribly mismanaged for years. All he had to do to start winning was stop doing really, really dumb things. Yeah.
And that's an incredible place to be. You know, America, like we're the greatest country. You know, we've got, you know, oceans on two sides, peaceful neighbors, incredible natural resources, you know, completely, you know, can produce our own food and energy. Like in many ways, most privileged country on earth. But sometimes with great privilege comes great like stupidity. And California to me would be a leading example of that. Most in many ways, most privileged state in America and is printed away with bad policies. Yeah.
And I do think one thing that everyone of all political stripes agrees on is there are too many regulations that result in far too many administrators, far too much complexity and an inability to build things in America. So,
you know, it was used very effectively and as it should have been against the Harris administration that they'd approved $42 billion for rural broadband, hadn't built anything, had approved $40 billion for EV chargers, whatever it was, hadn't done anything. And it's not that they didn't want to, you know, dig trenches and do broadband. They didn't want to make EV chargers. Their own regulations prevented them. So I just think,
deregulation and simplifying regulations and the tax code.
is going to lead to an immense amount of growth, which is something that all Americans should be happy about. Joe, you want to maybe give us your take? I know, obviously, you're very vocal. You're obviously a conservative, run a think tank, and have strong feelings on all this. But there is consensus, I think, amongst all Americans that we don't like fraud, waste, abuse, and those items. Those seem to be consensus-building efficiency and paying lower taxes. All of that seems like something...
almost all Americans, most Americans can get behind. So I guess maybe a little bit of your take on what we've seen in the markets and the plan. And then also, are you going to be involved in this at all?
Well, listen, Jake, I think I do agree. I think almost all reasonable Americans can see that our growth is ridiculously constrained. And I think Jeff Bezos was saying yesterday, like we need a growth oriented mindset if we're going to get out of our debt problems, our deficit problems. So it's nice to see everyone kind of coming on the team and saying, yeah, we need to fix these things. I think what people don't understand is like just how broken the government is.
bureaucracy and regulations are. It's not like they're kind of sort of bad. It's almost like they're companies that went bankrupt. Think of the worst company you know in Silicon Valley that went bankrupt like 30 years ago.
And imagine if someone just like kept pumping money into that worst company, you know, over like 30 years to keep hiring people. So like Yahoo or AOL, like some legacy company. It was failing. It's like the worst department there. And then like the worst department gets the most money. So it's like, it's like,
It's like more, I guess you can use the word retarded now. It's more retarded than anything you've seen in a long time. And I think one of the important things is America used to have these really hard tests for 100 years. You know this? In 1883, we said, you know what? We shouldn't just hire our friends.
If someone's gonna run something in the government, let's have these tough tests, kind of like China did for thousands of years. And for a hundred years, we had really hard tests. When we went to the moon, when we fought the world wars, you know, we did the Manhattan Project, the people making those decisions in hiring people had to pass things that really only like five, 10% of people could pass who took them.
And then in the late 70s, we said, not only are these tests racist, so we can't test people anymore of any background, we also can't fire people anymore because we're going to give them tons of protections. So the last 40 years, it just got dumber. And then 10 years ago, you started doing all the virtue signaling and hiring based on your identity versus based on anything else. So it's gotten even worse. And so now it's so broken that, yes, we're letting tens of billions of dollars on fire. And so there's really two things here. One, you've got to take a chainsaw.
as Elon, like I said, you got to take a chance on just like cut a ton of broken stuff. But then day two is you got to say, how do we make this not stupid in the future? And there's things like, maybe you bring back tests, maybe you bring accountability thing. I, the thing I'm most passionate about is, you know, right now there's over a million rules of the federal level. It's stuff that everyone disagrees on. You can be the most left person trying to build like solar or wind or whatever. And you're like, what I have to do, what study over how many years, this makes no sense. So, so we got it. We got to,
We've got to take these regulations and not only cut them, but we've got to make a data-driven system that forces regulations to defend themselves. And that way, instead of having a cancer that just grows forever out of control, you could actually have a process that naturally trims things, naturally makes things fight for themselves. And that way, it doesn't get as dumb ever again. Why not just make them automatically sunsetting after five years if they're not renewed? Exactly. But make the process to renew them difficult and data-driven. Exactly. So they have to fight. Yeah.
Yeah, exactly. So if you fought for an allocation. The process of renewing them will take so much time that it will slow it down. I wonder where we got to the place, Friedberg, I will bring you in on this since really, I think it was maybe two or three years ago, you started to point out exactly the debt spiral we're going to get in. I want to give you your flowers here on the pod.
because from this pod and in your obsession, and you're harping on and on about this national debt problem, you saw it early, you talked about it constantly, you brought a lot of consensus on board, and now we're seeing it as
The issue of the transition is the debt. And we were sitting here for the past year or two saying, when are politicians going to even pay attention to this? And now they are paying attention to it. So first, here's your virtual flowers. Second, how are you feeling about the transition to debt?
Well, I mean, I think, first of all, there's like three layers of the problem, which I've been trying to harp on for almost four years. Number one is the inefficiency and lack of accountability, which Joe and Gavin are obviously talking about. And that leads to excessive spending. And that leads to the debt problem. And the debt problem creates this kind of arithmetic debt death spiral, which is something you don't want to find yourself in. So that's the inevitability that I've been kind of really worried about. And I think that, you know, look, there's
the first derivative and second derivative can kind of get addressed. And then hopefully, you don't get to the absolute point where you have this breaking point. I think right now, everyone's banking number one on can we deregulate in a way that can unlock growth. And by unlocking growth, right, the kind of arithmetic argument is grow GDP, because you're not going to be able to shrink debt super fast. In order to grow GDP, there needs to be some unleashing happening. And
And so if you can get GDP to grow four, 5%, and you can minimize the excess spending, meaning you can minimize the deficit, the federal deficit, and therefore minimize the increment in the debt level, the debt to GDP ratio becomes more manageable, because ultimately, you can only tax so much of GDP. So yeah, I feel like this is important in both senses. One is just cut the inefficient, wasteful spending, get rid of the regulations, and that'll unleash
The necessary growth. One of the proxies I look to, and I think that this is going to be kind of the critical motivating factor for the United States, whether it's this administration or the next or on a continuous basis, there's going to be this kind of moment where we're going to look across the water.
at what China has. And you can see what China's getting, what China is making, what China is doing. I've talked about this a lot as well. And I do think this is the most critical metric that no one talks about as much as I think we should, which is the increment in electricity production capacity in China compared to the United States. And so we are going from one terawatt to two terawatts. They're going from, I think, two to eight
over the same time period. And they're doing it at a price. Why is that so important for the people who are listening who think that you're saying this very esoteric? I'll let you answer that. Go ahead. Just unpack it for the audience. I mean, I obviously understand why this is important, but I want you to... The number one thing I'd say is it's usually correlated to how well the working class
is doing in your country to per capita GDP, to cost of goods. I mean, obviously I care about it because we want to scale AI for all the things we're doing and we want to be able to do it effectively. But if you just look over time, it's really clear the relationship between how well is your average working middle-class person doing and their quality of life, their cost of life and the cost of electricity and cost of power. And it's crazy. We're not just like ramping up and cutting things to do this. More electricity.
means more automation, means more AI, means more things are being done for every person that are being done in factories or being done by machines. And that unlocks a new kind of level of living. And that's been kind of a continuous process for humans. There's this guy that writes these books that Bill Gates always talks about, Vaclav Smir. Smir? What's his name? Bill.
smell that cough smell he's got all these books on the history of the relationship between energy and kind of prosperity there's definitely correlation there and there's definitely causation there gavin and there's even like really simple ones i don't know if you've ever seen uh lee kuan yu from you know the founder of singapore essentially talk about just how air conditioning changed the country's fate
It raises average IQ by two or three points. It really matters. But look, I think at the end of the day, my key point was we have to make sure that this administration, and Joe can hear me on this, and I know he believes this, but for me, it has to be such a priority that we accelerate a nuclear energy rollout in the United States because that's what China's doing. They have dozens of Gen 4 reactors that are going to get built out, each of which has a gigawatt of production capacity.
capacity. And they're doing it at a cost that we can't compete with today. But fundamentally, they can do it. In the US, we can't even do it. And regulations, it goes back to Joe. Yeah. And so the regulatory structure prohibits our ability to actually expand energy capacity or electricity production capacity, which is a critical difference. And that ultimately leads to a situation where in 10 years, we're going to be looking across the water at
you know, a competitive country that has 3x, 4x the electricity production capacity of our country. And everything is cheaper. Everything is faster. It gives them superiority in a lot of functions that we can't
This is a national security thing, too, because we need manufacturing here to be affordable and competitive in order for national security. You know, David, when you when you texted me last minute to join this, I was actually in a meeting with our friend from Founders Fund who's building nuclear fuel again for the first time in the US. That's actually gone away, too. And so that needs to be approved. But, you know, I know Chris Wright, he's a nominee for the new
you know energy a secretary of energy and he you know he's super pro-liberty guy but super pro cheap cheap energy guy he's pro-nuclear so i think we have some really great people who care about this we're going to be fighting hard for it gavin what's your read on it yeah what's your read on energy and the blockers yeah yeah i mean more nuclear more better like i mean i agree with everything joe said and the only thing i'll just add is it is the most environmentally friendly kind of
energy source it's even more like i i think it is highly likely that in my lifetime the world just runs on solar like if you just you know we all know compound interest is the greatest force on earth but if you just look at the rate at which photovoltaic cell efficiency is compounding battery efficiency is compounding and people make these balance of system arguments
But it will never be as cheap as nuclear, but it will likely approach coal. And I think a lot of the world will run on solar, but that's going to take 50 years. Nuclear is arguably just as environmentally friendly done right and carefully. And it is here now. And so I just, yeah, I mean, that's... Yeah. It is unbelievable to watch, not exactly Moore's law, but this precipitous drop in...
the cost of just solar panels. - Solar's very impressive, but in some ways to me, it's a little dystopian to think about all these forests just covered with this stuff. I mean, I think it's great. - And it's rate limiting. It's rate limiting. You have to have many, many acres rolled out. And with nuclear, you can have a building that can power the equivalent of many acres. - The answer's both. - The answer's both, but it is like Elon has tweeted many times about the tiny fraction.
of, you know, deserted desert areas of America that need to be covered with panels. And then you put in batteries. There's still a space limiting, like, let's just fast forward 100 years on planet Earth. And if you look at the past 100 years and the 100 years before that, like energy demand, even on a per capita basis, has this nonlinear kind of scaling problem.
And that means that land consumption will scale non-linearly. Now we have it. If we're going to say a hundred years though, I mean, sorry to interrupt, if we're going to say a hundred years, technology changes, it's very clear you could probably do it from space if you really wanted to. I mean, this sounds crazy, but you probably could have like tons of these in space. I mean, a hundred years is far. I mean, we have enough uranium in just the crust of the, you know, like Northern Hemisphere to power everything we can imagine. We are on the verge of unlimited energy for all time.
Just to wrap this up and move us on. If we can get out of our own way. If we can get out of our own way with a bunch of midwits who have put so much regulation in place and who are working from home for four f***
hours a week, if we can just get them out of the way, then maybe we could approve some nuclear reactors and a little more solar batteries. Did you just call government workers midwits? No, just the ones who are blocking shit. If you're not blocking shit and you're working 50 hours a week, God bless. A lot of people are working hard in the government. That's exactly my point. But there's some number of them who are just obviously do not see the forest through the trees. By the way, on that point, Jake, how it is interesting, Texas is the number one solar producer.
in the country and it's not because everybody there is more environmentally conscious no we're not that level here it's just it's easy to build stuff in texas you have to build solar power plants this is i mean for the libs in cities who are so pro-solar and anti-natural gas or whatever yeah look at texas they're just built as much as you want and where joe and i live in austin
Home prices have gone down two years in a row. Rent has gone down two years in a row. They are building like lunatics because you don't need to beg and bribe people to build stuff. Joe, maybe some thoughts on what we've seen in regulation in Austin. Austin City Council is not perfect. Austin, they call it the blueberry and the tomato soup. So there may be a tiny bit of begging going on, but despite that, you're able to build there and everywhere else around it, you're building like mad. So it works.
It works. There's plenty of supply. I agree. Speaking of regulation, Gary Gensler is out. Paul Atkins is in. And Bitcoin just cracked 100. This is all obviously related. Atkins was previously SE commissioner under Bush II in the early 2000s. In the 90s, he worked for both Bush I and Clinton at the SEC. According to the New York Times, Atkins is admired among DC legal circles and regulators. He's pro-crypto, and he's been helping
drafts and best practices for the crypto trading platforms. As you know, Gary Gensler's approach to crypto was
there's a rule set, follow the rule set. We're not here to change the rules. We're here to enforce them. Good luck. And in some cases, I think maybe he was right with ICOs and a bunch of scams, but he also gave good actors no path to go forward. Anybody have strong feelings on this? I love Paul J. Kelly. I think he's going to, he's a fair guy. Yeah, I've been to several times at conferences and groups and he's a really smart guy. He cares
cares about the rules, cares about helping innovators. I mean, the thing that really pissed everyone off with Gary, I mean, I love you probably seen like, I think, I think, I think both Coinbase with Brian and the Winklevoss twins that put something out, they won't even hire anyone who worked with Gary on any of this stuff they were doing. And the reason they're that angry at them is they were purposely not defining the rules in certain cases and then going after people after not having defined it in order to kind of like
play a gotcha game. It was very dishonorable. And Paul sees all that and there's no way he's going to allow that. Gavin, any thoughts here on how this might change regulations in our business? Also the fund business, Joe is a venture capitalist, 8VC. You're in public markets and funds. I do pre-seed. So yeah, what do you think in terms of funds and regulations there and then crypto and, you know, the SEC may be becoming innovative as opposed to punitive and
you know, what's the word for Freedberg? What's the word I'm looking for here? Adversarial? Well, they are a regulator. They are a regulator, but they don't also seem, they seem to have gone beyond just regulating. They seem to have been aggressively adversarial. I mean, they're a regulatory enforcement agency. That's their job. So I don't know, like,
I mean, but not giving a path or not even meeting with people. I think that was the thing that I felt was kind of weird. Well, they'd meet with you if you were a big donor to the left. They wouldn't meet with you otherwise. That was part of it too. That was sketchy. That was why SBF got tons of meetings, but Brian got none, right? I mean, it's nonsense like that. I do think cryptocurrencies at some level fundamentally reduce the power of nation states. And that is something that is oft professed by the true believers, but it is true. And so if you...
are on the left and you are a devout believer in the power of the state to do good things, I get why you would not like cryptocurrencies. At the same time, we're very early in crypto.
I do think I read with interest all of the posts that David Marcus and his peers at Libra made about what happened to them. Libra was a Facebook project to embrace cryptocurrency at a very intrinsic level onto the sort of identity level of every one of their billions of users. And I think you can argue it would have been really, really good for not just America, but the entire world. You know, there are a lot of immigrants in America and
in America who send remissions back to their home countries at extremely high predatory rates. Yeah. Predatory rates. It would have made that free. And that would have been amazing for a lot of really hardworking people all over the world. It would have, you know, Visa and MasterCard, they do charge big fees. I mean, Visa and MasterCard do not charge big fees, but the credit card complex and aggregate is,
is a, is a reasonably big fee. I mean, everybody, Oh, it's just, you know, two, two and a half percent to make it perfect and safe. I think Facebook had a sound argument that they could have done that cheaper. That would have been an efficiency game for America. And it really did bum me out, you know, to read some of the letters that they sent the way they killed Libra. If anyone doesn't know, maybe we could, you could pull up David Marcus's post and
they just, all these politicians sent letters to participants in financial markets saying, "We don't know if they are doing anything wrong, but we think they probably are.
And we're going to look at this very closely. And we want to discourage you from participating. It was worse than that. It was like a mafia letter. It was like, if you are to support this and help with this, we are going to look into everything else you are doing. And we may then find some issues. It was like a mafia threat. We can't stop you legally, but watch out.
Like it was really sketchy. It was Sherrod Brown, who now is out of office, who led this, the senator from Ohio. But it was really bad. It was really bad what they were doing. It was really bad. I found it upsetting as an American. And it's you kind of hinted at this, Gavin. The fear of governments is that they will lose control of money supply and monetary policy. Maybe unpack that a bit. And then Freeberg, we'll go to you on the same sort of thread.
Yeah, I mean, look, it's a it is a rational fear. I mean, controlling monetary supply, like at some level, you know, the greatest powers we give the state are a monopoly on violence to keep us safe. And, you know, control over the money supply has, you know, a means of exchange, a unit of account, you know.
And those are great powers, particularly if you're American, you're a reserve currency. The only thing I would just say to balance this out, and I do think people are very positive on Paul Atkins. I've never met him. But the reaction from people who know him like Joe and who I respect has been very positive. It is important to remember, we have the best capital markets in the world. The US equity and fixed income markets are the most trusted places on earth. And we can always make them better, but just
It is very, you know, you want to be very vigilant about keeping them fair and keeping out things like inside information, which makes people feel comfortable doing business here. You know, making, you know, having investors have confidence in a company's financial statements. And those financial markets are one reason America is such a great country. And Gavin, to put this in context, this was during a time period, this David Marcus Libra process, when they felt...
certain people in government, and I'm not saying I endorse this, but this is their position. Zuckerberg had too much power. Zuckerberg was censoring people. The right felt they were being censored. The left felt that Cambridge Analytica and people were using targeting universally. The general vibe, and even J.D. Vance is kind of
was in on this as well, was too much power, specifically at Meta, too much influence. Now they've got this many people, this penetration, and the algorithm, plus we're going to give them money.
and they're going to have power over people's wallet and then what does the government have they can't censor people they can't control the message and they can't control the purse strings that is the time period we're talking about here i don't know i i understand 100 why they did it yeah i just think as an american at a minimum the way that they did it yeah was to you know use one of joe's phrases dishonorable you know if you if you want to say that we're going to kill this
Then just like, let's have a debate as a nation. Absolutely. Don't do it in the shadows. Yes. Rule of law. Rule of law is also another reason America is a great country. Yes. Freiburg, your thoughts on Dave Marcus's comments and this SEC pick and just generally a more less regulation kind of situation. I think the SEC is like one of the most important agencies we have.
And I think they're one of the best federal agencies. So I've worked with them and I've worked with many other agencies and there's all these issues with the SEC, but they play a very important job. And if you've worked in
than foreign markets and you've dealt with foreign securities regulators, you're going to be like, thank God for the SEC. You can't wait to go back. This whole crypto thing, there's a distinction, I think, between Bitcoin and cryptocurrencies as speculative assets, speculative trading. What do you see those differences as? Well, I definitely concur with Gavin. I think Bitcoin fundamentally is meant to be, supposed to be, ultimately will become a real threat to the US dollar.
And it's kind of ironic that Trump had this declaration this week, that he's going to put 100% tariff on all these BRICS nations that try to participate in an alternative currency to the US dollar, the greatest currency on earth, when he literally turns around and then says, we're going to support Bitcoin. It felt like the biggest irony of the week to me, because I do think Bitcoin is the big threat to the US dollar. And I do think
that at some point, whether it's this administration or the next, they're going to wake up to that fact. And maybe the Bitcoin does, you know, the network state concept does emerge. And that's where we end up. But I do think we want to have and are going to have a strong federal government in the United States for quite some time. That's going to play an important role in everyone's lives here. And I don't know if you can really just say, let the dollar, you know, be supplanted by Bitcoin. Bitcoin seems to be a more of a safe haven asset. And that seems to be the trade that it's
store of value and alternative. It's just going to take over gold. What do you think, Joe? You think the state has reasonable concerns about crypto competing with it? And then maybe specifically when you saw Trump talking about, hey, congratulations on your Bitcoin. I did this for you on 100K and taking credit for it at the same, which he should take credit for it. He did it. He did that last $40,000 per coin. And then you see him talking about the BRICS
And then we have the US currency. So which is a bigger threat to American exceptionalism and supremacy on planet Earth, Bitcoin or BRICS? So one represents a move towards liberty and one represents a move towards authoritarianism. If BRICS were to become dominant, if China and Russia were able to control global currency together and other players, that is terrible. It's bad for the US for so many reasons, bad for US consumer for so many reasons. He's right to fight it. At the same time, how
Having, you know, to channel biology, having this, like, pro-liberty network state, like, forces in that direction. Like, for example, I think rather than just, you know, Hong Kong and Singapore, Hong Kong has been lost, we should have, like, more Hong Kong and Singapore in the West to compete with the US. That'd be good for all of us who are on the pro-freedom side of the US and make the US wealthier, show examples of new experiments to create great wealth. And then that's kind of the side of Bitcoin is you want more experiments and competition from the liberty distributed side. You don't want competition from the authoritarian side. So, to me, it was very consistent.
Well, I would just say Texas is the Singapore of America, and it is putting pressure on the rest of America. And I don't say that just because I grew up in Texas. It's just a fact. I do think long-term Bitcoin, I do not think the BRICS will ever be able to replace the dollar. Just rule of law, even if it has occasionally been corrupted in America, is very, very powerful. Yes. As opposed to rule by law. But I do think Bitcoin...
will at some point be a serious threat to the US dollar. And that just is what it is.
And we'll see how different administrations react. It's a check on the most aggressive mistakes. First of all, if the debt doesn't get under control, if our deficit is ridiculous, Bitcoin is a wonderful check on that. You actually want healthy competition from something good because you want to check the excesses and the craziness. You need someone coming from the outside to say, no, don't do that. Let's just say at some point an AOC-like person gets in charge. It could happen in the next 20 years. You need some kind of check on the dollar. And it's much better to come from the Liberty side than from the other side.
I agree with all that. I will just say on AOC, I thought it was very interesting. I think if you're a Democrat, I think you're probably largely heartened by the kind of intellectual leaders of that party.
their reaction to losing, you know, it's focused around, Hey, we do need to do regulate. It is too hard to build. Josh Shapiro has been tweeting every three days about how he's making it easier, you know, to do business in Pennsylvania. It used to take 20 days to become, get a hairdresser license. Now it takes an hour. All that is good. But I actually thought AOC, who is a very talented politician. She's an extraordinary communicator. She was an extraordinary communicator. Her reaction was like, she posted this on Instagram. Um,
If you voted for Trump, I want to hear why. I want to hear the things you listened to that convinced you. Like, I don't say this out of anything other than genuine curiosity. Basically, clearly, I am missing something and I, you know, I want to listen. And I just thought that was a very interesting reaction. That is the proper reaction. Yeah, absolutely. Yeah. I want to point out one thing I did. I was doing some research before the show and I found this SEC speech.
This is really fascinating. This is from 2007 from Paul. And he was kind of giving his State of the Union here, and he's talking about doing some self-reflection. And he's talking about accreditation rules in 2007 before the great financial crisis. The concept of economic risk and return also affect a different proposal of the commission, the SEC.
relating to private investment funds, specifically part of the commission's proposal would add an additional requirement for any natural accredited person to have at least 2.5 million in investments before he or she could invest in a private investment fund like a hedge fund or private equity fund other than a venture capital fund. The underlying premise is
for the commission's proposal is that these types of investments are too risky for individuals other than the very rich. Therefore, we would have to presume that the non-rich are either unsophisticated or lack access to sophistication, and it is simply not tolerable to have these types of people at risk of losing their money on a hedge fund. Assuming that these premises are true, however, what evidence does the commission have to support the conclusion that private investment funds are the most risky? What makes a hedge fund or a private equity fund more risky than a venture capital fund?
Great question. And how does the risk profile of a pulled investment compare with the risks of investing in securities of a single issuer for which this new 2.5 million standard is? This is where it gets super interesting. Many public comment letters express indignation at the commission's proposal. One commentator wrote, stay out of my wallet. Stop trying to protect me from myself. Stop presuming.
To know more than I do about my own life, risk tolerance and financial sophistication. The Commission's parole may very well prevent the non rich from losing their money in private investment funds, but it also certainly will prevent the non rich from participating in any upside profits and gains on these funds. Does this mean the rich get richer while the non rich should be content to just hold their place on the economic ladder? This to me
when I saw this, I was like, you know what, I am feeling absolutely fantastic about Trump. If he stops these wars, or stops one out of two and keeps us out of you know, participating even though we're not on the ground with the other any new ones, and he removes regulations, and we have people in power who understand that moving up the socio economic ladder is as important as protecting the downside risk, especially when we see wealth
polarization, this is a great pick. Now, the other picks, there's some whack pack picks in there. I'll be totally honest. I don't know what the strategy is, Joe. I'll ask you that in a minute. But what do we think, Gavin, of this sort of approach here, which is really thinking thoughtfully about what is sophisticated and what are we doing here? What is the outcome we're looking for? Yeah, no, I think it's great. And you could just
I mean, the reality is a hedge fund that runs with a lot of leverage probably is more risky. I don't know that it's more risky than a single security, but like at the end of the day, since he wrote that letter, it was an incredible 15 year run for private equity. And, you know, now all the big private equity firms are making a huge effort now when probably the business is more mature and maybe the return opportunities aren't what they were to appeal to Main Street America.
Like it would have been cool if, you know, Blackstone or KKR or whoever in the
07, 08, 09, 2010, you know, could have had their fund up on like the Fidelity marketplace for subscription. That probably would have been good for America. So I think his comments are well taken. Imagine if Elon could raise for SpaceX, like, you know, from regular Americans, I'm sure he would have loved to do that if it wasn't crazy risky with the SEC, right? So there's all these people, they're blocking us from letting the average person be part of it. And it does keep them from climbing the wealth ladder. I think it's crazy.
Yeah, a freeberg. Any thoughts here? I mean, this has been my pet peeve for a long time is letting people do what they want with their money. If you don't allow people to take risk with their money and move up from poor to middle class from middle class to upper middle class, and maybe eventually becoming affluent, Jason, there's a lot of places people can invest their money, they can buy public stocks, there's $20 trillion of public stocks, they can buy, I don't think that you're prohibiting people from transitioning their wealth, like bands by not being able to buy private stocks. In fact,
I think it's more likely than not that people are going to go market bullshit securities in private markets and rip poor people off even worse. And that's why there are these regulatory kind of barriers. And I don't think that it's necessary. Look, everyone says, let's make it everything free and everything libertarian seems like a good idea. And so someone gets punched in the face, gets ripped off, someone dies from a drug, you know, that's not legal.
properly tested. And then we're all like, where are the regulators? Where are the agencies to protect the individuals? And I think that's the role that these agencies are kind of providing. And that's the reason these rules are in place. I don't think that this is like one of these things where, oh, liberty is being denied. I think it's, you know, there's a careful line to walk. I'm generally pretty centrist in most things. So I agree with what a lot of David said.
And I do think if you were to allow ordinary Americans to buy private companies that are held to a lower standard of disclosure and reporting than public companies, like something would have to change. Like, you know, just, hey, if a private company wants to
Public companies are held to certain standards for a reason. Tweak the numbers and have non-GAAP financials. And there is a lot of fraud in venture. There are unethical people. There are
And smart, diligent people can't even find it all. You know, that's, it's like the most diligent people are still getting ripped off. Yeah. I mean, look at FTX. I mean, I mean, FTX ripped off some very, very intelligent friends of ours. Not that anyone did any diligence at FTX. Yeah. But,
Which is an important part of this. But I mean, if you had a sophistication, I mean, there's such an easy solution to this. You just do a sophistication test. People take a five hour course and they answer 50 questions. The end, like a driver's license. Well, I do think it is a little, that's why I talked about private equity. These are extremely sophisticated institutions who are always investing alongside their clients. Yep. And they're buying established businesses. They're putting leverage on them, but they're,
Like, I think private equity is kind of a middle ground and on a pooled basis. I think you could argue and, you know, maybe those funds would need to change their reporting and their disclosures to deal with kind of the average American. But by that, I mean, strengthen it. But I think private equity is,
His comments were well taken. That's what I would say. Joe, what are your thoughts? Going around the horn here. The elephant in the room that's really funny here is that you have the people on the left saying that only people with lots of money are smart enough to be allowed to do this, which I think is just a very funny position to take. It's like, you have to have a few million dollars to be sophisticated enough to be allowed
do this. I like your idea, J. Cal of a test. Like, like there should be, there should be some other way of accessing this if you really want to. I agree. I agree. Listen, I don't want to live in a world where we're all constantly being spammed to the average person by like stupid financials stuff. That's just like, we would be scammed all the time. There probably should be some rules. Like I agree. I'm not like a total libertarian on this. I think it'd be really annoying, but yeah, but just to totally block people from participating to me, that sounds crazy. All right. Like, I mean, that's finance college professor.
you know, might, unless they had another job, might not, you know, be able to do this. They would have to make $250,000. Let's talk about a very important public market
set of transactions. Gavin, I'd like your point of view on Michael Saylor's convertible note issuances being used to buy Bitcoin. Here we go. Going over the top. Which this morning, Bloomberg reported is the hottest trade in hedge funds right now. Nick, if you could pull up the article. And then J. Cal, I know you've been an outspoken opinion setter on Michael Saylor's promotion of his securities actions. We'd love your point of view. Gavin?
At some point, this does get too big. For a while, when it was smaller, you could support the debt. Sorry, could you explain it? Could you explain it to everyone, Kevin? Yeah. So what he is doing is issuing debt and buying Bitcoin with the premise that Bitcoin is always going to go up. And he has made eloquent arguments why that is the case. No trees grow to the sky. And I think the interest expense on his convertible notes is...
Is 75 million off the top of my head. And by the way, I am, I could care less about micro strategy. Like I'm not close to it. I'm not involved. Yeah. I don't know any hedge funds who own it. No horse in the race. Yeah. Yeah. I, I think a lot of hedge funds are short micro strategy, but I have no horse in the race, but the, but he's the underlying business that, you know, pays the interest expense on the debt and,
only does $400 million a year in revenue and it's high gross margin revenue. But I just, unless debt investors have absolute confidence in Bitcoin as collateral, and I don't think that's where fixed income markets are yet. It will get to a point where it is too big for the size of his company. And then yeah, maybe he can over collateralize it and have $10 in Bitcoin for every dollar of debt.
But then like the, the magic money creation machine that, you know, I see discussed on X breaks down because that's like, you know, that's, that's very, very different than what is being discussed today.
Joe, do you have a point of view? Because Joe's got to run, by the way. So Joe, do you want to close this out with a point of view? I'll see defense people down here in LA. Listen, I am very bullish Bitcoin. I love all the energy of our society around it. I agree with what you said, Dave, that there needs to be some barriers for the public taking crazy risks. And I think the risks around how he's accessing this is actually very unusual and does scare me a bit. And people need to do their research and they shouldn't just throw money without studying it. It does scare me a little bit how blithely people are throwing money at this without knowing
the kind of leverage he's taking. Yeah. Joe, anything else you want to share that you're up to that you're excited about before you head out? Well, this weekend is the annual defense forum at the Reagan Library. I'm on the board. It's the biggest defensive end of the year. Everyone's coming in. I guess I'm really excited that America has woken up and assuming we can bring back more advanced manufacturing here. I think there's enough top companies now with Anduril
with Saronic, we're going to be building thousands of these vessels for the Navy with AI. With EPRIS, we're like turning things off, you know, 10 miles away, whatever, fairly far away with microwave radiation. There's some really cool technology coming that actually is going to make us be able to deter our enemies. So if you asked me six, seven years ago, I was panicked. We were going to like get way behind China. I'm feeling really good about it now. I think, and I think, I think, you know, just the Pete Hegseth pick,
you know, is actually someone I'm quite bullish on from everything I'm hearing. So I think things are going the right direction. Is there a wholesale upgrade happening in defense in the United States? Are all systems and all strategies being rethought right now using technology and innovation and kind of a performance-based product mindset?
leading kind of a reinvention of everything? Is that what's going to happen in the next four years? Warfare has fundamentally totally shifted. We're seeing some of this in Ukraine. There's all sorts of new ways you want to swarm things on the land, swarm things in the water, swarm things in the air. How do they coordinate and how do they work together? How do you manufacture enough of these things and how do you use electronic warfare in new ways that's basically created by this? And so it's just a whole new way of doing things. And we are going that direction. Too much of the money, David, like 95% of the money is still going towards like
frankly, wasteful legacy, mostly things we don't need. Cost plus maintenance and coaching systems. But enough is shifting and there's enough good people fighting. And as long as we keep just allowing open competition, allow it to say, okay, which is better and just let the best things win. As long as we keep doing that, I think it's going the right way. I'm feeling very good about it. Is the Chinese position shift
in their technology strategy and their system strategy going to motivate a shift here, do you think? Is there a shift underway? It already has. I mean, it definitely already has. So we don't need big aircraft carriers. We don't need F-35s. We need drones. We need lasers. We need weapons. I think there's a role for carriers and force projection. I don't think we need like incrementally a ton more of them. I'm not...
I'm not like this crazy radical where you get rid of all this, but yeah, on the margin, I'd much rather have 10,000 more smart drones above and below the water than like an incremental carrier, right? So on the margin, there's all these things that are better uses of money, and I think we're pushing that way. And is there a huge tidal wave of venture money? I was at a dinner last night where there was this conversation about defense tech used to be off limits and a lot of LPAs, so you can't invest in defense companies.
that's now changed or is changing and everyone's kind of coming up with their own defense tech strategy. Do you think, I mean, you were obviously early in this, Gavin, I don't know if you're an investor in this space.
but are you guys seeing a big shift? Yeah. I, I obviously, you know, listen, there's only been nine unicorns, I think still at this point. And I started three of them and invested three of them the first round. So I'm obviously pretty involved in the space. And I think it helps me if there's more money for my companies, which is really great. Right. I think there's probably the right answer for the U S it's not going to be like a thousand businesses or a hundred businesses. It's going to be, it's going to be like seven to 10 new primes. One of them's obviously under all, I think one is probably Saronic and Everest, but we'll see. But like,
There's going to be seven to 10 new primes and that's what it's going to be. So there's going to be a lot of zeros and a lot of bad investments, but yes, these seven to 10 new primes are going to be huge. And if you can get access to them, you're going to do really well.
Gavin, how do you look at that market? Do you agree? I agree with everything Joe said. The only thing I would just add on China, what we are doing by restricting their access to advanced compute and advanced networking, if you have read or watched the three-body problem, America is unfolding a so-fond over China. Yeah, that's a great way to say it.
i have been really impressed with um some of the chinese models that have come out and i think the risk to this strategy is necessity is the mother of invention and despite this handicap they're managing to stay just behind the leading edge of america which is amazing but you know nvidia's blackwell chip comes out next year you're gonna have new chips from amd new asics from broadcom
And I think at that point, it is not going to be possible for them to keep up anymore. So that's actually positive regulation and great, in your mind, foreign policy. It is very aggressive foreign policy. Yeah.
Clearly. You know, that could have lots of unforeseen consequences. Yeah. What do you think about the rare earth trade restrictions coming to us? And is that going to actually affect this? We have lots of rare earth here in America. We have everything in America.
Like we, you know, and I think there's a project underway to restart rare earth production. If there were ever to be a conflict, all this stuff would go away. It's a cost and it's allowing us to do the refining here. So refining some of this stuff, like we desperately need gallium, gallium nitride for things I'm doing right with, with like shooting the microwave radiation. The problem is refining is really messy.
If you let it happen in the US, it will still be messy, but it'll be cleaner. But we're not letting it happen. There's things like this. So we're back to regulation. And obviously, the cost here is different. We have a different cost structure. Joe, you got to go meet 20 senators. So thank you. Yeah. We appreciate it. Thank you, guys. This was fun. See you soon. Good times. J. Cal, do you want to talk about AI with Gavin and XAI? Yeah, I think that would be like a great next place to go would be to talk about the supercomputer being built by a friend of the pod, Elon.
He's now got the world's largest supercomputer, and he's going to 10X it, according to reports. Yeah. And I would just say this is, I think, a very important moment for AI, you know, for this entire AI trade in public and private markets. You know, everybody, I'm sure, who watches your podcast is very aware of scaling loss. And we have not had a scaling loss for training, where if you 10X the amount of compute used to train a model, you significantly improve the intelligence and capability of that model.
And often they're these kind of emergent properties that emerge alongside that higher IQ. No one thought it was possible to make more than 25,000, maybe 30,000, 32,000, pick a number, NVIDIA hoppers coherent. And what coherent means is in a training cluster that each GPU, to kind of simplify it, knows what every other GPU is thinking.
So every GPU in that 30,000 cluster knows what the other 29,999 are thinking. And you need a lot of networking to make that happen. Enabled by InfiniBand, right? InfiniBand, and I think even more importantly, NVLink. Although a lot of... Ethernet is...
Never bet against the internet, never bet against ethernet. Like if you read the Lama 3.1 technical paper, you got a lot of people excited about skinny link ethernet. Just to slow down for the audience here, Gavin, maybe explain why transporting information between the GPUs is important. And we're in the weeds here a little bit. Everybody's heard of ethernet, but some of the other protocols and ways of moving stuff around. Yeah.
large amounts of data. That's what these H200s, H800s do particularly well. They'll move a couple of terabytes a second from one processor to the next processor. Yeah. So, you know, picture a server in the case of a GPU. It looks like maybe three pizza boxes stacked on top of each other, and it has eight GPUs together. And those eight GPUs are connected today with something called
in V-Link, probably you can think of the speed of communication. On chip is the fastest. Chip to memory, next fastest. Chip to chip within a server, next fastest. And so you take those units of servers, which are connected, the GPUs are connected on the server with a technology called NVSwitch, and you stitch them together with either InfiniBand or
Ethernet into a giant cluster. And each GPU has to be connected to every other GPU and know what they're thinking. They need to be coherent. They need to kind of share memory. For the compute to work, the GPUs need to work together for AI. And no one thought it was possible to connect more than 30,000 of these with today's technology. From public reports, Elon, as he so often does,
focused deeply on this, thought about it from first principles, how long it should take, the way it should be done. And he came up with a very, very different way of designing a data center. And he was able to make over 100,000 GPUs coherent. No one thought it was possible. If I was a last minute ad for this,
But I would have said there were all these articles that were being published in the summer saying that no one believed he was going to be able to do it. It was hype. It was, you know, ridiculousness. And that was coming. The reason the reporters felt comfortable writing those silly stories is because engineers at Meta and Google and other firms were saying, we can't do it. There's no way he can do it. He did it.
And I think the world really only believed it when, you know, Jensen did that podcast, I think with, wasn't it with Gerstner? It might've been with Gerstner. Yeah, I think it was with Gerstner and said, what Elon did was superhuman. No one else could have done it. And I actually think you can argue that,
That Elon doing that in a lot of ways kind of saved Nvidia from a tough six month period when Blackwell was delayed because everyone who was waiting for Blackwell and thought it was impossible to make a hundred thousand hoppers coherent rushed out and bought a lot of hoppers to try and do it themselves. Now we will see if someone else is able to do it. It was really, really hard. No one else thought it was possible. And, and,
As a result of that, Grok 3 is in trading now on this giant Colossus supercomputer, the biggest in the world, 100,000 GPUs. In Memphis. In Memphis. At the old Electrolux factory. And they're putting a lot of energy in there, a lot of natural gas, a lot of megawatts going in. Yeah, a dingy Electrolux factory. Yeah. With a lot of megapacks around it. And the city of Memphis is all in on supporting this. Yeah. Which is obviously smart for them.
But you have not had a real test of scaling loss for training, arguably since GPT-4. And this will be the first test. And if scaling loss for training holds, Grok 3 should be a significant advance in the state of the art. That is an immensely, you know, from like a Bayesian way to look at the world, that is like an immensely important data point. But if that card doesn't work, and I think it is going to work, I think Grok 3 is going to be really good.
i should note that i am with consumers yeah you're you're involved in a foreign got it yeah they've raised a tremendous amount of capital a lot of it from the middle east and they're supposedly going to build colossus to a million gpus is this data goal 10 times bigger than it is currently there's been some debate back and forth freeburg about hey
Are we hitting a wall here? Maybe you could explain the wall, either of you, to the audience. David? Well, I'll let Gavin speak to the wall. I mean, Gavin, I think one of the questions also is, you know, do we see an evolution if the kind of increment in performance relative to the investment in net kind of training, compute resources declines?
do we start to see a shift in how the architecture of the systems are run? Meaning like, do we start to build models of models and that starts to resolve a higher level architecture that unlocks new performative capabilities? So I would just say we're already building models of models, you know, almost every application startup I'm aware of is chaining models. You know, you start with the cheap model, you check the cheap models work with a more expensive model, you know, lots of very clever things are being done. You know, every, every,
Every AI application company has what's called a router, so they can swap out the underlying model if another one is better for the task at hand. As far as what the wall is, there's been a big debate that we were hitting a wall on these scaling laws, and the scaling laws were breaking down. And I just thought that was deeply silly because no one had built a cluster bigger than 32,000 H100s.
And nobody knew. It was a ridiculous debate. And there were really smart people on both sides, but there's no new data. Grok 3 is the first new data point to support whether or not scaling laws are breaking or holding because no one else thought you could make 100,000 hoppers coherent. And I think based on public reports, they're going to 200,000 hoppers. And then the next tick is a million.
It was reported they're going to be first in line for Blackwell. But Grok's three is a big card and will resolve this question of whether or not we're hitting a wall. The other question you raised
David, it's very interesting. And by the way, we should note there is now a new axis of scaling. Some people call it test time compute. Some people call it inference scaling. And basically the way this works, you just think of these models as human. The more you speak to one of these models, the way you'd speak to your 17-year-old going off to take the SAT, the better it will do for you. As a human, if I ask you, David, what's two plus two? Four flashes in your mind right away.
if I ask you to unify a grand unified theory of physics that accounts for both quantum mechanics and relativistic physics, you will think for a lot longer. 147. Yeah, nobody knows. We have been giving these models the same amount of time to think no matter how complicated the question was. What we've now learned is if you let them think for longer about more complex questions,
test time compute, you can dramatically improve their IQ. So we're just at the beginning of this new scaling law. But I think the question you raise on ROI is very good. And I'm happy to address it. And there's a context window shift underway as well, which also creates a new kind of scaling access, arguably, in terms of the potential set of applications. So networks of models, think time, context window, there are multiple dimensions upon which these
these tools ultimately kind of resolve to better performance. Oh, yeah. Even if scaling laws for training break, we have another decade of innovation ahead of us. Exactly. And as my understanding from speaking to folks, I'm certainly not as deep and well-versed as you, but there's a lot of effort and research going on in re-engineering various parts of the stack to reduce energy, to reduce every resource that effectively drives model performance,
to basically re-engineer architecture. It was all like very brute force for a period of time. And it was like push, push, push. But now as we go back and we start to re-engineer and architect things in perhaps a more designed way, we get better performance. And there's a lot of work to do there still. Absolutely. This is one of the great things about capitalism and a functioning capital market is you've got people working just on the context window. For people who don't know what that is, is that's the number of tokens. A token is essentially a word. You can think of it, a piece of information.
the number of tokens you can put into a conversation with a large language model. Some people have really large context windows, some people have smaller ones, but you can basically put an entire book in the context window and start asking questions against the model. And the speed of those is critically important as well, because if you put the book in there and it takes you 10 minutes to get an answer, that's not functional, right? Gavin, are you an investor in OpenAI?
Oh, absolutely not. Yeah. Can you kind of theorize on what the build out that's being done with Colossus does to the advantage that OpenAI has today? How long till we kind of catch up there with XAI and how much is going to be disrupted and how quickly here? Well, if scaling laws hold, the best information I have is the largest cluster Microsoft has after panicking is still smaller than XAI's cluster in Memphis.
If you didn't believe it was possible, you weren't even working on it. Grok3 should take the lead if scaling laws hold in January or February. I do think a lot of talent has left OpenAI. I thought it was a really shocking statement from Mira Murady that she resigned during a fundraise. That's the only way she can express disapproval of what is going on there and still probably get her money. So I think...
I think there's a lot of reasons if scaling loss holds to be optimistic about Croc 3. But I think, and then by the way, on the power question, and they are, you know, 23 and 24, it was just a panic to get GPUs and get them plugged in.
Now we're trying to make them efficient and thoughtful. And to your point, re-architecting them. And the H200s now are 50% less power and either 50% more or twice as much compute, depending on the task. They have a little more compute and a lot more memory, which really matters. So per kind of unitive effect of compute, they're a lot more power efficient.
Two or three times, you think? No, the H200s, probably not 2X, but a good increment. And the H100 was a great chip. So 50%, yeah. Yeah, Blackwell's just around the corner, and that's an entirely new architecture with an entirely new set of networking technologies. What would consumers, if we had to sort of speculate here, how would consumers' experiences change
in using forward-facing language models? And then maybe what are developers going to see on the back end, you know, in terms of what they're going to be able to build? If this pans out, you know, in the next short term, two years. Right now you have like a friend in your pocket who has an IQ, right?
of 115, 110 maybe, but has all of the world's knowledge accessible to it. And that's what makes it amazing. I think this will be like, you have a friend in your pocket, but, and they sometimes make things up again. They're very human. And a lot of humans, when they don't know the answer, they disassemble these AIs do it too. So
You will have a friend in your pocket with an IQ of maybe 130 that knows everything, has more up-to-date knowledge of the world, and is more grounded in factual accuracy than
And it is interesting for any question involving real-time information, mostly sports and finance. You know, I always, you know, if there's a stock down 25%, ask every AI, why is the stock down 25%? Generally, Grok is the one that knows. Yeah, Grok actually, you know, Grok because of the Twitter data set knows what is happening at the moment. In the world today. All right. And then, you know, as we sort of wrap up here on the AI issue,
What about the ROI here that David was mentioning? Yeah, so I find these debates also very funny. You know, there have been articles written about the multi-hundred billion dollar ROI questions. Those are very strange to me because the biggest spenders on GPUs are public companies and they report financial results every quarter.
And you can calculate a metric called return on invested capital. And ROIC, ROI, has gone vertical since they ramped their CapEx on GPUs. And actually just started to level out in this latest quarter. So the ROI on AI has been very positive thus far. Just a fact. It's a really good question.
Will it continue, particularly if, you know, it's going to cost $100 billion to train a model in two or three years, which I think is a realistic estimate. I guess the counter to that isn't the counter to that, that maybe there's a little bit of hype that, you know, maybe there are people are trying to determine the ROI and correlate it more precisely. And I guess that's the challenge, you know, meta doing AI across its entire enterprise, you might see in Google, you might see it.
directly making ads more effective as an example. 100% Yeah, that is the best. Yeah. But then for other folks, like, you know, is it actually happening? Or is it a toy? I guess is the criticism I hear? I'm not saying that's my position. But that's the criticism I hear is like, are people actually getting money from the copilot? Or maybe this is just product market fit discovery process? Because the the AI laptops
AI intelligence on Apple and let's say some general LLMs people feel maybe aren't worth the money or Copilot for Microsoft, maybe not worth the money. Yeah. I mean, I personally have not had good experiences with Copilot, but I would say that, and I'm sure both of you have come across these. There are lots of companies that are just these thin wrappers over a foundation model and they go from zero to 40 million instantaneously and they're profitable. Yeah.
And for their customers, they're replacing labor budgets. Yes. I'm sure you guys are noticing this too, but startups today at a given size are employing fewer people than they would have three years ago. And just like, you know, it's funny, people were very skeptical. I would say 50% less. Yeah, and that's the ROI on AI. And like in, you know, I went to the first AWS reInvent conference and no big companies were using cloud computing. It was all startups. Startups always adopt technologies first.
So outside of the ROI on AI that you're seeing in Google and Meta from using this across their businesses, you're seeing real ROI on AI from startups the same way they saw real ROI from cloud computing before anyone else. It's crazy. But I don't think these companies are in a classic prisoner's dilemma. They all believe to varying degrees that whoever gets there first to artificial superintelligence
is going to create tens or hundreds of trillions of dollars of value and i think they may be right and i if they get there and they think that if they lose the race their company is at mortal risk so as long as one person is spending i think they will all spend even if the roi decelerates it is a classic prisoner's dilemma competition is amazing it really is when you have a free market with competition we're sitting here two years ago three years ago on this pod gavin just
lamenting like, oh my God, what could happen in China could just roll over us. They've got everything dialed in. We're a disaster. And now here we are. China is a disaster. They've got all kinds of challenges. And the free market is even with weapon systems, we're seeing capitalism applied and competition applied there. All right. I think we should just wrap up on this Brian Thompson story. The CEO of UnitedHealthcare was shot and killed outside a Manhattan hotel on Wednesday morning.
UnitedHealthcare is an insurance subsidiary of UnitedHealth Group, and they employ over 140,000 people. They provide coverage to millions. And this was, I don't know if you've seen them, assuming you guys have seen the video on social media or go by on X.
There's been a big debate. Was this like a really well-trained killer, like an assassin, like a hired gun? Was it something personal maybe and this person's a hack and they're not really good at doing a hit like this and most people are sort of coming somewhere in between. ABC has reported, and this is where this thing has taken like a crazy turn, that the words deny, defend, and depose were discovered on the bullet casings at the scene. And those are the terms
Two of the three are in a book about how health insurers reject many of the claims every year. They deny it, they defend it, and then they will depose people to harass them, essentially. This is a crazy, crazy story, and it's breaking here. I don't know if anybody has any insights on it, but I thought I would bring it up here to just maybe intelligently speculate about what we've seen. I mean, it seems like the most likely case is someone's loved one died because they were denied coverage.
And whether this person was hired or they're a victim or related to a victim. I don't know if it matters. I think there's the observation I'll make is a question, which is, should CEOs be personally responsible for corporate actions, generally speaking? So there's a difference between a CEO committing fraud or being negligent. But if you don't get a good
service, or good quality of service or the product you expect, even if it is something you depend on, for healthcare, for example, let's say you take a drug, and the drug causes a side effect that causes some permanent damage, should the CEO be individually held accountable? And if that were the case, would anyone want to be a CEO of a company that sets out provide services that are critical like this? It's a very, like, I think, challenging question to think about, because
Certainly, you could feel like you want to hold someone responsible because a loved one died because that CEO's job was to make more money for their shareholders and therefore deny claims. And therefore, the way that they run that business is wrong. I think ultimately, we've got to kind of have this distinction between negligence, fraud, and acting on the corporate behalf. There's a, for a period of time, all of these documentaries and
This movement against the idea of the corporation, generally speaking. You guys remember this was like a decade ago or 15 years ago. Anti-capitalism movements. It is. Yeah. And it's like the corporation shields individuals and the corporation creates a shield for individuals to do harm is kind of the argument that's made.
And so there's a lot of people in this camp that think that these old CEOs of companies that let people down or evil should be killed, should be put in jail, whatever the awful kind of contextualization of that is.
And I do think like, it's really important to think about, well, if no one were to be the CEO, because they face that threat, and those companies can't make money as a business, then those services go away entirely. That's kind of the end state of where this goes. There's going to be these difficult situations. If a CEO does something negligent, fraudulent, wrong, there's a court and there's a system and there should be kind of laws that protect people. I don't know, man, the whole thing is pretty depressing.
to think that a guy who's the CEO, he's, you know, from what I heard. This guy's got a family. Yeah, I mean. He's got a family. He's got a wife. People that have known him said he was like a nice guy and a good guy. And he runs a tough business. You know, insurance is a very tough business. Well, and to your point about this seems like it's very personalized with the casings, if that is in fact true. Again, this is breaking news. So we're speculating here, hopefully informed.
This chart has been the one that's been circulating on social media. Now, this has now become Gavin, like a Rorschach test about how you feel about corporate America, healthcare, etc. But UnitedHealthcare, at least according to these charts that are speculating, deny claims at a rate at a multiple two or three x other people in the industry and that they are the most hated. Not that any of this obviously results in somebody deserving to die.
I mean, I can't believe I'm even saying this, but Taylor Lorenz went viral with a series of tweets, not tweets, I think she's on whatever the blue thing is, sky blue, blue sky, where she wrote some quotes here. And people wonder why we want these executives dead. Lorenz wrote on blue sky, a microblogging social media site, alongside an article about how blue sky, blue cross, blue shield no longer cover anesthesia for patients.
the following surgeries. That's according to the New York Post. Gavin, your thoughts on this insanity and tragedy? Yeah, well, first of all, it's a tragedy. And actually, I'm in New York as we record this, and it happened one block from where I am. And I mean, it is absolutely, it's a human tragedy. Taylor Lorenz was not the only person on social media who reacted that way, which I thought was deeply troubling.
It was a large group of people who were writing very morbid comments. There was a lot of anger around this issue that I was unaware of. I was completely unaware of it. Well, I think we all probably are very privileged to have great health care and able to pay our premiums. So we're not affected by this at this stage in our lives. I was very affected by this 30 years ago. We're all very lucky on this podcast. Yeah. Yeah.
And I can't imagine how I would feel if someone I loved had been denied medical care and died. And I felt like it was unnecessary and due to some corporation trying to make more money. But I just, I cannot believe. I'm sure I'd be outraged. I just can't believe I was deeply disturbed as a person by the number of people online celebrating this. It's really crazy.
Yeah, I thought it was awful. And I guess the last thing I would just say about that chart is I think it is a little misleading. I think that is initial denial. You know, maybe the, you know, in other words, maybe the company that, you know, only denies 7%, that's a final deny. You know, they, that's a company that... Yeah, who knows if the chart's even correct. I bring it up only that it is the trending item and people are, I find in these tragedies, they become like Rorschach tests, right? Yeah, UnitedHealthcare is,
Medical loss ratio is about 85%. So 85 cents of every dollar they collect in insurance premium, they're paying out in claims. If you guys want to look at what the most egregious insurance industry in the world is, it's title insurance. And I'll give you the list of the rest. Travel insurance is pretty bad. They pay out like nothing. You were in the insurance business for a bit there. Yeah. Like, I mean, you know, health insurance is the hardest, one of the hardest besides auto insurance businesses to be in.
You're paying out constantly. And there is a very difficult kind of process of managing losses because the number of claims that comes in, it's very easy to suddenly pay everything out. And then your premium goes up and then people can't afford the health insurance. So you're striking this balance of making health insurance affordable against the cost of medical claims. So it's a very kind of difficult business to be in. And I think it's very complicated to walk people through how they in their individual circumstances
aren't necessarily motivated by some corporate, you know, malfeasance. It's just the way the thing has to operate, unfortunately. Let me just say, I think that they're much like we saw with Hamas and the attacks in Israel a year ago, there were people celebrating that behavior. And we've seen that several times since. And people have become very vocal about their celebration of what they view to be the death
and harm done to those who view who they view to be oppressors, in whatever context you want to kind of fit this to and put that oppressor label on an individual. And that mindset seems to hold true through any social, financial, economic, political context, there is an oppressor group, and there's an oppressed group. And if you're in the oppressor group, you deserve harm, you deserve death, you deserve jail. And this is another manifestation of that mindset playing out.
This is an individual with a family who ran a business, who worked very hard for many years and wasn't trying to hurt people.
And for him to kind of have his life taken like this and for people to say that person is an oppressor, I think really speaks to how deeply people's minds have been contorted by this concept that there's oppressors and oppressed. It's almost like a mind virus. And I'm not going to call it the woke mind virus, because I just think you immediately shut down and won't hear that because it sounds cliche. But there is this concept of like everyone is in one of two groups. You're either being oppressed or you're an oppressor. And if you're an oppressor,
There is no limit to what I should do or what should be done to you. I think it's well said. And it's a very stark and sad kind of commentary on what's going on right now. And if you're oppressed, the corollary to that is if you are considered oppressed, you can do no wrong. You can do no wrong. And obviously there are people who are oppressed on this planet, but they can still do wrong. They should still be held to a moral standard. Yes.
And there is a moral standard and there is a standard and murder, obviously, an assassination like this is not acceptable. And it's just tragic. I just feel so terrible for this. These kids. Let's end on a happy note. So we'll see you on Saturday. Big party. Yeah. Hard turn here, but looking forward to seeing everybody on Saturday for the all in holiday. Zoom is sponsoring the all in holiday spectacular. So if you want to go to all in dot com, you can go sign up there. Right, Freebird? Yeah. And then you can sign up for the Zoom event.
Gavin, we expect you to sign up. Yes. We have a caviar budget we have to replenish over here at Sats. We do appreciate Zoom helping us out for the event. Zoom AI companion helped set up the live stream. So thanks to Zoom for doing that. AI everywhere. I have to say, you know what? One of the great... I have a couple of experiences with AI that are really great. Notion has a phenomenal AI built into it and so does...
Zoom with the AI summaries. I love getting these AI summaries of calls. I ask people permission to turn it on and we get a summary and the bullet points really well done. I went to we did a hackathon in the office a couple of weeks ago and we used have you guys actually built applications with cursor?
I have not. Was it fun to build it? Well, it was great because we had so many people that have never built software applications in the hackathon and they built tools from scratch, deployed them in production and are now using them. And I think it really showcases the kind of the impressive impact
that AI is having on workplace productivity. You don't need to buy SaaS tools. You don't need to have service providers do stuff for you. Individuals, and by the way, it's only getting better. And you can kind of think to a point. I mean, the ability to just wake up in the morning and say, I want this app and have it built for you. It is. And by the way, I'll just say, it's like 70, 80% there. You still have to debug. You still have to have someone come in and help kind of get things into production. So there's still a little bit of work. Well, it's just like web pages, right? Going back to the architecture question. Two months ago. Two months ago. And I,
And then go back to the architecture. Two months ago it was 60% there, now it's 70 to 80. And you fast forward 12 months and now you've got the architecture where the AI can run its own QA testing and debugging. Amazing. And the AI can run its own kind of UX. Sales and marketing. And it's own UX of the application and it can run everything. So you're basically going to say, I want this app to do this.
it builds it, it tests it, it builds the UX, it tests the UX, it iterates the UX, it does everything streamlined for you. And then you show up a couple hours later, and you're using a new product that was built
on the fly for you. It is, and we're literally like climbing this ladder, Gavin, like very quickly that it's going to totally change this entire software industry is like getting re-architected. I could guess Freeberg's app at his company hackathon. What do you think I made? I made a vegan version of Yelp. Only profiles all the vegan restaurants. I actually tried to make a CRM tool so that I wouldn't have to pay for CRM licenses.
I tried nine months ago to make a multiplayer app for Skyrim, which I was very excited with Skyrim. But I do think I failed. Maybe I should give it another go. But the, you learned, you didn't fail. I learned, I learned, I didn't fail. I learned. Yeah. I have a growth mindset, but,
We learned the limits. We all tested the limits. Yes, we stress tested the app. But I think next year, human language will be the dominant programming language. Totally. Totally. It's... You really made a great insight earlier, Gavin, with startups is where you see these innovations happen. And I always say internally...
we resource constraints really do drive innovation. And when you only have a nickel, you got to try to get a dollar out of it. And when you got a dollar and you got a lot of dollars, you're like, eh, it's okay. If I get a nickel out of a dollar, I got more dollars laying right over here. And Dylan always talked about this as well. Like they, they asked him like, why did blood on the tracks? Like, why did you do that? It was incredible. Like it's this Rolling Stone interview was talking to Dylan about it. He said,
This was like my favorite album. And this is incredible, whatever. And like, what was the inspiration take me behind it? And he said, Well, you know, I owed Columbia Records an album and they had given me an advance and they were going to sue me and I had to give the money back and I just gone through a divorce and I needed the money and I couldn't do it. So I wrote the album. I was desperately crushed that Dylan's one of his best albums and pieces of art in his life was strictly a function of the pressure of
Necessity is the mother of both technical and creative invention. Absolutely. All right, everybody. Four. Thanks, guys. Gavin Baker, Joe Lonsdale, David Friedberg, and we miss you, Sax, taking a victory day. And it's taking victory day today. And Chamath, both out of the office today. I am the world's greatest moderator. And we'll see you next time on the All In Podcast. Bye-bye. Bye-bye. Bye-bye.
Rain Man, David Sack. And it said, we open sourced it to the fans and they've just gone crazy. Love you, Westies. I'm the queen of Kinwani. Westies are gone. Dog taking a notice in your driveway. Oh, yeah.
Oh man! We should all just get a room and just have one big huge orgy because they're all just useless. It's like this like sexual tension that they just need to release somehow. You're the beat beat. What? You're the beat beat. What? We need to get merch. I'm doing all...