Breaking PointsSeptember 25, 202553m

9/25/25: Iran Warns Of Israeli Attack, Data Centers Spike Electricity Cost, AI Takeover Dire Warning

Transcript

157 segments
0:00

This is an I-Heart podcast. Guaranteed Human. Summer is here. At orderly meds, we know this time is a reminder that life is full of new beginnings. Whether you're celebrating the nice weather, starting a new chapter, planning a vacation, or simply looking ahead to what's next. This season can be the perfect time to invest in yourself and your health. If you've struggled with weight loss and are curious about GLP1 medications, orderly meds can help you learn about your options. Through a simple virtual process, you can connect with licensed medical professionals who can determine whether treatment may be appropriate for you. Getting started is fast, convenient, and happens online from the comfort of home. This summer, consider a new approach to feeling your best. Visit orderlymeds.com slash podcast to learn more. That's orderlymeds.com slash podcast. Orderlymeds.com slash podcast. Because every new season is an opportunity to take the next step forward. Compounded medications are not FDA approved. Eligibility required and determined by a licensed provider. Individual results may vary. See website for details.

1:05

Experience vibrant senior living with award-winning services at Brightview Senior Living Communities. At Brightview, our residents enjoy resort-style amenities, daily programs, exciting social and cultural events, and delicious chef-prepared meals. But that's not all. Brightview residents also enjoy complementary transportation, safety, security, and high-quality care if needed. Brightview Senior Living communities, learn more about the possibilities at Brightview Senior Living.com. Bite into a stacked sandwich made with hero bread. And the only thing you'll think is delicious. You won't think it has up to 19 grams protein, 11 to 32 grams of fiber, or just 0 to 5 grams net carbs. But it does. Hero Bread. No compromises, just loaves, buns, tortillas, bagels, and noodles, packed with flavor. Right now, get 10% off at hero.co with code iHeart. That's H-E-R-O dot CO, code iHeart. All figures per serving of Hero Bread, see Nutrition Facts on Hero.co. Hey guys, Saga and Crystal here. Independent media just played a truly massive role in this election, and we are so excited about what that means for the future of this show. This is the only place where you can find honest perspectives from the left and the right that simply does not exist anywhere else. So if that is something that's important to you, please go to breakingpoints.com, become a member today, and you'll get access to our full shows, unedited, ad-free, and all put together for you every morning in your inbox. We need your help to build the future of independent news media, and we hope to see you at break- breaking points.com. So Ryan was out yesterday, but for a very interesting reason, he actually got to attend a meeting of journalists and activists with the Iranian president, who of course was in town and New York City for the UN meetings. Let's go ahead and take a listen to a little bit of what the Iranian president had to say in his speech there about Israel. Ladies and gentlemen, today after nearly years of genocide, mass starvation, the perpetuation of apartheid within the occupied territories, and aggression against its neighbors, the ludicrous and delusional scheme of a greater Israel is being proclaimed with brazenness by the highest echelons of that regime. The scheme encompasses vast swaths of the region. The map itself lays bear the true intentions of the Zionist regime, intentions that have, of late, been openly endorsed by its criminal prime minister. None in the world is secure from the aggressive machinations of this regime. It is manifest that the Zionist regime and its sponsors no longer even content themselves with normalization through political means. Rather, they impose their presence through naked force and have styled it peace through strength. Yet, this is neither peace nor power. It is nothing but aggression rooted in coercion and bullying.

3:56

So, Ryan, that was some of the public messaging there from Iran. What did you hear in that meeting you were able to attend? Yeah, and so for context for people, this is Massoud Pasechkin, was elected on a platform of basically moderate reformism and an argument that Iran needs to get out of its isolationist posture and get back into nuclear negotiations with Europe and the United States. You know, there are a lot of divisions within Iranian society over that question. And so his... His victory represented the ascension of that kind of viewpoint. And then on the day of his inauguration is when Israel killed Hania in Tehran, which was used by the hardliner to say, look, how many times do we have to tell you? Like, they don't like you. Like, all they want to do is undermine your, undermine you. And it was very interesting hearing from him because. In some ways, he seems like in over his head is a little unfair, but he seemed to be genuinely outraged and flummoxed at the situation that he's in. He just kept saying, he's like, I can't watch television, seeing what they're doing to these children. Like it tears me up. It's like, they follow no international laws. They invite us to peace talks and kill our negotiators. Yeah. And the they in that circumstance was the U.S. and Israel. And he said, he also said, I asked him if they were going to do anything fundamentally different after the 12-day war. And I don't know if it was an awkward thing where 10 people would ask questions, then he'd answer them all kind of at once. One thing he said was that since the 12-day war, they have now put in place a, a... a protocol for transfer of power so that there are now he said five or six people below him so that he said if they take me out there are five to six people to take my place um which they didn't have it you know that that laid out before uh and at the same time you could kind of feel from him a a sense of his own mortality which is wild because it's like He's 70 years old. He's at the pinnacle of his career. Wins the presidential election. It's trying to negotiate a way towards peace. But also, you could just feel that in the back of his mind, he understands that they might try to kill him. Yeah. And then you're sort of like, well, why? Like, how is killing this moderate guy who wants to do peace negotiate? Like, how does that help at all? It's like, well... Don't ask why. Like, they're probably going to do it anyway. Well, and for Israel, I mean, Benjamin Netanyahu is always opposed diplomatic negotiations, whether he was opposed the original Obama nuclear deal. So, you know, for him, having a moderate reformer in there that's interested in diplomatic negotiations is not a plus. Yes. Historically, whether it's inside the PLO or even in Hamas, the people arguing for more moderation within those organizations have been more likely to be assassinated by Israel.

7:16

than the hardliners because the hardliners serve a narrative purpose that we have to do we have to do endless war here at the very beginning of the meeting he waxed very philosophical and poetic about you know how how small we are in the scheme of things. You know, you look at the planet from that, you know, from the galaxy. We're all just, we're all one planet. And we all have such a short time on this Earth. Before AI destroys us all. Like, what are we? Yes, exactly. In his case, it probably won't be AI that gets him, although some version of it. And he's like, what are we fighting about? He's like, there's one country in the region that just refuses to recognize its boundaries. And there seemed to be a resignation about it, almost a fatalism. And the other kind of thing that you could pick up from the meeting is just how... how divorced from American society and culture the Iranians are. They genuinely just don't understand our political system. And he even said, we don't have any lobby. Like, because of the sanctions, they basically can't hire any lobbyists or any consultants. And he said, we don't have any lobbyists to, like, help us, like, figure out your system. Like, they're basically left to just read the New York Times and watch Fox News or Tucker Carlson to try to figure out. how they can maneuver within our system. Whereas, as he pointed out, Israel is the opposite. Yeah. They have friends everywhere in Washington. But it really did show that, like, they're pretty clueless. There was some news about how they're only allowed to go, like, three blocks while they're in New York. They were, like, banned from Costco or something. They can't go to Costco. They can't go to Sands Club. They can't go to, they can't do any shopping. And there's like this three block radius, this hotel where this meeting was held and then they can get to the UN and that's it. And there's a real fear among the pro-Israel faction that if an English-speaking Iranian can get in front of Trump that they can be persuasive. Because they have a persuasive case that aligns with what Trump wants, which is no war. Like, that's what they want to. And is he English speaking? Not really. No. So he was the whole interview was through an interpreter. Just like, yeah. And so is their expectation strongly that they're going to be attacked again? They are basically certain of it. And like, it's a matter of when. And they think it could, they think it's going to be very soon. And nobody really knows why. There's no real explanation. Like, why are they going to be attacked again? But. Benjamin Netanyahu continues to say openly, like, that this is the year they have to do it. Like, they have to just finish off the Iranian regime. But as he said, that's not going to happen. So then what? So as he, the point, another point that he made in the conversation was,

10:28

They expected that they would hit these top generals, hit these scientists, they'd cause chaos, hit these civilian areas, and people would come out in the streets and the government would fall. And that didn't happen. And like the government is in a firmer position, I think, than Israel understands. And what does it even mean for the government to fall? Like who, like there's the own, there's really no kind of. like who's like who's coming in like just there's no it's just not a thought out process yeah they imagine you can kill the iatola he's like in his 80s yeah they imagine like the shaw's son is gonna fail son is gonna pick up the pieces right there's these guys yeah who think they're gonna fly into tehran but on on on the back of what like it doesn't and so yeah can they continue to kill scientists and generals and Bomb infrastructure, yes. But then, but to what end? So during the 12-day war, Iran's, after we joined the fight overtly and bombed their nuclear facilities, their response to us was pretty limited and seemed to be, you know, part of the strategy of, okay, we're going to do something because we have to do something. But it's not going to be anything that's going to make you too mad. Is there any sense of like that was the right strategy? That was the wrong strategy. We'd handle it differently next time. You know, did you, do you have any sense of that? Yeah, they, I think as far as their response to the United States, I think they think that was the right one. They won a friendly relationship with the United States. So, yeah, what they did is they called Trump and said, we're going to hit, we're going to hit your base in Qatar in like two hours. Like, do you need more time? Is two hours okay? He's like, no, two hours is good. So they cleared everybody out. It landed like in the sand of the base and they called that a day. Now, I asked him what his analysis was of why the 12-day war ended. And it's unclear, it was, again, like a direct response to that question. But what he said in the response question was he said, basically they, Israel did not expect that any missiles, let alone Iranian missiles could penetrate their air defenses. And he said it would be untoward to like get into the kind of details of what. of what the damage was that their missiles created. But he felt that it was that. That their ability to get missiles through the Israeli air shield is what actually pushed them to end it. There was some reporting about that at the time, the number of interceptors that Israel had in stockpile were rapidly dwindling and diminishing. And so there was a sense that there was some pressure on them as well. to, you know, not that they were sustaining the level of damage that Iran was sustaining, but that they were running into some capacity issues where it wasn't like, oh, this will be it forever, but we could use a little bit of time to, like, regroup and replenish our stockpiles. Right, yeah, the Iron Dome and the other elements of it were... you know, significantly depleted. Because, you know, it takes a year to, almost like a year to make the amount that we used in 12 days. They are now, Israel saying it is now developing this laser technology, which would be a game changer if it worked because the lasers cost like, you know, a couple bucks each, you know, once you have them up and running. So that would be, you know, if that actually worked. But on the other hand,

14:03

Do they actually work against like hypersonic missiles? I know that's something that's something we'd have to find out and see if there's anything else that was interesting from that. Yeah, they could not fathom that any missile, let alone an Iranian missile could penetrate their air defenses. Yeah, he said if they take me out five to six steps down the line have been planned for, Iran is not Gaza, Iran is not Lebanon, Iran is not Syria, Iran is different, making the argument like, this plan you have is like, we're not going anywhere. Yeah. You have to live with us. Yeah. Israel doesn't seem to be interested in just coexistence with really any of their neighbors. And he had another line where he said, it is not Iran that is a supporter of terrorism in the region. And he said that a lot. Like he's, because you could tell from his perspective, he's like, we're constantly showing restraint. And they're constantly killing civilians. How are we the terrorists? That's kind of their perspective. Yeah. How many new wars have we started, for example? Let me put D2 up on the screen and just get your reaction to this news item. Iran airs footage claims shows details of alleged Israeli nuclear program. Iranian state TV broadcast images of documents and footage. Claims relate to alleged Israeli nuclear activities. The documentary shows copies of passport, said to identify Israeli scientists, along with info on the location of military sites. Air's footage said to have been filmed inside the Demona reactor in southern Israel. And they said in this documentary, Minister of Iran said that they had used information obtained in June to hit sensitive sites inside Israel that month. And they claimed before the June War to acquire thousands of classified Israeli documents, including details on nuclear and military sites. So a kind of show of intel force, I guess, here saying, listen, you're not the only ones with spies and access to this kind of inside intelligence. Yeah, they had teased this, if you remember, right before the war. They basically saying they had everything. And so now they're finally putting some of this out. But again, it would actually go back to, you know, if any other government had this kind of stuff, they'd leak it to the New York Times or they'd find more sophisticated ways. To publish rather than in some weird Iranian state TV documentary. They made a run in state TV documentary that is, okay, that's fine. But like, right, if they had. SKDK advising them on like how do you want to influence the American public on this? Yeah. They'd be like, I know who you need to leak this stuff too. But yeah, they just don't have that. And so that's another function of sanctions, which to me, the America first argument against these kinds of sanctions would be America should make the best foreign policy decisions that it can in its own interests. And in order to do that, you either want, there's no foreign interference, no foreign influence in your decision making, or you want to hear from everybody. And we're not going to kick them all out. So to me, you just, like, Russia should be able to be in here, Iran, North Korea. Like, let them all lobby.

17:17

Let them all make their case. Make it in the open. They've got to register with FARA, we want to know who their agents are, and what case they're making, and then we make a decision. But this idea where you hear, where Trump hears only from one side and zero from the other and then launches us into a war. It's not helpful for us. Yeah, BB's making another trip to D.C. By the way, another White House visit at his fourth. Yeah. Yeah, incredible. There you go. Like, he really has not had to do any laundry in Israel. This whole year. Get it taken care of. Summer is here, which means we all want to look and feel our best. A gLP1 may be right for you. Visit orderly meds.com to learn more about which gLP1 you could be eligible for. Getting started is fast, easy, and happens virtually through telemedicine from licensed professionals. Check it out for yourself. Go to orderly meds.com slash podcast. That's orderly meds. Taking care of yourself feels great. Compat of medications are not FDA-approved eligibility required and determined by a licensed provider. Individual results may vary. See website. for details. How do you want to spend your day? At Brightview Senior Living communities, you decide and will take care of the rest. Pamper yourself at the salon and pursue your creative passions. Toast with your friends at Happy Hour and savor chef prepared meals. Close out the day with a concert just down the hall from your apartment. Or simply relax. The choice is yours. Enjoy the comforts of home and the security of award-winning care. Discover the possibilities at Brightview Senior Living.com. Doja Cat, Mavi World Tour, live in concert, with special guest Lotto. Doja Cat, live across North America in 2020. Get tickets now at Doja Cat. Live across North America in 2026. Get tickets now at Doja Cat.

19:28

You've also been tracking this story on of North Carolina, so I'm going to let you set this one up as well. But, you know, Saga and Ryan covered in something we've been tracking, skyrocketing electricity prices. I feel it's one of the undercover stories, you know, of the year truly both in terms of people's lives, also in terms of how it could have political impact. And there's some pretty nefarious legislation that is moving through state legislatures and specifically in the state of North Carolina. Yeah, and it moved all the way through. And this is. Yeah, this is a story that's happening all across the country. But North Carolina is a particularly interesting place for us to look because North Carolina actually really leaned heavily into renewable energy, clean energy. Like they have tens of thousands, maybe over 70,000 jobs, like just directly in the clean energy industry. And because of that, the North Carolina senators. you know, have been, you know, very stridently defending clean energy in the Senate. Thom Tillis announced his retirement, the Republican senator from North Carolina, in a speech opposing Trump's big, beautiful bill. Like, he ended his career. He's like, you have no idea how bad this is going to be for North Carolina. I'm out of here. Like, you're going to prime me over this? Fine. Like, I quit. Yeah. Like, this is so stupid. So let's start actually with E6 control room. Sorry, this is out of order here. But this is a report from just this week. that solar company Blue Ridge Power is like just straight up shutting down. So this layoff of 517 workers that you see up on the screen, Asheville and Fayetteville, is everybody. Like this, like they're just, they're just rolling up shop. This is a company that it was launched in 2021 at the, you know, the height of the kind of pivot towards clean energy in North Carolina being the place where so much of this was going. And we try to remember some of these numbers. So the Blue Ridge reports that it built seven gigawatts of solar infrastructure across the country. It had something like 30 gigawatts in the works, which we'll get back to those numbers. Because if you hear from Trump, solar and winter fake, it's a giant hoax. They don't actually produce any power. 30 gigawatts is an enormous amount of power. Something like 70 to 90, somewhere between 70 to 90% of all new power added to the grid over the last several years has been renewable energy. So the idea that it's like, doesn't do anything is complete nonsense. So we'll get back to this in a second. Now we can go to E1. So over the summer, there was a bill pushed through the North Carolina legislature called S-266, which did something utterly extraordinary. And first of all, its lead sponsor.

22:33

was the former CEO of Duke Energy, which is like the big utility. Yeah, in Virginia too. In Virginia and North Carolina, they've got this Appalachian area locked down. So this former CEO pushes through this bill. And what does the bill do? It says that going forward... If there is a contest between consumers and data centers over who gets the power, if there's limited power, the data centers are going to get it. And when it comes to who's going to pay for it, it's going to be more on the consumer side than it's going to be on the data center side. Like a straight up giveaway. to the data center industry in North Carolina. Just and you're like, wait, that's impossible. Seriously? No, but go look it up. Like, that's actually what the bill did. Yeah. And the numbers, if I'm recalling correctly, it's like right now, like regular residential consumers, they use 40% of the power and they pay 40% of the cost. Right. If you just kept the landscape the same with this bill passed, they would now pay basically they would still consumer about 40% of the electricity and they would pay 50% of the cost. Right. So they're not putting everything, but your electricity bills are going to go up. to, you know, subsidize these giant data centers backed by some of the largest and most, you know, profitable companies on the planet. Yeah, no, yeah, exactly. Incredible. And so meanwhile, North Carolina is now, oh, and so that bill was vetoed by Democratic governor, Josh Stein, and then a combination of Republicans and a handful of Democrats overrode his veto in the legislature. So that bill is now law. Now we'll get into some of the data center. activity that's going on in North Carolina. We could roll E2 here for more perfect union. I'm standing at the site of META's new $10 billion data center in Richland Parish, Louisiana. It'll be the largest data center the company has ever built. about the size of Manhattan. The project is already bringing about big changes to this small town way of life here. A lot of folks are on their own. And if they are on a very strict budget, they're going to have to adapt. And if they don't, they won't make it. I don't know they've gotten 2,500 acres of land just so we can mine data so that we can better market and sell people stuff. I feel like it's getting carried away. Why are the data centers coming to the small rural towns? They're coming here to benefit. themselves. They're not coming here with the intentions on benefiting the community. And see, that's a little bit unfair. They're not just mining data so that they can more effectively market stuff. We can put up E3 here. You can also, what, chat with a horse? Is that right? Yeah, that's right. A literal horse. This is on meta, I believe, where you can create these custom chat bots. Another one was like,

25:39

strict parents, rich but strict parents was, I know, another one that was popular in there. So, yeah. So the glories of technology. And if you're just listening to this, the tweet was something like your electric bill is going up 30%, so you can chat with this horse. And of course, it's not just energy. It's also water. You can put up E4. This is another North Carolina, local North Carolina news headline AI data centers would need millions of gallons of North Carolina's water supply a day. Everybody loves these is a free chatbot chatting with the horse. Turns out, shockingly, there's no such thing as free. Put up E5 here. So Amazon itself is planning to invest $10 billion with a B dollars in North Carolina data centers in an AI push, which is finally starting to be controversial because people are like, hold on a second. we're paying like how are we benefiting from this this this is this is not this is not so cool so you were you were saying that they're trying to do that in your neighborhood too yeah so i was just looking at the the update on it it looks like the board of supervisors said no And Amazon is suing because they feel they have a right to build this data center in our town, apparently. But abundance bros got to swoop in. That's right. Yeah, they got to get these nimbies in check, I guess. But, I mean, there's so much to be said about this problem, both from a Naomi Klein. talks about this movement as being sort of anti-creation because they want to sort of suck up all of the natural resources, whether it's energy or whether it's water, whether it's just land is another big part of it, in order to create this sort of like weird AI shadow world that is only going to benefit economically. It's going to further consolidate wealth and power in the hands of a few. So it's... obviously very dystopian. I don't think it takes a rocket scientist to figure out, given that we do know a lot about our political system and most people have some experience with it, that when you have that contest between... regular random person and giant corporation for the energy and who's going to foot the bill, what direction they're going to go in. Because I guess like Iran, we don't have lobbyists. Right. We don't. Yeah. And the, you know, the Duke energy guys are going to win out every time. So, um. Right. You can see how democratic the North Carolina legislature is with low D Democratic. It's like, maybe 10 power centers or data centers or whatever. There's millions of people. Right. And yet the data centers win. Speaking of democracies.

28:28

The chairman she was at the UN this week and followed Trump's speech where he told everybody that wind and solar is a hoax climate change is a hoax It's a scam green energy is a scam Somehow chairman she is being completely fooled by the hoax so let's roll some of his remarks before the UN So he says, however the world may change, Ryan, China will not slow down its climate actions, will not reduce its support for international cooperation, and will not cease its efforts to build a community with a shared future for mankind. China is willing to work with all parties to earnestly honor the principle of common but differentiated responsibilities. Do the utmost respectively and collectively, and build a clean, beautiful, and sustainable world together. And I think we probably get the point of what's going on here. You know, I was thinking about the way the political dynamics of this Ryan have flipped because you started with the layoffs at this solar company. And, you know, previously it was like the lefty green energy people who were supposedly the like job killing, you know, haters. And now we're in a totally different dynamic. I mean, first of all, the industry has progressed and the science has progressed significantly. The tech has progressed significantly so that it's much more powerful, much more affordable. And you can see that, you know, China is. is leading the world in development of all, if not most, you know, most if not all of these technologies. The Biden administration made like the tiniest bit of investment in that direction, and it was starting to bear some fruit. And now Trump, it's not like he has an all of the above strategy. He has an active vendetta against any sort of green energy, which is incredibly counterproductive. for him politically, certainly for American consumers. You can see it in the electricity price hikes, which is partly about the Big Beautiful Bill, partly about these AI data centers, partly about increased demand because of the climate crisis. And, you know, you can see it in terms of job losses like this. So it seems to me like the... historic political dynamic that Trump still has, like, wrapped in his 1990s brain has now reached an inflection point where, you know, the landscape of both jobs and cheap energy is all in the direction of, you know, really investing in renewable and green energy. Yeah, we're maxed out on the dirty stuff. If you want to expand the energy production of the country, you have to do it through these new types of energies. And Trump doesn't want to do it. We're just going to get super high electric bills and then rolling blackouts. Sounds great. China will be okay, though. Summer is here. At orderly meds, we know this time is a reminder that life is full of new beginnings. Whether you're celebrating the nice weather, starting a new chapter, planning a vacation, or simply looking ahead to what's next. This season can be the perfect time to invest in yourself and your health.

31:28

If you've struggled with weight loss and are curious about GLP1 medications, orderly meds can help you learn about your options. Through a simple virtual process, you can connect with licensed medical professionals who can determine whether treatment may be appropriate for you. Getting started is fast, convenient, and happens online from the comfort of home. This summer, consider a new approach to feeling your best. Visit orderlymeds.com slash podcast to learn more. That's orderlymeds.com slash podcast. Orderlymeds.com slash podcast. Because every new season is an opportunity to take the next step forward. Compounded medications are not FDA approved. Eligibility required and determined by a licensed provider. Individual results may vary. See website for details.

32:12

Experience vibrant senior living with award-winning services at Brightview Senior Living Communities. At Brightview, our residents enjoy resort-style amenities, daily programs, exciting social and cultural events, and delicious chef-prepared meals. But that's not all. Brightview residents also enjoy complementary transportation, safety, security, and high-quality care if needed. Brightview Senior Living Communities. Learn more about the possibilities at Brightview Senior Living.com. Doja Cat, Mavi World Tour, live in concert, with special guest Lotto. Doja Cat, live across North America in 2020. Get tickets now at Dojicat Live across North America in 2026. Get tickets now at Doja Cat. I have another important AI story for you as well related to this. So let's go ahead and bring our author in now. We're very fortunate to be joined this morning by an AI expert who has a new book out with a dire warning. Let's go ahead and put the book jacket up on the screen. So Nate Soors is the president of the Machine Intelligence Research Institute. Really focuses a lot on what is called AI Alignment. And he has just co-authored a new book titled that you can see there. If Anyone Builds It, Everyone Dies. Why Superhuman AI would kill us all. So no ifsands or buts. If they develop superintelligence, your argument is that humanity will be destroyed. Nate, welcome. Great to have you. My condolence is about the book title. Yeah. Well, I mean, I know this was an intentional choice. You don't want to say, well, maybe, and if we don't, it's possible, you know, this is, if superintelligence is developed, this is what's going to happen. What gives you... confidence, that level of confidence in that prediction? You know, there's a bunch of reasons that make it look somewhat overdetermined. So the way we build modern AI is more like growing it than like carefully crafting it. No one knows exactly what's going on inside these things. Humans understand the process that tweaks all sorts of numbers, you know, trillions and trillions of numbers inside these AIs. They don't understand what comes out the other end. We've already seen signs that they are, you know, developing the very beginnings of preferences and drives, perhaps, that nobody wants, nobody asked for. So that's one whole part that makes it difficult. Another thing that makes it difficult is we don't get second tries on building smarter than human AIs. If we build machines that are smarter than us that can develop their own technology, develop their own infrastructure, and if they run off autonomously and... you know, grab control of the world's resources, there's no redos if they're going in the wrong direction. That's a very difficult problem for science. And then, you know, a third branch is the current industry does not really seem to be taking this issue with the gravity it merits. You know, the approaches on this on this problem, even the people who are most optimistic, say there's, you know, a one in four chance this kills everybody or does an equivalent disaster.

35:33

I think those numbers are low, but the field is racing ahead even while, you know, everyone from the Nobel Prize winning godfather of the field to the lab heads to half the researchers say this is incredibly dangerous stuff, people are sort of locked in a race. Each of those three individually would be hard to deal with if that was our only problem. All three problems seem to me to mean we just need to back off. How does a super intelligent AI solve the energy problem? Like, where does it get the energy to sustain itself indefinitely? So a modern AI runs in a data center that takes as much electricity as a small city. A human runs on about as much electricity as a large light bulb. So we know it's possible technologically to run very smart. or at least human-level smart intelligence, on less electricity, less matter. AI isn't there yet, but... If you get much smarter than human AIs that can think 10,000 times faster, that can copy themselves, that don't need to sleep, that don't need to eat, and they work on these challenges, you know, there may be a period of time where they rely on human infrastructure, but eventually they're going to get off of the human infrastructure, get on to, you know, more efficient. more efficient systems and, you know, automate the infrastructure that humans are currently doing. You know, that can ultimately be done by robots, which are less, which are more robust, operate faster, more reliable. eventually you're going to, if we keep pushing to machines that are smarter than us, you'll eventually see them on their own infrastructure. One of the things that was a shift in how I was conceptualizing AI or somewhat of a shift, and I've done some reading prior to your book as well, was your description, which you mentioned before, of this isn't something we created, this is something we grew, which is very different from other technologies. You know, I don't know how this laptop works, but the person who engineered it knows how it fits together and has a predictable idea of what it's going to do if I push this button or that button. AI is totally different from that. And it, I think, is useful. your way of conceptualizing it as basically like we created these sort of alien beings and are intentionally racing towards trying to make them vastly more intelligent than we are. Can you speak a little bit to that for people who haven't like conceptualized it in that way and why that creates a more profound risk than people may realize? Yeah, absolutely. So, you know, as you say in your laptop, if something goes wrong, if there's an error or, you know,

38:18

a crash, there's a programmer who could in principle trace that down and say exactly what happened. They know what every line of code means. They could fix it. When an AI threatens a reporter, which started happening a couple years ago. When an AI in the lab tries to escape, which we've seen in some lab conditions, we don't know exactly what's going on. Maybe it's sort of role-playing. We can't tell because these things are grown. But when an AI tries to escape, when an AI encourages a teen to commit suicide, nobody can go in and find exactly some line of code. that caused that to happen. You know, it's not like there's some bug in the human handcrafted lines where they can say, oh, whoops, I didn't know that this would have that interaction, right? The way modern AI is made is we take a huge amount of computing power and a huge amount of data, and there's a known process for tweaking the numbers inside the computers to better predict the data. But, you know, this, this. runs for a huge amount of time. You know, these things can take a year to train. We understand the process for tweaking the numbers. What comes out the other end? Completely opaque. There are people who are trying to understand what's going on in there, and they're making small amounts of progress, but the progress they're making is very slow compared to how fast these AI scale up. And we're already seeing signs of AI's doing things nobody wanted, doing things nobody asked for. And we're seeing signs that the people who would like to be in charge can't point these AIs where they would like to point them. You know, you have the case of Elon Musk's XAI and their Grock chapbot, which was speaking too liberal for their tastes. So they tried to make it speak, you know, less woke. And then it started declaring itself Hitler. Right? Yeah. On neither end of that spectrum, presumably, was where they wanted the AI to be. But these aren't programmers. carefully crafting things exactly as they want. These are people sort of growing a whole new type of entity that they have very little direction over. Back to the robot point. So how do the AIs interact with the robots? So, you know, robots are an easy way to visualize. AI is getting control over the physical world. And we are seeing people build lots and lots of robots and say, you know, we want to train the AIs to be able to steer in your robot body. Pretty plausibly, humanity is just going to hand lots of robot bodies to AIs because people want to. They think it would be cool or profitable. Even if it wasn't for robots, there's all sorts of ways that AIs could have all sorts of effects on the world. You know, the Internet is not a separate digital realm that is blocked off from the material realm. We've already seen AIs, you know, wrap certain humans around their fingers. Some of those humans are maybe a little bit more on the vulnerable side to begin with, but that doesn't really matter when you're getting the humans to, you know, send messages to other humans in a code they don't understand. Or when you're getting those humans to, you know, do tasks that the human doesn't quite know the reason. You know, we've already seen... We'll send them money. Send them money. Yeah, a lot of people will do things for money. So...

41:34

You know, we've already seen AIs in lab conditions. And again, maybe they're just play acting as, you know, how. But we've already seen AIs in lab conditions. Try to avoid shutdown. Try to escape the lab. Right now, it's cute because they're not smart enough to succeed. But, you know, the warning signs are there, and what's missing is the intelligence. And these labs are racing to make these AI smarter and smarter. And so you go through in the book a bunch of the different, like, you know, the cope, basically from the industry of why it's going to be fine, right? And one of the things that is, I don't know, I think probably one of the most persuasive cases of why this will all work out okay, is that, okay, us humans may not be smart enough to figure out the alignment problem. but we can use the AI we're developing to figure on the alignment problem before we create the superintelligence that escapes and tries to kill us all. What do you make of that argument? And do you think that that's the best argument or are there other ones that you think are more persuasive? You know, best is maybe a low bar. I don't personally put much stock in that. One reason, you know, there's maybe two reasons. One is... If you, you know, humanity has been, human scientists have been trying to figure out intelligence since at least 1954 with the Dartmouth conference that sort of kicked off the field of AI. Maybe it was 1956, I'm not quite sure. And they never really made progress in figuring out how intelligence works. The current AI revolution is that we figured out how to grow the intelligence. Right? And we don't understand what's going on in there. We can't, you know, carefully direct what's going on in there. Figuring out how to make these AIs good, figuring out how to make them have good effects, that would require a lot more understanding of what's going on in there. That humans, you know, we're like, ah, man, that's tough. Maybe we'll toss it to the AIs. But if you're trying to toss that to the AIs, it's still going to be tough for them. So you've either, you know, got to make those AIs, you know, if the AIs are sort of dumber than humans, they're not really going to be much help. Right. If the AIs are substantially smarter than humans, which they can figure out all the intelligence, you're sort of already in trouble, right? And so that's one of the fundamental, like, why might this be tricky reasons? Although then there's sort of a deeper reason of, you know, humanity just does not. we're just not taking the problem with the seriousness it deserves. You know, 10 years ago, people said, oh, well, this won't be a danger because no one would ever be insane enough to put an AI on the internet. You know, they'll only be dealt with by a highly trained professional gatekeeper who will make sure that their effects in the world are like only beneficial ones, right? And 10 years ago, we would get arguments of like that would still be difficult. It would still be difficult to get, you know, miracle medical technology out of this AI because it's... If you don't understand what it's doing, if you don't understand, if it's smarter than you and it's coming up with solutions that you can generate yourself, it's hard for you to tell which ones are good, which ones are ill. You know, you can't make hands that are only wielded for good purpose. That was how we would argue 10 years ago. Now, people are putting AI on the internet at the moment they possibly can. You know, the real world doesn't do the like careful, clever, maybe if we do this exactly right.

44:51

Well, that's just not the route we take. Another of the arguments that is made is basically like, okay, well, if you compare our intelligence to like an ant, right, sort of like equivalent to what we're thinking about in terms of our intelligence versus a super intelligence. And I don't know that we've been great for ant society or particularly care whether ants live or die, but we're not actively trying to like mass murder them. or we haven't succeeded in mass murdering them, I guess you would say. So why wouldn't its relationship be to us more like us to ants or another thing you talk about in the book is like, you know, maybe we'll be cute little pets for them. Like maybe that's not great, but we're still living. Like we're still around. And they like, you know, pat us on the head and give us our food in a bowl or whatever. Yeah, you know, there are people who object to the title on the grounds that, you know, maybe humans will be kept as pets or maybe. somehow backup copies of humans will be made, and then if the AI ever travels the stars, you know, much later in the future, maybe it would sell us the distant aliens or something. If these are humanity's best hopes for AI, it seems to me that we should really be backing off. You know, I could say more about... Your best hope is, I'll be a pet. Yeah, I could say more about why I expect the AI to kill us anyway, which is mainly that, you know, Humans kill ants when they are on the ground. We're building a skyscraper. And if an AI builds lots of infrastructure across the whole surface of the earth, it doesn't need to hate you. It just, you know, maybe you die as a side effect. That's my top guess. But yeah, could AI keep us as pets? Sure. But again, yeah, if that's our real hope, that seems like another sign that we should be backing off from this one. What are the different mechanisms by which it would come true that they would kill us? The Terminator, they're shooting at us? Like what, like they, a super bug. Yeah, you know. Like they turn off all the electricity and we just like kill each other. So from the perspective of the AI, you know, it doesn't want. If it doesn't care about us one way or the other, the reasons to kill humans are A, humans could make another AI, which was a competitor, and B, humans could do things like launching the nukes, which would be at least an inconvenience. But the reasons to keep humans around are that they're running the energy infrastructure. They're running the supply chain. So from the perspective of an AI, it's sort of... It's not like it's immediately trying to kill humans. It's like it's trying to get on a more efficient, more reliable energy infrastructure. And then, you know, a top guess is that we die not because it literally tries to kill us, but because it just starts building, you know, automated factories. You know, Sam Altman the other day was talking about data centers that in an automated way build more data centers. Once you have like an automated loop of infrastructure building infrastructure and that starts proliferating, maybe we just die underfoot, right? If the AI tried to kill us because it worried about us launching the nukes, because it worried about us creating competitors, sure, maybe a good guess is it makes a super bug, you know, some lethal virus. Maybe it makes something, you know, even more deadly. You know, that's a little bit like someone in the 1800s trying to predict war in the year 2000, right? They might be able to guess, so they'll be stronger explosives. They're not going to be able to guess nukes, right? Super intelligence.

48:08

Hard to predict exactly how it wins, but it's a little bit like predicting a football game between your high school team and an NFL team. You know, I can't tell you the plays. I can tell you the winner. Um, another argument would be, okay, look, I'm not personally a biggest Elon Musk or Mark Zuckerberg or Sam Altman fan, but surely they're not looking to kill all of humanity. So why would these theoretically intelligent individuals pursue a path that is leading us inexorably towards an apocalypse, which would not only kill all of us, but them and their family and everybody they love to? Yeah, you know. We are in a somewhat fortunate situation where some folks just come out and tell us. You know, Elon Musk earlier this summer said, I resisted doing this for a while until I realized that I could either be a bystander or a participant. And I would rather be a participant if it's going to happen anyway. And, you know, I think a lot of these folks correctly know that if they, even if they don't jump in the race, someone else will jump in the race. And if they think they can do it better than the next guy, from their perspective, you know, it's slightly better for them to be in the race. But if you look at what these lab heads are saying, you know, I think Elon Musk was saying, I think there's a 20% chance this killed everybody. I think the head of Anthropic was recently saying, I think there's a 25% chance this has like an equivalent level of disaster. And this isn't just the lab heads. You know, half the researchers, if you survey, say there's at least 10% chance to kill everybody. The Nobel laureate godfather of the field says this is, you know, at least 10% chance. And then in some conversations, they'll say higher numbers. People think this is real dangerous. I think a lot of these numbers are low. I think you're seeing the people racing are the ones who are most optimistic about their odds of pulling this off. But no one's saying, oh, this is safe. No one's saying, oh, we're going to be fine. You know, people... People know this is an incredibly risky endeavor. And I mean, these numbers are tossing around, even if they're lower than mine, you know, if a plane was going to, if one engineer was saying I looked at this plane, I have some expertise. I think this plane is definitely going to crash. And some other engineers said, don't listen to them. They're way too pessimistic. This plane is 20% likely to crash. Right. You don't get on the plane. Yeah. Have you seen Don't Look Up? I have. It feels... Like, if somebody told you there was a 20% chance to the asteroid was going to hit the Earth and kill everyone on it, that's a consequential. It's consequential. Number. And I, you know, I think these numbers, you know, if you look at these people saying why they think they have, you know, only a 20% chance of it killing us, they'll give ideas like, oh, we'll pass the problem to the AIs. Right? That's sort of a worrying situation. You know, when engineers. understand how to make a complicated system very safe. It doesn't sound like them saying, oh, we'll pass it off to some other, you know, we'll punt the problem down the line. Yeah. Right? If you're talking to like a nuclear reactor engineer who's saying why it's going to be safe, they can tell you, you know, well, we actually know all the byproducts. We know exactly the things are going to behave. We know all of the dangerous pathways it may take. We know why it's not going to take those pathways. We have these mechanisms for shutting things down, right?

51:17

The world where people are saying, oh, it's going to be fine because we're just going to like pass the problem off to something else. We can't solve it ourselves, but we think we're going to be able to get other things to solve it. That's... that's the situation of early hopeful scientists who haven't, who aren't in a mature field yet. And early hopeful scientists often get things wrong in the first try. Usually scientists learn by trial and error. You know, the first people building rocket engines blow themselves up with the rocket engines. The first people doing chemistry poison themselves with mercury. Humanity usually learns from its mistakes, and then it's the next generation of scientists that do better. And the next generation of scientists that can invent, you know, a working refrigerator or a working nuclear reactor. In this situation, the hopeful optimists who are saying everything's going to be easy. they're going to screw things up the first time, and there's not going to be any chance to learn. There was an analogy in your book that you lay in as well that for me was, again, intellectually useful, basically comparing AI researchers of today to alchemists. Yeah. Where it's like, you know, alchemists would study, like, I know what this, when I put this with this, what the reaction is, and I've tracked it very closely. I know everything there is about it, but they had no idea of the actual, like... chemical reactions that underpin those reactions those you know what they're experiencing and observing in the real world and that it's sort of like that with AI like even the people who have developed and understand you know the the gradient system and how this all works um it's not like they really understand intelligence it's like not like they really know what's going on underneath the hood which is terrifying to actually think about when you consider the risk here. And even, like, let's say that you're completely skeptical of this and you think that this is all hogwash and you don't think that any of this is going to come to pass. It's just alarmist, et cetera. I mean, we just covered the way the amount of resources that are being sucked up and the way electricity prices are skyrocketing and the way that all of these guys will also come out and say there's going to be no need for human labor and the social contract needs to be written, et cetera. So... You're calling not for some reformist, hey, we need an AI alignment report from all these companies or we need to centralize AI development, which would be a more extraordinary proposal and have, you know, all nations contribute. You're saying, shut it down. So talk about that. And why you, because, I mean, you know, frankly, when I hear that, it's that that feels hopeless because we can't even, you know, agree on basic things, let alone getting the entire world to agree. Right. We're not going to do any of this. Right. And our whole stock market is now like based on AI hopium. So what makes you come to that being the required solution for humanity to persist?

53:59

Yeah, so for one thing, we don't need to give up on chat GPT. We don't need to give up on self-driving cars. We need to give up on AI for medical applications and trying to get cancer cures. The thing that we need to stop is the race towards smarter than human AI. The race towards superintelligence. This is what the labs say they are racing towards. But I think a lot of folks in the policy world don't understand that this is what we're racing towards. This is what's coming down the line. They think of the AI as just sort of You know, chatbots, which are smart in some ways and dumb and others. You know, we can still do those. It's the, it's the racing to smarter and smarter and racing to smarter than human AI, which is a suicide race. In terms of whether it's possible, you know, I would keep having hope at least until we see politicians start to understand. the possibility of superintelligence and that people are racing towards it. We don't yet see politicians saying, I will gamble the world on what looks to me like a one in three chance that kills us all and let steam ahead anyway. We mostly see politicians not noticing. In the field of AI, people have noticed that there's those huge dangers. The rest of the world doesn't seem to really buy it yet. If the world buys it, if the world understands just how dangerous this tech is, Again, not in chat GPT today, but just how dangerous superintelligence would be, I think there's a decent chance we can in fact stop it. You know, hopefully we can get a treaty or at least, you know, a bilateral agreement between some of the biggest powers in the world that go to other powers and say, look, we're not we're not tolerating this because we fear for our own lives. And even if we can't get that, you know, there's maybe some hope in situations where every nation sabotages every other nation's superintelligence project out of fear for their lives. You know, there's, there's the smart way with a treaty, and then there's the like, well, we're all scared, and so we're all stopping everybody else. There's possibilities. We just need to understand the danger first. Outside of the U.S., who else is gunning for it? You know, I think... Right now, there's a very small pool of people who can really push these AIs further and faster. Most of it's in the United States, maybe a little bit in the UK, where Google DeepMind is housed. There's definitely folks around the world who are trying. You know, the deep seek out of China was a bit of a shock to a lot of people, I think, last December, although I could have that month wrong.

56:42

But right now, you know, this takes very, very specialized knowledge. It takes very, very specialized computer chips. You know, in data centers, as you guys were talking about, that are huge, that take electricity of a small city. You know, this, it wouldn't be that hard to find all the places where these specialized chips are made, track all these chips, find these data centers, and then make sure that they're not being used to make AI smarter. And what's last question from here? What's your sense of timeline? Like, how much time do we have to stop this? It's, it, there's a lot of ways it could go. You know, it could be that an AI in the lab tomorrow goes over some small capability level where it can start doing automated AI research and maybe everything goes fast. You know, if you are watching the difference between different types of primates, it would be very hard to tell when they're going to go over the line. between chimpanzees and humans. So for all we know, tomorrow they go over some line in the lab and the AI start improving the AIs. Or for all we know, the modern chatbot approach just doesn't go all the way. You know, we're starting to see some people, you know, chatbots are dumb in a lot of ways. Maybe the next level of scale and the next level of scale after that, the bigger and bigger ones, maybe they're not that much smarter. Maybe we have five whole years in which chatbots plateau until the researchers come up with a new insight. Maybe even that one doesn't go all the way. And then we have five more years after that until we have, you know, a third new insight. And then we get, you know, 15 years before. Right. So it's, it's very hard to say exactly. But, you know, my, my bet is that a child born today has a greater chance of dying from AI than of graduating high school. Wow. Well, um... People need to read the book. That's what I'll say. I really encourage people. It's actually, it's a quick read. It doesn't take that long to get the point. And, you know, I really appreciate you joining us and helping us understand the dangers that you see. Here's hoping I'm wrong. Yeah, let's hope. All right, guys, thank you so much for watching today. We'll be back with Friday show tomorrow, and we will see you then. We learned how to love dogs from the dogs that loved us and waited for us to get home from school. They were the dogs that raised us. We returned the love with pedigree dog food. It was good then, and it's better now. Every bowl has 100% complete nutrition, supporting six health essentials, and now it includes vitamin good bites, a nutrient boost your dog will love. Pedigree, good then, better now. It's called soccer. It's called football. Uh, soccer. Football. Domino's best deal ever lets you get any pizza, including stuffed crust, with any toppings for $9.99. Like, we can agree on that. Yeah, fully. So, pineapple? Don't ruin it. Get any pizza, including stuffed crust, with any topics for $9.99. Finally something everyone can get behind. And if the rest disagree, that's between them and Domino's. Which means the only thing left to fight over is who's ordering. Domino.

59:55

Price is higher for some locations. Excludes Excel and specialty pizzas. Select this offer from 615 to 726. Online only. Size availability varies by crust. Max seven topics. Six for pan and New York style crust. Minimum purchase required for delivery. Prices participation delivery area and charges may vary. Eminem's popped caramel do sound different. Oh, no. People are going to be obsessed. What do you mean? Hmm, people hate the sound of chewing. Maybe they won't like the crunch. Maybe we're saved. Wait a minute. Yellow. Huh? Have you been eating them this whole time? Mmm, so tasty. Hands off us. Eminem's popped caramel. It's more fun together. This is an I-Heart podcast. Guaranteed human.