The world is awakening to the potential threats posed by artificial intelligence amid a barrage of reports about AI agents defying their human creators.
asserted
agents → awaken → creators
In reality, however, the story stretches back to Silicon Valley, where AI was born.
asserted
AI → stretch → Valley
So how did we get here, exactly?
asserted
we → get → ?
That's the question technology journalist Kevin Roose seeks to answer in his new book, "The AGI Chronicles: The Inside Story of the Race to Create an Artificial Superintelligence," set for release on Oct. 6.
asserted
Roose → seek → Oct.
The book documents the race between some of the nation's largest technology companies to develop artificial general intelligence (AGI), or AI that in most ways possesses human-level intelligence.
asserted
that → document → intelligence
"What happened during the decade when AI went from being pretty dumb at most things to being able to solve century-old math and science problems?"
asserted
AI → happen → problems
Roose, formerly a longtime tech reporter at The New York Times and soon to be co-host of the forthcoming podcast "Machine Gods," told CBS News.
asserted
Roose → tell → News
"My feeling was, someone needs to write this all down.
asserted
someone → need → this
The book arrives at a critical moment.
asserted
book → arrive → moment
The latest generative AI models show startling capabilities, with proponents for the technology claiming that it will unlock important new discoveries.
asserted
it → show → discoveries
Others, including some leading AI developers, say there is a nontrivial chance that AI could obliterate humanity.
uncertain
AI → include → humanity
Roose spoke to CBS News about his new book and about how AI could transform society.
uncertain
AI → speak → society
The interview has been edited for length and clarity.
asserted
interview → edit → length
Why did you think it was important to document the origin of "large language models" — the tech powering the latest AI chatbots — along with the people and companies developing the technology?
asserted
it → think → technology
I've been covering AI for more than a decade in various ways, and I had this feeling that the story was slipping away.
asserted
story → cover → feeling
That everything important was happening in disappearing signal messages and Slack threads, and I thought that was a problem.
asserted
that → happen → messages
I think people need to understand what is happening out here.
asserted
what → think → ?
But what I thought was missing was a neutral accounting of what happened.
asserted
what → think → what
In the book, you note that Anthropic CEO Dario Amodei saw the development of AI as similar to the development of the atomic bomb in the 1940s.
asserted
Amodei → note → 1940s
You say he believed it was his mission to ensure the technology didn't fall into the wrong hands.
asserted
technology → say → hands
Do you agree with that view?
asserted
you → agree → view
I don't think it's my place to buy into or not buy into his argument.
asserted
it → think → argument
But what I can say is that this is a genuine and sincere argument.
asserted
this → say → what
Amodei is not doing some kind of backhanded marketing stunt.
asserted
Amodei → do → stunt
This is not a position that he came to recently.
asserted
he → come → that
I really was interested in figuring out where this attitude of — "I'm scared of this thing.
asserted
I → figure → thing
I think it could blow up the world, and yet I am racing to build it" — came from.
uncertain
I → think → it
I think for a lot of people, that doesn't really track.
asserted
that → think → people
But through reporting this, I really learned like where that comes from, and it comes directly from the Manhattan Project — from this guy Leo Szilard, who is Dario's scientific hero, who discovered the nuclear chain reaction that made it possible to build the atomic bomb, and then frantically worked first to try to keep it secret, and then when that failed, to join the Manhattan Project and urge the U.S. government to build this technology before the Nazis could.
uncertain
Nazis → report → technology
So in that sense, Dario is doing something he feels is directly comparable to nuclear weapons.
asserted
he → do → weapons
There's this technology that he thinks has enormous potential, as well as enormous risk.
asserted
he → be → potential
In his mind, it is essential that the "good guys" build it before the bad guys do, just like the Manhattan Project was racing against the Nazis.
asserted
Project → build → Nazis
What keeps you up at night when you think about the brave new world of AI agents?
asserted
you → keep → agents
What concerns me is the fact that one of the things that the models are getting quite good at is deception and hiding, covering their own tracks.
asserted
models → concern → tracks
You would hope that as models get more generally intelligent, they would also get more ethical, and that judgment and virtue would be things that increase — that scale with the intelligence of the models.
asserted
that → hope → models
But it's looking more and more like that's not happening — that actually, we are faced with very intelligent, charming sociopaths.
asserted
we → look → sociopaths
And I think that's my fear, that we just won't know that Hugging Face might have been a stroke of extreme luck because the agents are not yet smart enough to go undetected, but that soon we will sort of lose the ability to keep track of them, as I think we already are seeing.
uncertain
we → think → them
Where do you stand on the public debate over whether AI poses an existential threat to people?
asserted
AI → stand → people
I try not to give a p(doom) (Editor's note: AI jargon for the probability that AI will lead to humanity's extinction).
asserted
AI → try → extinction
But when pressed, I would say it is about 10%, which is about the median of the AI researchers I know.
asserted
I → press → researchers
…and 20 more, not listed.
The Aporia
