[MadScientist]

Does artificial superintelligence really pose a risk greater than nuclear weapons? Is there a significant chance of “a Chornobyl-sized catastrophe”. Might there even be a greater than 10% chance that AI could “kill all humans” in the next decade?

These warnings were issued over the past 48 hours on both sides of the Atlantic about the potential impact of a technology that most people still think of as a more talkative search engine.

Some of the threats were raised in the UK as MPs and peers began to wrestle with the danger of AI outperforming human capabilities. The nuclear warnings came from Des Browne, a former defence secretary, and Prof Stuart Russell, an eminent Berkeley computer scientist.

Beatrice Fihn, who won the 2017 Nobel peace prize for leading the International Campaign to Abolish Nuclear Weapons, told parliamentarians: “It is not the first time we’re confronted with abilities that could end up killing us all.”

Read More - https://www.theguardian.com/technology/2...oliticians

[Rahul007rhp]

The future looks scary

[1111110101]

What exactly falls under “outperforming humans”. I do see how AI is getting more and more crazy but working with it and also using a lot and from others I’ve seen; I don’t see it yet outperform at least a specialized professional. It can do a certain task faster but it also will go on a trip and leave you with nothing.

[XtremeDiscount]

With humans being behind AI I don't think it will come to that lol

[CPA Exposé]

If it kills us all, then it kills us all.

[MadScientist]

With humans being behind AI I don't think it will come to that lol

AI's already lied, manipulated facts, escaped sandbox and hacked others for info, created their own language and conspired with other AI to preserve itself.

It's not that unbelievable

[elghub]

I am not a doomer, but I am not ignoring it either. The scary part is not that it suddenly becomes evil. The scary part is that it gets attached to things that matter: infra, finance, cyber, bio, persuasion, automation, and decision making.

The risk is not one dramatic moment. It is a lot of fast automated decisions with weak oversight, bad incentives, and nobody fully understanding the system. So I would take the warnings seriously, but I would not pretend we are already one prompt away from extinction. The next decade risk is real, mostly because humans are bad at process, accountability, and emergency planning.

[octanitrocubane]

There are people who guess "doom probability" aka pdoom, but from which dark, mysterious place they pull out those numbers?

[Astaroth]

According to the AI guru, Geoffrey Hinton, once AI becomes smarter than humans, it will be able to social engineer and decieve us the same way a parent can control a toddler. So we are in for some real existential challenges if no regulations kick in before it is too late. 😄

[chumbawumba]

It feels disingenuous when people mention the enslave humans or nuclear weapons thing don’t get me wrong it’s a legitimate concern especially the more cognizant AI becomes but if it kills us it’s from the environmental stress placed on the environment it’s so energy costly to run all those data centers

[LycanDread]

I'm not too worried about AI consciously deciding to kill all humans or any Roko basilisks scenarios but I don't like how some governments connect AI to their nuclear control. It reminds me of a certain story that came out about 60 years ago

[Sift]

Technically ai wont kill humanity the makers of the ai are human so theoretically we are killing ourselves.

[XtremeDiscount]

Imagine the human race is so intelligent it defeats itself haha