AIAlignmentProblem

ThoughtStorms Wiki

https://www.nature.com/articles/s41562-022-01383-x.pdf

https://arxiv.org/pdf/2209.00626.pdf

I’m scared of AGI. It's confusing how people can be so dismissive of the risks.

I’m an investor in two AGI companies and friends with dozens of researchers working at DeepMind, OpenAI, Anthropic, and Google Brain. Almost all of them are worried.

🧵
— Arram Sabeti (@arram) April 2, 2023

Transcluded from AIAndCapitalism

AI and Capitalism

Most people who worry about AI "alignment" haven't really taken seriously NickLand's point that AI and capitalism are the same thing.

For anyone on the left, the AI alignment worry (that we're building a system which will run out of control and swamp us with paper-clips) is OBVIOUSLY just Marxism 101 for people with some weird mental inhibition about admitting it.

We already built the super-human intelligence which is out-of-alignment with our welfare and interests, and is therefore turning our world into grey goo: it's called "the market".

And we're already in a fight to switch it off.

Left wingers don't worry about "the alignment problem" because we already know that humans won't be able to resist the goodies that AI offers and curb the AI's appetite. We already see humanity lacking the moral wisdom and courage in the case of capital. And in the face of the self-interested propaganda of those who benefit from it.

But rather than worry about the problem in a hypothetical (conveniently distant) future, why not face the SAME problem in the here and now?

Where it is more acute?

BillSeitz points to MikeTravers's http://omniorthogonal.blogspot.com/2013/02/hostile-ai-youre-soaking-in-it.html

Backlinks (17 items)