Suppose you had a super intelligent AI whose only goal was to make as many paperclips as possible.

设想你有一个无比聪明的人工智能机器人，它的唯一目标就是制造尽可能多地回纹针。

What about number two, with the paperclips? It sounds tame enough.

第二个用曲别针的怎么样？听起来没什么危险。

I don't recommend eating paperclips, but toss them in water and they sink.

我不建议吃回形针，但将它们扔进水中，它们会下沉。

They might also use up the resources needed for the manufacturing of more paperclips.

他们也可能会用尽制造更多回形针所需的资源。

Now this one is called 'Unusual Measures of Lengths', and you basically use lots of paperclips.

现在这个叫做“不同寻常的长度测量”，基本上，你会用到很多曲别针。

For each 25 minutes of writing, move a paperclip.

每写作 25 分钟，就移动一个回形针。

Human bodies consist of atoms and those atoms could be used to make a lot of really nice paperclips.

而恰好人类身体中的原子能够制造出非常好的回纹针。

He replaced a missing button with a paperclip.

扣子掉了一个他就拿曲别针代替。

… and even use atoms from human bodies to turn them into paperclips! Now that’s a horror story, Rob.

甚至使用人体内的原子，将人类变为回纹针！这是个惊悚的故事，罗伯。

“Don't staple manuscripts, ” the postscript read. “Loose pages plus paperclip equal correct way to submit copy.”

附言写的是“勿将手稿装订，正确投稿方式是散页加曲别针。”

So why not use them to make paperclips?

那么为什么不用它们来制作回形针呢？

Over here, the government owns every bit of capital, down to the last office paperclip.

在这里，政府拥有每一点资本，包括最后一个办公室回形针。

Yeah, the batteries, the paperclips, the tape, the pencils, odds and ends, just random stuff.

是的，电池、回形针、胶带、铅笔、零碎的东西， 都是随机的东西。

Eventually, the entire planet becomes paperclips, and then, the entire universe.

最终，整个星球变成回形针，然后，整个宇宙。

It contained the usual typed pages held together with a paperclip.

它包含用回形针固定在一起的常用打印页面。

In a famous thought experiment proposed by Nick Bostrom, AI was asked to produce and maximize paperclips.

在尼克·博斯特罗姆提出的一个著名的思想实验中，人工智能被要求生产并最大化回形针。

Now this one is called " Unusual Measures of Lengths" , and you basically use lots of paperclips.

现在这个叫做“不寻常的长度测量”，你基本上使用了很多曲别针。

The other one is the paperclip maximizer.

另一种是回形针最大化器。

But you're still worried that AI might turn you into paperclips, because it might have the wrong values.

但你仍然担心人工智能可能会把你变成回形针，因为它可能有错误的价值观。

So, the Roko's basilisk and the paperclip maximizers are both boogeymen of the AI doomers.

因此，洛科蛇怪和回形针最大化器都是人工智能毁灭者的恶魔。