What would happen if we upload our brains to computers Robin Hanson

Someday, we may have robots
as smart as people,

artificial intelligence, AI.

How could that happen?

One route is that we’ll just keep
accumulating better software,

like we’ve been doing for 70 years.

At past rates of progress,
that may take centuries.

Some say it’ll happen a lot faster

as we discover grand new
powerful theories of intelligence.

I’m skeptical.

But a third scenario

is what I’m going to talk about today.

The idea is to port the software
from the human brain.

To do this, we’re going to need
three technologies to be good enough,

and none of them are there yet.

First, we’re going to need
lots of cheap, fast, parallel computers.

Second, we’re going to need
to scan individual human brains

in fine spatial and chemical detail,

to see exactly what cells are where,
connected to what, of what type.

And third, we’re going to need
computer models

of how each kind of brain cell works –

taking input signals,
changing interval state

and sending output signals.

If we have good enough models
of all the kinds of brain cells

and a good enough model of the brain,

we can put it together to make
a good enough model of an entire brain,

and that model would have the same
input-output behavior as the original.

So if you talk to it, it might talk back.

If you ask it to do things,
it might do them.

And if we could do that,
everything would change.

People have been talking
about this idea for decades,

under the name of “uploads.”

I’m going to call them “ems.”

When they talk about it, they say,

“Is this even possible?

If you made one, would it be conscious?
Or is it just an empty machine?

If you made one of me,
is that me or someone else?”

These are all fascinating questions
that I’m going to ignore …

(Laughter)

because I see a neglected question:

What would actually happen?

I became obsessed with this question.

I spent four years trying to analyze it,

using standard academic tools,
to guess what would happen,

and I’m here to tell you what I found.

But be warned –

I’m not offering inspiration,
I’m offering analysis.

I see my job as telling you
what’s most likely to happen

if we did the least to avoid it.

If you aren’t at least a bit disturbed
by something I tell you here,

you’re just not paying attention.

(Laughter)

OK, the first thing I can tell you

is that ems spend most
of their life in virtual reality.

This is what you might look like
if you were using virtual reality.

And this is what you might see:

sunlight glinting off of water,
you might hear gulls flying above,

you might even feel the wind
on your cheeks or smell seawater,

with advanced hardware.

Now, if you were to spend
a lot of time here,

you might want a dashboard

where you could do things like
make a phone call,

move to a new virtual world,

check your bank account.

Now, while this is what
you would look like in virtual reality,

this is what an em
would look like in virtual reality.

It’s computer hardware
sitting in a server rack somewhere.

But still, it could see
and experience the same thing.

But some things are different for ems.

First, while you’ll probably always notice
that virtual reality isn’t entirely real,

to an em, it can feel as real to them
as this room feels to you now

or as anything ever feels.

And ems also have
some more action possibilities.

For example, your mind just always
runs at the same speed,

but an em can add more or less
computer hardware to run faster or slower,

and therefore, if the world around them
seems to be going too fast,

they can just speed up their mind,

and the world around them
would seem to slow down.

In addition, an em can make
a copy of itself at that moment.

This copy would remember
everything the same,

and if it starts out with the same speed,
looking at the same speed,

it might even need to be told,
“You are the copy.”

And em could make archive copies,

and with enough archives,

an em can be immortal –

in principle, though not
usually in practice.

And an em can move its brain,
the computer that represents its brain,

from one physical location to another.

Ems can actually move around the world
at the speed of light,

and by moving to a new location,

they can interact more quickly
with ems near that new location.

So far, I’ve been talking about
what ems can do.

What do ems choose to do?

To understand that, we’ll need
to understand three key facts.

First, ems by definition do what
the human they emulate would do

in the same situation.

So their lives and behavior
are very human.

They’re mainly different because
they’re living in a different world.

Second, ems need
real resources to survive.

You need food and shelter or you’ll die.

Also, ems need computer hardware,
energy, cooling, or they can’t exist.

For every subjective minute
that an em experiences,

someone, usually that em,
had to work to pay for it.

Third, ems are poor.

(Laughter)

The em population can grow
quicker than the em economy,

so that means wages fall down
to em subsistence levels.

That means ems have to be working
most of the time.

So that means
this is what ems usually see:

beautiful and luxurious, but desks –

they’re working most of the time.

Now, a subsistence wage scenario,
you might think, is exotic and strange,

but it’s actually the usual case
in human history,

and it’s how pretty much
all wild animals have ever lived,

so we know what humans do
in this situation.

Humans basically do
what it takes to survive,

and this is what lets me say
so much about the em world.

When creatures are rich, like you,

you have to know a lot
about what they want

to figure out what they do.

When creatures are poor,

you know that they mostly do
what it takes to survive.

So we’ve been talking about the em world
from the point of view of the ems –

now, let’s step back
and look at their whole world.

First, the em world grows
much faster than ours,

roughly a hundred times faster.

So the amount of change
we would experience in a century or two,

they would experience in a year or two.

And I’m not really willing to project
this age much beyond that,

because plausibly by then something else
will happen, I don’t know what.

Second, the typical emulation
runs even faster,

roughly a thousand times human speed.

So for them, they experience
thousands of years in this year or two,

and for them, the world around them
is actually changing more slowly

than your world seems to change for you.

Third, ems are crammed together
in a small number of very dense cities.

This is not only how they see
themselves in virtual reality,

it’s also how they actually are
physically crammed together.

So at em speeds, physical travel
feels really painfully slow,

so most em cities are self-sufficient,

most war is cyber war,

and most of the rest of the earth
away from the em cities

is left to the humans, because the ems
really aren’t that interested in it.

Speaking of humans,

you were wanting to hear about that.

Humans must retire, at once, for good.

They just can’t compete.

Now, humans start out owning
all of the capital in this world.

The economy grows very fast,
their wealth grows very fast.

Humans get rich, collectively.

As you may know, most humans today
don’t actually own that much

besides their ability to work,

so between now and then,
they need to acquire sufficient assets,

insurance or sharing arrangements,

or they may starve.

I highly recommend avoiding this outcome.

(Laughter)

Now, you might wonder,

why would ems let humans exist?

Why not kill them, take their stuff?

But notice we have many
unproductive retirees around us today,

and we don’t kill them
and take their stuff.

(Laughter)

In part, that’s because it would disrupt
the institutions we share with them.

Other groups would wonder who’s next,

so plausibly, ems may well let humans
retire in peace during the age of em.

You should worry more that
the age of em only lasts a year or two

and you don’t know what happens next.

Ems are very much like humans,

but they are not like the typical human.

The typical em is a copy
of the few hundred most productive humans.

So in fact, they are as elite,
compared to the typical human,

as the typical billionaire,
Nobel Prize winner,

Olympic gold medalist, head of state.

Ems look on humans
perhaps with nostalgia and gratitude,

but not so much respect,

which is, if you think about it,
how you think about your ancestors.

We know many things about how humans
differ in terms of productivity.

We can just use those
to predict features of ems –

for example, they tend to be smart,
conscientious, hard-working,

married, religious, middle-aged.

These are features of ems.

Em world also contains enormous variety.

Not only does it continue on with most
of the kinds of variety that humans do,

including variety of industry
and profession,

they also have many new kinds of variety,

and one of the most important
is mind speed.

Ems can plausibly go from human speed

up to a million times
faster than human speed,

and down to a billion times
slower than human speed.

Faster ems tend to have
markers of high status.

They embody more wealth.
They win arguments.

They sit at premium locations.

Slower ems are mostly retirees,

and they are like the ghosts
of our literature.

If you recall, ghosts are all around us –

you can interact with them
if you pay the price.

But they don’t know much,
they can’t influence much,

and they’re obsessed with the past,
so what’s the point?

(Laughter)

Ems also have more variety
in the structure of their lives.

This is your life: you start
and you end, really simple.

This is the life of an em,

who every day splits off
some short-term copies

to do short-term tasks and then end.

We’ll talk more about
those short term versions in a moment,

but they are much more efficient

because they don’t have to rest
for the next day.

This em is more opportunistic.

They make more copies of themselves
when there’s more demand for that.

They don’t know which way
the future’s going.

This is an em designer,

who conceives of a large system

and then breaks recursively into copies
who elaborate that,

so ems can implement
larger, more coherent designs.

This an emulation plumber

who remembers that every day,
for the last 20 years,

they only ever worked
two hours a day, a life of leisure.

But what really happened is,
every day they had a thousand copies,

each of whom did a two-hour plumbing job,

and only one of them
went on to the next day.

Objectively, they’re working
well over 99 percent of the time.

Subjectively, they remember
a life of leisure.

(Laughter)

This, again, is you.
You start and you end.

This could be you
if at the start of party,

you took a drug that meant
you would not remember that party

ever after that day.

Some people do this, I’m told.

Toward the end of the party,

will you say to yourself,
“I’m about to die, this is terrible.

That person tomorrow isn’t me,
because they won’t remember what I do.”

Or you could say, “I will go on tomorrow.
I just won’t remember what I did.”

This is an em who splits off
a short-term copy

to do a short-term task and then end.

They have the same two
attitude possibilities.

They can say, “I’m a new short-term
creature with a short life. I hate this.”

Or “I’m a part of a larger creature
who won’t remember this part.”

I predict they’ll have
that second attitude,

not because it’s philosophically correct,
but because it helps them get along.

Today, if the president says
we must invade Iraq,

and you say, “Why?”

and they say, “State secret,”

you’re not sure if you can trust them,

but for ems, a copy of the president
and a copy of you can go inside a safe,

explain all their secret reasons,

and then one bit comes out
from your copy to yourself,

telling you if you were convinced.

So now you can know
there is a good reason.

I know you guys are all eager
to evaluate this world.

You’re eager to decide
if you love it or hate it.

But think: your ancestors
from thousands of years ago

would have loved or hated your world

based on the first few things
they heard about it,

because your world
is really just weird.

So before judging a strange future world,
you should really learn a lot about it,

maybe read a whole book about it,

and then, if you don’t like it,
work to change it.

Thank you.

(Applause)

有一天,我们可能会拥有
像人一样聪明的机器人、

人工智能、人工智能。

怎么会这样?

一种方法是我们将继续
积累更好的软件,

就像我们 70 年来一直在做的那样。

按照过去的发展速度,
这可能需要几个世纪的时间。

有人说,

随着我们发现新的
强大的智能理论,它会发生得更快。

我很怀疑。

但是第三种情况

是我今天要讨论的。

这个想法是
从人脑移植软件。

要做到这一点,我们需要
三种足够好的技术

,但目前还没有。

首先,我们需要
大量廉价、快速、并行的计算机。

其次,我们需要

以精细的空间和化学细节扫描人脑,

以准确了解哪些细胞在哪里,
与什么相关联,属于什么类型。

第三,我们将需要

每种脑细胞如何工作的计算机模型——

接收输入信号、
改变间隔状态

和发送输出信号。

如果我们有足够好的
各种脑细胞

模型和足够好的大脑模型,

我们可以将它们组合在一起,制作
出足够好的整个大脑模型,

并且该模型将具有相同的
输入输出行为 原本的。

所以如果你和它说话,它可能会回嘴。

如果你要求它做事,
它可能会做。

如果我们能做到这一点,
一切都会改变。

几十年来,人们一直在

以“上传”的名义谈论这个想法。

我将称它们为“ems”。

当他们谈论它时,他们会说,

“这甚至可能吗?

如果你制造了一个,它会是有意识的吗?
或者它只是一台空机器?

如果你制造了一个我,
是我还是其他人?”

这些
都是我将忽略的有趣问题……

(笑声)

因为我看到了一个被忽略的问题:

实际会发生什么?

我开始沉迷于这个问题。

我花了四年时间尝试分析它,

使用标准的学术工具
,猜测会发生什么

,我在这里告诉你我的发现。

但请注意——

我不是在提供灵感,
而是在提供分析。

我认为我的工作是告诉你如果
我们尽量避免它,最有可能发生的事情

如果你对
我在这里告诉你的事情没有一点不安,那

你只是没有注意。

(笑声)

好吧,我可以告诉你的第一件事

是,ems
大部分时间都在虚拟现实中度过。

如果您使用虚拟现实,这就是您的样子。

这就是你可能会看到的:

阳光从水面上闪烁,
你可能会听到海鸥在上面飞翔,

你甚至可能会感觉到
脸颊上的风或闻到海水的味道,这些

都是先进的硬件。

现在,如果你
要花很多时间在这里,

你可能想要一个仪表板

,你可以在其中做一些事情,比如
打电话、

转移到一个新的虚拟世界、

检查你的银行账户。

现在,虽然这是
您在虚拟现实中的样子,

但这
是虚拟现实中 em 的样子。

它是
位于某处服务器机架中的计算机硬件。

但是,它仍然可以看到
和体验同样的事情。

但是对于ems,有些事情是不同的。

首先,虽然你可能总是会
注意到虚拟现实并不完全真实,但

对他们来说,它对他们的
感觉就像这个房间对你现在的感觉

或任何东西对他们的感觉一样真实。

而且ems还有
一些更多的行动可能性。

例如,你的大脑总是
以相同的速度运行,

但一个 em 可以添加或多或少的
计算机硬件来运行得更快或更慢

,因此,如果他们周围的世界
似乎过快,

他们可以加快他们的速度。 心,

他们周围的世界
似乎慢了下来。

此外,一个 em 可以
在那个时刻复制自己。

这个副本会记住
所有的东西

,如果它以同样的速度开始,
看着同样的速度,

甚至可能需要告诉它,
“你就是副本”。

并且 em 可以制作存档副本,

并且有了足够的存档

,em 可以是不朽的

——原则上,尽管
在实践中通常不会。

一个 em 可以移动它的大脑,
即代表它大脑的计算机,

从一个物理位置移动到另一个物理位置。

Ems 实际上可以以光速在世界各地移动

并且通过移动到新位置,

它们可以更快地
与该新位置附近的 em 交互。

到目前为止,我一直在谈论
ems 可以做什么。

ems选择做什么?

要理解这一点,我们
需要了解三个关键事实。

首先,根据定义,ems
会做他们模仿的人类

在相同情况下会做的事情。

所以他们的生活和行为
非常人性化。

他们之所以不同,主要是因为
他们生活在一个不同的世界。

其次,ems需要
真正的资源才能生存。

你需要食物和住所,否则你会死的。

此外,ems 需要计算机硬件、
能源、冷却,否则它们就无法存在。

对于一个 em 经历的每一个主观的分钟

某人,通常是那个 em,
必须工作来为此付出代价。

第三,ems很差。

(笑声)

新兴经济体的人口增长速度比新兴经济体的增长速度更快,

因此这意味着工资下降
到维持生计的水平。

这意味着 em 必须大部分时间都在工作

所以这意味着
这是ems通常看到的:

美丽而豪华,但桌子——

它们大部分时间都在工作。

现在,
你可能会认为,维持生计工资的情景是异国情调和奇怪的,

但这实际上
是人类历史上常见的情况,

几乎
所有野生动物都曾这样生活过,

所以我们知道人类
在这种情况下会做什么。

人类基本上
做了生存所需的一切

,这就是让我
对 em 世界说这么多的原因。

当生物像你一样富有时,

你必须对
它们

想弄清楚它们做什么有很多了解。

当生物很穷时,

你知道他们大多会
做生存所需的一切。

所以我们一直在从 em
的角度讨论 em 世界——

现在,让我们退后一步
,看看他们的整个世界。

首先,新兴市场的增长
速度比我们的快得多,

大约快了一百倍。

因此,
我们在一两个世纪内将经历的变化,

他们将在一两年内经历。

而且我真的不愿意把
这个年龄预测得更远,

因为到那时可能
会发生其他事情,我不知道会发生什么。

其次,典型的仿真
运行速度更快,

大约是人类速度的一千倍。

所以对他们来说,这一两年他们经历了
数千年,

而对他们来说,他们周围的世界
实际上变化的速度

比你的世界似乎对你的变化要慢。

第三,ems挤
在少数非常密集的城市。

这不仅是他们
在虚拟现实中看待

自己的方式,也是他们
实际挤在一起的方式。

所以在 em 速度下,物理旅行
感觉非常缓慢,

所以大多数 em 城市是自给自足的,

大多数战争是网络战争,

地球上
远离 em 城市的大部分地区

都留给了人类,因为 em
真的 对它不感兴趣。

说到人类,

你想听听。

人类必须立即退休,永远退休。

他们只是无法竞争。

现在,人类开始拥有
这个世界上所有的资本。

经济增长非常快,
他们的财富增长非常快。

人类集体致富。

你可能知道,今天的大多数人除了工作能力之外
实际上并没有那么多东西

所以从现在到那时,
他们需要获得足够的资产、

保险或共享安排,

否则他们可能会挨饿。

我强烈建议避免这种结果。

(笑声)

现在,你可能想知道,

为什么 ems 会让人类存在?

为什么不杀了他们,拿走他们的东西?

但是请注意,
今天我们周围有许多没有生产力的退休人员

,我们不会杀死他们
并拿走他们的东西。

(笑声

) 部分原因是它会破坏
我们与他们共享的机构。

其他团体会想知道谁是下一个,

如此合理地,ems 很可能让人类
在 em 时代平静地退休。

你应该更担心
他们的年龄只持续一两年

,你不知道接下来会发生什么。

Ems非常像人类,

但它们不像典型的人类。

典型的 em
是几百个最有生产力的人类的复制品。

所以事实上,
与典型的人类相比,他们是精英,

是典型的亿万富翁、
诺贝尔奖获得者、

奥运会金牌得主、国家元首。

Ems 看待人类
也许怀着怀旧和感激之情,

但没有那么尊重

,也就是说,如果你想一想,
你会如何看待你的祖先。

我们知道很多关于人类
在生产力方面的差异的事情。

我们可以用这些
来预测 ems 的特征——

例如,他们往往是聪明的、
认真的、勤奋的、

已婚的、宗教的、中年人。

这些是 ems 的特点。

Em 世界也包含巨大的多样性。

它不仅延续
了人类所做的大多数

种类,包括行业
和职业的种类,

他们还有许多新的种类

,其中最重要的
一种是思维速度。

Ems 可以合理地从人类速度

上升到
比人类速度快 100 万倍,

并下降到
比人类速度慢 10 亿倍。

较快的 em 往往具有
较高地位的标记。

他们体现了更多的财富。
他们赢得争论。

他们坐在优质的位置。

较慢的 em 大多是退休人员

,他们就像
我们文学中的幽灵。

如果你还记得,幽灵就在我们身边——如果你付出代价,

你就可以与它们互动

但是他们知道的不多,
影响不了多少,

而且还沉迷于过去
,那又有什么意义呢?

(笑声)

Ems
的生活结构也更加多样化。

这就是你的生活:你开始
,你结束,真的很简单。

这就是 em 的生活,

每天都分出
一些短期

副本做短期任务,然后结束。

我们稍后会更多地讨论
这些短期版本,

但它们效率更高,

因为它们不必
在第二天休息。

这个 em 更投机取巧。 当有更多需求时,

他们会制作更多自己的副本

他们不
知道未来会走向何方。

这是一个 em 设计师,

他构想了一个大型系统

,然后递归地分解成副本
并详细说明,

因此 em 可以实现
更大、更连贯的设计。

这个仿真水管

工记得
,在过去的 20 年里,

他们每天只工作
两个小时,过着悠闲的生活。

但真正发生的是,
他们每天有一千份,

每人做了两个小时的管道工作

,只有一个
继续到第二天。

客观地说,他们在
超过 99% 的时间里工作得很好。

主观上,他们记得
悠闲的生活。

(笑声)

这又是你。
你开始,你结束。

如果在派对开始时,

你服用了一种药物,这意味着
你在那天之后永远不会记得那个派对,这可能就是你

有人告诉我,有些人会这样做。

在聚会快结束时,

你会不会对自己说:
“我快死了,这太可怕了。

明天的那个人不是我,
因为他们不会记得我做了什么。”

或者你可以说,“我明天继续。
我只是不记得我做了什么。”

这是一个将
短期副本拆分

出来做短期任务然后结束的em。

他们有同样的两种
态度可能性。

他们可以说,“我是一个新的短命
的短期生物。我讨厌这个。”

或者“我是一个更大的生物的一部分,
他不会记得这部分。”

我预测他们
会有第二种态度,

不是因为它在哲学上是正确的,
而是因为它有助于他们相处。

今天,如果总统说
我们必须入侵伊拉克,

而你说,“为什么?”

他们说,“国家机密”,

你不确定你是否可以信任他们,

但对于 ems,总统
的副本和你的副本可以进入保险箱,

解释他们所有的秘密原因,

然后一点
从你的副本中出来给你自己,

告诉你你是否被说服了。

所以现在你可以知道
这是有充分理由的。

我知道你们都
渴望评价这个世界。

你急于决定
是爱它还是恨它。

但是想一想:你
几千年前的祖先

会根据他们听到的最初几件事来爱或恨你的世界

因为你的
世界真的很奇怪。

所以在判断一个陌生的未来世界之前,
你应该真正

了解它,也许读一整本书

,然后,如果你不喜欢它,就
努力改变它。

谢谢你。

(掌声)