Why fascism is so tempting and how your data could power it Yuval Noah Harari

Hello, everyone.

It’s a bit funny, because I did write
that humans will become digital,

but I didn’t think it will happen so fast

and that it will happen to me.

But here I am, as a digital avatar,

and here you are, so let’s start.

And let’s start with a question.

How many fascists are there
in the audience today?

(Laughter)

Well, it’s a bit difficult to say,

because we’ve forgotten what fascism is.

People now use the term “fascist”

as a kind of general-purpose abuse.

Or they confuse fascism with nationalism.

So let’s take a few minutes
to clarify what fascism actually is,

and how it is different from nationalism.

The milder forms of nationalism
have been among the most benevolent

of human creations.

Nations are communities
of millions of strangers

who don’t really know each other.

For example, I don’t know
the eight million people

who share my Israeli citizenship.

But thanks to nationalism,

we can all care about one another
and cooperate effectively.

This is very good.

Some people, like John Lennon,
imagine that without nationalism,

the world will be a peaceful paradise.

But far more likely,

without nationalism,
we would have been living in tribal chaos.

If you look today at the most prosperous
and peaceful countries in the world,

countries like Sweden
and Switzerland and Japan,

you will see that they have
a very strong sense of nationalism.

In contrast, countries that lack
a strong sense of nationalism,

like Congo and Somalia and Afghanistan,

tend to be violent and poor.

So what is fascism, and how
is it different from nationalism?

Well, nationalism tells me
that my nation is unique,

and that I have special obligations
towards my nation.

Fascism, in contrast, tells me
that my nation is supreme,

and that I have exclusive
obligations towards it.

I don’t need to care about anybody
or anything other than my nation.

Usually, of course,
people have many identities

and loyalties to different groups.

For example, I can be a good patriot,
loyal to my country,

and at the same time,
be loyal to my family,

my neighborhood, my profession,

humankind as a whole,

truth and beauty.

Of course, when I have different
identities and loyalties,

it sometimes creates conflicts
and complications.

But, well, who ever told you
that life was easy?

Life is complicated.

Deal with it.

Fascism is what happens when people try
to ignore the complications

and to make life too easy for themselves.

Fascism denies all identities
except the national identity

and insists that I have obligations
only towards my nation.

If my nation demands
that I sacrifice my family,

then I will sacrifice my family.

If the nation demands
that I kill millions of people,

then I will kill millions of people.

And if my nation demands
that I betray truth and beauty,

then I should betray truth and beauty.

For example, how does
a fascist evaluate art?

How does a fascist decide whether a movie
is a good movie or a bad movie?

Well, it’s very, very, very simple.

There is really just one yardstick:

if the movie serves
the interests of the nation,

it’s a good movie;

if the movie doesn’t serve
the interests of the nation,

it’s a bad movie.

That’s it.

Similarly, how does a fascist decide
what to teach kids in school?

Again, it’s very simple.

There is just one yardstick:

you teach the kids whatever serves
the interests of the nation.

The truth doesn’t matter at all.

Now, the horrors of the Second World War
and of the Holocaust remind us

of the terrible consequences
of this way of thinking.

But usually, when we talk
about the ills of fascism,

we do so in an ineffective way,

because we tend to depict fascism
as a hideous monster,

without really explaining
what was so seductive about it.

It’s a bit like these Hollywood movies
that depict the bad guys –

Voldemort or Sauron
or Darth Vader –

as ugly and mean and cruel.

They’re cruel even
to their own supporters.

When I see these movies,
I never understand –

why would anybody be tempted to follow
a disgusting creep like Voldemort?

The problem with evil
is that in real life,

evil doesn’t necessarily look ugly.

It can look very beautiful.

This is something that
Christianity knew very well,

which is why in Christian art,
as [opposed to] Hollywood,

Satan is usually depicted
as a gorgeous hunk.

This is why it’s so difficult
to resist the temptations of Satan,

and why it is also difficult
to resist the temptations of fascism.

Fascism makes people see themselves

as belonging to the most beautiful
and most important thing in the world –

the nation.

And then people think,

“Well, they taught us
that fascism is ugly.

But when I look in the mirror,
I see something very beautiful,

so I can’t be a fascist, right?”

Wrong.

That’s the problem with fascism.

When you look in the fascist mirror,

you see yourself as far more beautiful
than you really are.

In the 1930s, when Germans
looked in the fascist mirror,

they saw Germany as the most
beautiful thing in the world.

If today, Russians look
in the fascist mirror,

they will see Russia as the most
beautiful thing in the world.

And if Israelis look
in the fascist mirror,

they will see Israel as the most
beautiful thing in the world.

This does not mean that we are now
facing a rerun of the 1930s.

Fascism and dictatorships might come back,

but they will come back in a new form,

a form which is much more relevant

to the new technological realities
of the 21st century.

In ancient times,

land was the most important
asset in the world.

Politics, therefore,
was the struggle to control land.

And dictatorship meant that all the land
was owned by a single ruler

or by a small oligarch.

And in the modern age,
machines became more important than land.

Politics became the struggle
to control the machines.

And dictatorship meant

that too many of the machines
became concentrated

in the hands of the government
or of a small elite.

Now data is replacing
both land and machines

as the most important asset.

Politics becomes the struggle
to control the flows of data.

And dictatorship now means

that too much data is being concentrated
in the hands of the government

or of a small elite.

The greatest danger
that now faces liberal democracy

is that the revolution
in information technology

will make dictatorships
more efficient than democracies.

In the 20th century,

democracy and capitalism
defeated fascism and communism

because democracy was better
at processing data and making decisions.

Given 20th-century technology,

it was simply inefficient to try
and concentrate too much data

and too much power in one place.

But it is not a law of nature

that centralized data processing
is always less efficient

than distributed data processing.

With the rise of artificial intelligence
and machine learning,

it might become feasible to process
enormous amounts of information

very efficiently in one place,

to take all the decisions in one place,

and then centralized data processing
will be more efficient

than distributed data processing.

And then the main handicap
of authoritarian regimes

in the 20th century –

their attempt to concentrate
all the information in one place –

it will become their greatest advantage.

Another technological danger
that threatens the future of democracy

is the merger of information technology
with biotechnology,

which might result
in the creation of algorithms

that know me better than I know myself.

And once you have such algorithms,

an external system, like the government,

cannot just predict my decisions,

it can also manipulate
my feelings, my emotions.

A dictator may not be able
to provide me with good health care,

but he will be able to make me love him

and to make me hate the opposition.

Democracy will find it difficult
to survive such a development

because, in the end,

democracy is not based
on human rationality;

it’s based on human feelings.

During elections and referendums,

you’re not being asked,
“What do you think?”

You’re actually being asked,
“How do you feel?”

And if somebody can manipulate
your emotions effectively,

democracy will become
an emotional puppet show.

So what can we do to prevent
the return of fascism

and the rise of new dictatorships?

The number one question that we face
is: Who controls the data?

If you are an engineer,

then find ways to prevent too much data

from being concentrated in too few hands.

And find ways to make sure

the distributed data processing
is at least as efficient

as centralized data processing.

This will be the best
safeguard for democracy.

As for the rest of us
who are not engineers,

the number one question facing us

is how not to allow
ourselves to be manipulated

by those who control the data.

The enemies of liberal democracy,
they have a method.

They hack our feelings.

Not our emails, not our bank accounts –

they hack our feelings of fear
and hate and vanity,

and then use these feelings

to polarize and destroy
democracy from within.

This is actually a method

that Silicon Valley pioneered
in order to sell us products.

But now, the enemies of democracy
are using this very method

to sell us fear and hate and vanity.

They cannot create
these feelings out of nothing.

So they get to know our own
preexisting weaknesses.

And then use them against us.

And it is therefore
the responsibility of all of us

to get to know our weaknesses

and make sure that they
do not become a weapon

in the hands of the enemies of democracy.

Getting to know our own weaknesses

will also help us to avoid the trap
of the fascist mirror.

As we explained earlier,
fascism exploits our vanity.

It makes us see ourselves
as far more beautiful than we really are.

This is the seduction.

But if you really know yourself,

you will not fall
for this kind of flattery.

If somebody puts a mirror
in front of your eyes

that hides all your ugly bits
and makes you see yourself

as far more beautiful
and far more important

than you really are,

just break that mirror.

Thank you.

(Applause)

Chris Anderson: Yuval, thank you.

Goodness me.

It’s so nice to see you again.

So, if I understand you right,

you’re alerting us
to two big dangers here.

One is the possible resurgence
of a seductive form of fascism,

but close to that, dictatorships
that may not exactly be fascistic,

but control all the data.

I wonder if there’s a third concern

that some people here
have already expressed,

which is where, not governments,
but big corporations control all our data.

What do you call that,

and how worried should we be about that?

Yuval Noah Harari: Well, in the end,
there isn’t such a big difference

between the corporations
and the governments,

because, as I said, the questions is:
Who controls the data?

This is the real government.

If you call it a corporation
or a government –

if it’s a corporation
and it really controls the data,

this is our real government.

So the difference
is more apparent than real.

CA: But somehow,
at least with corporations,

you can imagine market mechanisms
where they can be taken down.

I mean, if consumers just decide

that the company is no longer
operating in their interest,

it does open the door to another market.

It seems easier to imagine that

than, say, citizens rising up
and taking down a government

that is in control of everything.

YNH: Well, we are not there yet,

but again, if a corporation really
knows you better than you know yourself –

at least that it can manipulate
your own deepest emotions and desires,

and you won’t even realize –

you will think this is
your authentic self.

So in theory, yes, in theory,
you can rise against a corporation,

just as, in theory, you can rise
against a dictatorship.

But in practice,
it is extremely difficult.

CA: So in “Homo Deus,” you argue
that this would be the century

when humans kind of became gods,

either through development
of artificial intelligence

or through genetic engineering.

Has this prospect of political
system shift, collapse

impacted your view on that possibility?

YNH: Well, I think it makes it
even more likely,

and more likely
that it will happen faster,

because in times of crisis,
people are willing to take risks

that they wouldn’t otherwise take.

And people are willing to try

all kinds of high-risk,
high-gain technologies.

So these kinds of crises
might serve the same function

as the two world wars in the 20th century.

The two world wars greatly accelerated

the development of new
and dangerous technologies.

And the same thing might happen
in the 21st century.

I mean, you need to be
a little crazy to run too fast,

let’s say, with genetic engineering.

But now you have more
and more crazy people

in charge of different
countries in the world,

so the chances are getting
higher, not lower.

CA: So, putting it all together, Yuval,
you’ve got this unique vision.

Roll the clock forward 30 years.

What’s your guess –
does humanity just somehow scrape through,

look back and say, “Wow,
that was a close thing. We did it!”

Or not?

YNH: So far, we’ve managed
to overcome all the previous crises.

And especially if you look
at liberal democracy

and you think things are bad now,

just remember how much worse
things looked in 1938 or in 1968.

So this is really nothing,
this is just a small crisis.

But you can never know,

because, as a historian,

I know that you should never
underestimate human stupidity.

(Laughter) (Applause)

It is one of the most powerful forces
that shape history.

CA: Yuval, it’s been an absolute delight
to have you with us.

Thank you for making the virtual trip.

Have a great evening there in Tel Aviv.

Yuval Harari!

YNH: Thank you very much.

(Applause)

大家好。

这有点好笑,因为我确实
写过人类将成为数字化,

但我没想到它会发生得这么快

,而且会发生在我身上。

但我在这里,作为一个数字化身

,你在这里,所以让我们开始吧。

让我们从一个问题开始。 今天观众

中有多少法西斯分子

(笑声)

嗯,这有点难说,

因为我们已经忘记了法西斯主义是什么。

人们现在使用“法西斯”一词

作为一种通用滥用。

或者他们将法西斯主义与民族主义混为一谈。

因此,让我们花几分钟时间
来澄清一下法西斯主义到底是什么,

以及它与民族主义有何不同。

较温和的民族主义形式
一直是人类最仁慈

的创造之一。

国家是
由数百万互不相识的陌生人

组成的社区。

例如,我不

认识拥有以色列国籍的八百万人。

但是由于民族主义,

我们都可以互相关心
并有效地合作。

这是非常好的。

有些人,比如约翰列侬,
想象没有民族主义

,世界将是一个和平的天堂。

但更有可能的是,

如果没有民族主义,
我们将生活在部落混乱中。

如果你今天看看世界上最繁荣
、最和平的国家,

像瑞典
、瑞士和日本这样的国家,

你会发现他们
有非常强烈的民族主义意识。

相比之下,
缺乏强烈民族主义意识的国家,

如刚果、索马里和阿富汗,

往往是暴力和贫穷的。

那么什么是法西斯主义,
它与民族主义有什么不同呢?

好吧,民族主义告诉我
,我的国家是独一无二的

,我
对我的国家负有特殊的义务。

相比之下,法西斯主义告诉我
,我的国家至高无上

,我对它负有专属
义务。

除了我的国家,我不需要关心任何人或任何事情。

当然,通常
人们

对不同的群体有许多身份和忠诚度。

比如,我可以做一个好的爱国者,
忠于我的国家,

同时忠于我的家人、

我的邻居、我的职业、我

的整个人类、

真与美。

当然,当我有不同的
身份和忠诚度时,

有时会产生冲突
和复杂性。

但是,好吧,谁告诉过
你生活很轻松?

生活很复杂。

处理它。

法西斯主义是当人们
试图忽略并发症

并让生活对自己来说太容易时发生的事情。

法西斯主义否认
除民族认同之外的所有认同,

并坚持我
只对我的国家负有义务。

如果我的国家
要求我牺牲我的家人,

那么我会牺牲我的家人。

如果国家
要求我杀死数百万人,

那么我将杀死数百万人。

如果我的国家
要求我背叛真理和美丽,

那么我就应该背叛真理和美丽。

例如,
法西斯如何评价艺术?

法西斯如何决定一部电影
是好电影还是坏电影?

嗯,非常非常非常简单。

真的只有一个标准:

如果电影
符合国家利益,

那就是好电影;

如果这部电影不
符合国家利益,

那就是一部糟糕的电影。

而已。

同样,法西斯主义者如何决定
在学校教孩子什么?

同样,它非常简单。

只有一个标准:

你教孩子们任何
符合国家利益的东西。

真相根本不重要。

现在,第二次世界大战
和大屠杀的恐怖使我们想起

了这种思维方式的可怕后果。

但通常,当我们
谈论法西斯主义的弊端时,

我们这样做的方式是无效的,

因为我们倾向于将法西斯主义描绘
成一个可怕的怪物,

而没有真正
解释它的魅力所在。

这有点像
那些把坏人——

伏地魔、索伦
或达斯维德——

描绘成丑陋、卑鄙和残忍的好莱坞电影。

他们甚至
对自己的支持者也很残忍。

当我看到这些电影时,
我永远不明白——

为什么有人会想追随
像伏地魔这样恶心的怪物?

邪恶的问题
在于,在现实生活中,

邪恶并不一定看起来很丑。

它可以看起来非常漂亮。

这是
基督教非常清楚的事情,

这就是为什么在基督教艺术中,
与好莱坞相反,

撒旦通常被描绘
成一个华丽的大块头。

这就是为什么
很难抵挡撒旦的诱惑,


很难抵挡法西斯的诱惑。

法西斯主义使人们认为

自己属于世界上最美丽
、最重要的东西

——民族。

然后人们会想,

“嗯,他们告诉
我们法西斯主义是丑陋的。

但是当我照镜子时,
我看到的东西很漂亮,

所以我不能成为法西斯主义者,对吧?”

错误的。

这就是法西斯主义的问题。

当你照照法西斯镜子时,

你会发现自己
远比真实的自己美丽。

1930年代,当德国人
照着法西斯的镜子时,

他们认为德国是世界上最
美丽的东西。

如果今天,俄罗斯
人照着法西斯的镜子,

他们会认为俄罗斯是世界上最
美丽的东西。

如果以色列人
照照法西斯镜子,

他们会认为以色列是世界上最
美丽的事物。

这并不意味着我们现在
正面临着 1930 年代的重演。

法西斯主义和独裁可能会卷土重来,

但它们将以一种新的形式卷土重来,

这种形式与 21 世纪

的新技术现实更加相关

在古代,

土地是世界上最重要的
资产。

因此,政治
就是控制土地的斗争。

而独裁意味着所有的
土地都归一个统治者

或一个小寡头所有。

在现代,
机器变得比土地更重要。

政治变成
了控制机器的斗争。

独裁

意味着太多的机器
集中

在政府
或少数精英手中。

现在数据正在
取代土地和机器

成为最重要的资产。

政治变成
了控制数据流的斗争。

而独裁现在

意味着太多的数据集中
在政府

或少数精英手中。

现在自由

民主面临的最大危险
是信息技术革命

将使独裁政权
比民主政权更有效率。

在 20 世纪,

民主和资本主义
击败了法西斯主义和共产主义,

因为民主更
擅长处理数据和做出决策。

鉴于 20 世纪的技术,

试图
将过多的数据

和过多的权力集中在一个地方简直是低效的。

但是

,集中式数据处理
总是

比分布式数据处理效率低,这不是自然规律。

随着人工智能
和机器学习

的兴起,在一个地方非常有效地处理
大量信息,

在一个地方做出所有决策

,集中数据处理

将比分布式数据处理更有效。

然后是

20 世纪威权政权的主要障碍——

他们试图将
所有信息集中在一个地方——

这将成为他们最大的优势。

另一个
威胁民主未来

的技术危险是信息技术
与生物技术的结合,

这可能会
导致算法的创建

比我更了解我自己。

一旦有了这样的算法

,像政府这样的外部系统

就不能仅仅预测我的决定,

它还可以操纵
我的感受和情绪。

一个独裁者可能
无法为我提供良好的医疗保健,

但他可以让我爱他

,让我恨反对派。

民主将很难
在这样的发展中生存下来,

因为最终,

民主不是建立
在人类理性的基础上的;

它是基于人类的感受。

在选举和公投期间,

你不会被问到
“你怎么看?”

你实际上被问到,
“你感觉如何?”

如果有人能
有效地操纵你的情绪,

民主就会变成
一场情绪化的木偶戏。

那么,我们能做些什么来
防止法西斯主义卷土重来

和新独裁政权的崛起呢?

我们面临的第一个问题
是:谁控制数据?

如果你是一名工程师,

那就想办法防止过多的

数据集中在过少的人手中。

并找到

确保分布式数据
处理至少

与集中式数据处理一样高效的方法。

这将是民主的最好
保障。

至于
我们这些不是工程师的人,

我们面临的第一个问题

是如何不让
自己被

控制数据的人操纵。

自由民主的敌人,
他们有办法。

他们破坏了我们的感情。

不是我们的电子邮件,不是我们的银行账户——

它们侵入了我们的恐惧
、仇恨和虚荣心,

然后利用这些感觉

从内部分化和摧毁
民主。

这实际上

是硅谷
为了向我们推销产品而开创的一种方法。

但是现在,民主的敌人
正在使用这种方法

向我们兜售恐惧、仇恨和虚荣心。

他们不能
无中生有地创造这些感觉。

所以他们会了解我们自己
先前存在的弱点。

然后用它们对付我们。

因此,我们所有人都有责任

了解我们的弱点

,并确保它们
不会

成为民主敌人手中的武器。

了解自己的弱点

也有助于我们避开
法西斯镜子的陷阱。

正如我们之前解释的那样,
法西斯主义利用了我们的虚荣心。

它让我们看到
自己比实际更美丽。

这就是诱惑。

但如果你真的了解自己,

你就不会上
当受这种奉承了。

如果有人在你眼前放了一面镜子

它隐藏了你所有丑陋的部分
,让你看到

自己比实际更美丽
、更重要

,那就

打破那面镜子。

谢谢你。

(掌声)

Chris Anderson:Yuval,谢谢。

天啊。

很高兴再次见到你。

所以,如果我理解你的话,

你是在提醒我们
注意这里的两大危险。

一个是
诱人的法西斯主义形式可能卷土重来,

但与此相近的是,独裁政权
可能并不完全是法西斯主义,

但控制着所有数据。

我想知道这里的

一些人
是否已经表达了第三个担忧

,即不是政府,
而是大公司控制我们所有的数据。

你怎么称呼它,

我们应该对此有多担心?

Yuval Noah Harari:嗯,归根结底,公司和政府
之间并没有那么大的区别

因为正如我所说,问题是:
谁控制数据?

这才是真正的政府。

如果你称它为公司
或政府——

如果它是一家公司
并且它真正控制着数据,

这就是我们真正的政府。

因此,差异
比实际更明显。

CA:但不知何故,
至少对于企业来说,

你可以想象市场机制
可以将它们取缔。

我的意思是,如果消费者只是

决定公司不再
符合他们的利益,

它确实打开了通往另一个市场的大门。

想象这似乎

比公民
起来推翻一个

控制一切的政府更容易。

YNH:嗯,我们还没有,

但是如果一家公司真的
比你自己更了解你——

至少它可以操纵
你自己最深的情感和欲望,

而你甚至不会意识到——

你会 认为这是
你真实的自我。

所以理论上,是的,理论上,
你可以反抗公司,

就像理论上,你可以
反抗独裁。

但在实践中,
这是极其困难的。

CA:所以在“Homo Deus”中,你
认为这将是

人类成为神的世纪,

无论是通过
人工智能的发展

还是通过基因工程。

这种政治
体系转变、崩溃的前景是否

影响了你对这种可能性的看法?

YNH:嗯,我认为这使它
更有可能发生,

而且更有
可能发生得更快,

因为在危机时期,
人们愿意承担

他们原本不会承担的风险。

人们愿意尝试

各种高风险、
高收益的技术。

因此,这类危机
可能

与 20 世纪的两次世界大战具有相同的作用。

两次世界大战极大地加速

了新
的危险技术的发展。

同样的事情也可能发生
在 21 世纪。

我的意思是,你需要
有点疯狂才能跑得太快,

比如说,基因工程。

但是现在你有
越来越多的疯狂的

人负责世界上不同的
国家,

所以机会越来越
高,而不是越来越低。

CA:所以,综合起来,Yuval,
你有这个独特的愿景。

将时钟向前滚动 30 年。

你的猜测是什么
——人类是否只是以某种方式勉强通过,

回头看,然后说,“哇,
这是一件很接近的事情。我们做到了!”

或不?

YNH:到目前为止,我们已经
成功克服了之前的所有危机。

尤其是如果你
看看自由民主

,你认为现在情况很糟糕,

请记住
1938 年或 1968 年的情况有多糟糕。

所以这真的没什么,
这只是一场小危机。

但你永远不会知道

,因为作为历史学家,

我知道你永远不应该
低估人类的愚蠢。

(笑声) (掌声)

它是塑造历史的最强大力量
之一。

CA:Yuval,很
高兴有你和我们在一起。

感谢您进行虚拟旅行。

在特拉维夫度过一个美好的夜晚。

尤瓦尔·哈拉里!

YNH:非常感谢。

(掌声)