Searching for a child in a private world.

[Music]

[Applause]

there are some things you can’t unsee

i’ve worked in the field of child sexual

abuse for eight years

as part of the thorn team we build

technology to defend kids from sexual

abuse

so i’ve made personal decisions about

what i know

and what i sometimes have to see and i

work alongside

incredibly brave officers who have to

see the

unimaginable every day as they search

for these kids

i don’t need you to ever see it but i do

need you to know about it

and i’m going to share something with

you today that i’m carrying and i’m

going to give it to you

so that we carry it together for them

the kids who are very much a part of our

lives but are not part of this

conversation

what i’m about to share with you is hard

to hear

a few months ago law enforcement

contacted us about a case they were

working

it’s never a good sign when they reach

out to us directly

because it usually means that the abuse

is quite severe

and that was true in this instance

a father is raping his daughter

and putting the images and videos online

he is taking precautions to not get

caught

their one clue is they think it may be

in the u.s

his daughter looks to be about two or

three years old

for the purposes of our conversation

today

i think it’s important we give her a

name we’ll call her marie

marie is a human being

i have seen marie’s face it’s something

i will never

unsee right now

on march 21 2021

if every major tech platform ran marie’s

face

against their data the chances are they

would probably find her

in a non-abuse photo and that would end

this nightmare for marie but here’s why

this is such a challenging

conversation there are reasons

privacy reasons legal reasons even some

technical

reasons for why we can’t do that today

and intellectually i accept those

reasons

but it just doesn’t feel right

it doesn’t feel right because we as

adults have made certain

decisions while she as a child has

continued to be abused

when i meet marie in the future and she

sits across from me

and says did you do everything you could

to help me to find me

what would i say

we must fiercely guard our right to

privacy

it is incredibly important but we must

also fiercely guard one of our greatest

resources

our children we often say

you can be or you can have all these

three things

you can want more privacy online you can

want to protect children online

and you can use technology you don’t

have to choose i am here today to share

with you the idea

that privacy is a continuum

it’s not an all or nothing proposition

it’s not an on or off switch and if we

are wanting to create a world where we

have more privacy online

and protect kids we’re going to have to

strike that balance

and we’re going to have to work hard to

do it

i am sharing this with you today because

we are going to signal to you

the users of these technologies every

day

that you’re going to have to make

decisions along this continuum

as part of this process

people often say to us isn’t it obvious

that people can’t share child

pornography online and we call child

pornography

child sexual abuse material because that

is what it

actually is is the evidence or

documentation of a child’s abuse

and the answer right now is currently

yes

right now most companies can detect

child sexual abuse content

but as we move to more private

environments without the right technical

solutions

we may lose sight of it

how do we get here how has there been

such a strong swing towards privacy or

why has that happened

people are upset our privacy has been

violated and we’ve seen that play out in

so many ways in our lives over the last

few years

so in response to that companies are

making a major course correction

and they are trying to provide you the

user with more private environments

more secure environments more trusted

environments now

and that generally is a good thing it’s

a great thing

and it can be a great thing for kids too

if it’s doing things like

protecting their data not disclosing

their geolocation

etc however what’s not

often talked about in the privacy

conversation

is who loses out who isn’t protected

as in those private environments and i’m

going to use encryption

as an example encryption will absolutely

protect activists organizing against

oppressive regimes

and allow them to connect and organize

encryption will also protect someone

sharing marie’s abuse video with someone

else and encouraging others to abuse

children in the same way and it will

make it harder to find those kids

both realities are true

we have to acknowledge that instead of

trying

to only highlight one or the other

we’re gonna have to be smarter than that

and we’re gonna have to find that

balance where we can protect

both that’s the goal

what’s interesting about this

conversation is that defining children’s

rights

often lags behind that of adults

and you see this in in the history

a friend of mine who’s a human rights

lawyer said to me a few years ago

privacy is not always inherently good

for children

and i thought about this more children

are often abused in private spaces

thinking back on the days where child

abuse was something that happened in the

home that was for the family to figure

out and not discussed out in public

in fact it wasn’t until the 1960s here

in the us

when dr henry kent published a medical

paper called

the battered child which included x-rays

that demonstrated what physical child

abuse

looked like on child’s bodies that we

started to

use the term child abuse in conversation

before that it was thought of as

uncommon and not a regular

issue mandatory reporting laws

here in the united states so when

doctors teachers

caregivers social workers are are

asked to and have to report suspected

child abuse

didn’t come into place until the late

1970s here in the u.s

this is a relatively new field of

defining

child children’s rights separate of

their parents

and decades later as we’ve made progress

on this front

we’re going to have to do it all over

again in defining what children’s rights

are

in the online world and the really scary

thing is we’re really far behind

2020 taught and showed us so many things

but one of the things that made clear is

that children are living

on the internet we saw a 97

increase in online enticement reports

last year to the national center for

missing and exploited children

online enticement is when an adult will

befriend a child

and either groom them to perform a

sexual act

to extort them for a naked photo or even

to groom them to meet up in person to

abuse them

so we saw an uptick in these reports

last year

at the same time because children

weren’t out in the physical world

mandatory reports went down because kids

weren’t seeing doctors teachers social

workers coaches

other parents who might be able to

report suspected child abuse

so as kids became more isolated in the

physical world

they also became less protected in the

online world

that’s a pretty dangerous combination

so how are we going to do this how are

we going to define

children’s rights and how we’re going to

hold them

equal to everyone’s rights online and

strike that balance between

privacy and child protection well first

we’re going to need innovation

technology is a major character in this

story

and again i’ll use encryption as an

example

right now most companies can and have

been

successfully detecting child sexual

abuse content

on their platforms because they are not

encrypted

what’s happening now is as companies

move towards more private environments

we’re concerned that we might lose sight

of that abuse

you’ll actually see this play out in

conversation between abusers

where they’ll say don’t go to x platform

and try and groom a child there it’s not

secure

you will be caught isn’t that what we

want

don’t we want the internet to be a

hostile

environment for this kind of abuse so as

more environments move towards

encryption

companies will no longer be able to

detect child sexual abuse material

and this is where we’re really concerned

an example of this is facebook

they have been a super reporter for

years

to their credit they’ve looked for it

they’ve found it and they’ve reported it

they had over 20 million reports to the

national center for missing exploited

children last year

when facebook encrypts messenger at the

end of this year

close to 70 or what they estimate to be

around 70

of those reports will no longer be able

to be seen

that’s scary it’s also really important

to mention

that there are companies who’ve been

encrypted who have never searched for

this content

so how are we going to solve this what

is the solution

well it’s a technical problem it’s a

policy problem

it’s really just a good old-fashioned

problem that needs smart people to come

together

and figure out the answer and the good

news is there are technologists

and policy makers all over the world who

want to solve for this

if we are about to have a hotel orbit

around the moon in a few years time

we created five vaccines and under a

year to flight to fight a global

pandemic

we can absolutely figure out a way to

surgically detect child sexual abuse

content

in encrypted environments or in private

environments

the answer is not don’t encrypt

the answer is we’re going to have to

work harder to make that private

environment

safe for everyone

the second thing we’re going to need is

you you listening

where do you fall into all this where do

you come into play

well as i mentioned before we all want

more privacy online and we

saw this play out in market research

that we did last year where we

asked a swath of americans do you want

more privacy on the internet

and the vast majority said yes what was

really interesting is

as you dive into how that actually

plays out in real life there’s a

disconnect between

wanting privacy and realizing what that

means so we would also ask people

about encryption only 10 percent

responded saying they knew a lot about

encryption

24 with very little or somewhat

this decision of how you gain more

privacy on these

on this platforms has been made for you

without a full disclosure about what the

tradeoffs are

when you click a box to say yes i want

more privacy on this platform

you’re not thinking i’m making it harder

to find kids like marie

you’re thinking about protecting you and

your family

so until we’re open and honest about

the full spectrum of trade-offs that

happen here

we’re not going to find a solution

that’s balanced because i guarantee you

the solution is not sitting at one of

the either ends of this continuum

there’s a final point to make today

which is really important

which is that we believe in privacy for

all

including the children who are in the

images and videos

we must acknowledge that every time

marie’s

image or video is shared her privacy

is being violated by not

acknowledging that the privacy of the

children in these images and photos is

happening now

we are robbing them of their privacy as

a future adult

we know that these images and videos

will never

go away but we have to make the promise

to them that we will do

everything in our power that they not

see the light of day

they go on to haunt these kids for the

rest of their lives

trying to remove them and acknowledging

that that is a breach in their privacy

is the least we can do

so when i think back to if i were to

meet marie

in the future and she was to say

did you do everything you could

right now i would have to say no

and i’d say no because we haven’t done

the work

to figure out those balance solutions

it’s hard and it’s never been done

before

but we’re gonna have to do it

for me personally if i was using an

encrypted platform

i would be okay knowing that they’re

looking for child sexual abuse in that

environment

but i recognize that’s a controversial

thing for me to say

and i respect you if you disagree with

that or if that’s not true for you

but we have to have these open and

honest conversations if we’re going to

figure this out

because there is absolutely a world

where we can protect our privacy online

and we can find marie faster we just

have to build it

thank you

you

[音乐]

[掌声]

有些事情你无法忽视

我在儿童性虐待领域工作

了八年,

作为 thorn 团队的一员,我们

开发了保护孩子免受性虐待的技术,

所以我把个人 关于

知道什么以及我有时必须看到什么的决定,我

非常勇敢的军官一起工作

,他们每天在

寻找这些孩子时必须看到难以想象的

事情我不需要你看到它,但我确实

需要你知道 关于它

,我今天要与你们分享一些

我随身携带的东西,我

将把它交给你们,

以便我们为他们一起携带它

,孩子们是我们生活的一部分,

但不是

几个月前,执法部门

就他们

正在处理的

一个

案件联系了我们

非常严重

,在这种情况下确实如此

一位父亲正在强奸他的女儿

并将照片和视频

放到网上 他正在采取预防措施以免被

抓到

他们的一个线索是他们认为这可能

在我们身上 就

我们谈话的目的而言,他的女儿看起来大约两三岁

今天

我认为重要的是我们给她一个

名字,我们将称她为

玛丽玛丽是人类

我见过玛丽的脸

如果每个主要技术平台都

根据他们的数据运行玛丽的脸,我将永远不会在 2021 年 3 月 21 日看到这一点 他们

很可能会

在一张非虐待照片中找到她,这将结束

玛丽的这场噩梦,但这就是为什么

这是一场如此具有挑战性的

对话,有一些原因

隐私原因法律原因甚至一些

技术

原因导致我们今天不能这样做

在理智上我接受这些

理由,

感觉不对,感觉不对,因为我们作为

成年人已经做出了某些

决定,而她作为一个孩子却

继续受到虐待

w 当我将来遇到玛丽时,她

坐在我对面

说你有没有尽你

所能帮助我找到我

我会说什么

我们必须严格保护我们的隐私权

这是非常重要的,但我们

也必须严格保护一个 我们最宝贵的

资源

我们的孩子 我们经常说

你可以,或者你可以拥有这

三样东西

你可以想要更多的在线隐私 你可以

想要保护在线儿童

你可以使用你

不必选择的技术 我今天在这里

与您分享

隐私是一个连续体的想法,

它不是一个全有或全无的主张,

它不是一个开关

这种平衡

,我们将不得不努力

做到这一点

我今天与您分享这一点,因为

我们每天都会向您发出信号

,这些技术的用户

您将不得不

沿着这个连续性做出决定 m

作为这个过程的一部分,

人们经常对我们

说,人们不能在网上分享儿童

色情制品不是很明显吗?我们称儿童

色情制品为

儿童性虐待材料,因为

它实际上是

虐待儿童的证据或文件

目前的答案是

肯定的,

现在大多数公司都可以检测到

儿童性虐待内容,

但是随着我们在

没有正确技术解决方案的情况下转移到更私密的环境中,

我们可能会忽略它

我们如何到达这里如何有

如此强烈的波动 人们对隐私或

为什么会发生这种

情况感到

不安 尝试为您的

用户提供更私密的环境

更安全的环境 更受信任的

环境

,这通常是一件好事,它是

一件好事

,它可以是 对孩子们来说也是一件好事,

如果它正在做一些事情,比如

保护他们的数据而不泄露

他们的地理位置

等,但是

在隐私对话中不常谈论的

是谁失去了

在那些私人环境中不受保护的人,我

将使用 以加密

为例 加密将绝对

保护组织起来反对

压迫性政权的活动家,

并允许他们联系和组织

加密还将保护与他人

分享玛丽的虐待视频的

人,并鼓励其他人

以同样的方式虐待儿童,这将

使其更难找到 那些孩子,

这两个现实都是真实的,

我们必须承认,与其

试图只强调一个或另一个,

我们必须比那更

聪明,我们必须找到

平衡,我们可以保护

两者,这就是

目标 这次谈话的有趣之处

在于,定义儿童的

权利

往往落后于成年人的权利

,你在 th 中看到了这一点 历史

我的一位人权

律师朋友几年前对我说,

隐私并不总是对孩子有本质的好处

,我想到这一点,更多的孩子

经常在私人空间受到虐待,

回想起虐待儿童的日子

发生在

家里是为了让家人

弄清楚,而不是在公开场合讨论

,事实上直到 1960

年代在美国

,亨利肯特博士发表了

一篇

名为“受虐儿童”的医学论文,其中包括 X 光片

,证明 虐待

儿童的身体是什么样子 我们

开始

在谈话中使用虐待儿童这个词

之前它被认为是

不常见的,在美国不是一个经常

发布的强制性报告

法律,所以当

医生 老师

照顾者 社会工作者是

直到 1970 年代后期才

在美国

被要求并且必须报告涉嫌虐待儿童的行为,这是定义 c 的一个相对较新的领域

将儿童的权利与父母分开

,几十年后,随着我们

在这方面取得进展,

我们将不得不

重新定义网络世界中儿童的权利

,真正可怕

的是我们 真的远远落后于

2020 年,向我们展示了很多东西,

但其中一件明确的事情是

,孩子们生活

在互联网上,我们看到

去年向国家

失踪和受剥削儿童中心提交的在线诱惑报告增加了 97

在线诱惑是 当一个成年人

与一个孩子成为朋友

,或者诱使他们进行

性行为

以勒索他们的裸照,或者

甚至诱使他们亲自见面以

虐待他们时,

因此我们在去年同时看到这些报告有所增加

因为孩子

们没有出现在现实世界中,

强制性报告下降了,因为孩子

们没有去看医生,老师,社会

工作者,教练,

其他可能能够

报告涉嫌虐待儿童的父母

因此,随着孩子们在现实世界中变得越来越孤立,

他们在网络世界中的保护也越来越少,

这是一个非常危险的组合

所以我们将如何做到这一点

我们将如何定义

儿童的权利以及我们将如何

让他们

平等 为了每个人的在线权利并

隐私和儿童保护之间取得平衡首先

我们将需要创新

技术是这个故事中的主要人物,

我将再次以加密

为例,

现在大多数公司都可以并且已经

成功地检测到 儿童性

虐待内容

在他们的平台上,因为它们没有

加密

现在正在发生的事情是随着公司

向更私密的环境迈进

,我们担心我们可能会

忽视这种虐待,

你实际上会

在施虐者之间的对话中看到这种情况。

我会说不要去x平台

并尝试在那里培养一个孩子这不安全

你会被抓到这不是我们

想要的

不是我们想要的吗 互联网不会

成为这种虐待的敌对环境,因此随着

更多环境向加密方向发展,

公司将不再能够

检测到儿童性虐待材料

,这是我们真正担心的地方,

一个例子就是

他们一直在关注的 Facebook 多年来一直是一名超级记者,

值得称赞的是,

他们一直在寻找它,他们已经找到并报告了它

,去年当 facebook 在此结束时加密信使时,他们向国家失踪受剥削儿童中心报告了超过 2000 万份报告

接近 70 年或他们估计

大约 70

份的报告将不再被看到

,这很可怕,还有一点非常重要的

,有些公司已经被

加密,他们从未搜索过

这些内容,

所以如何 我们要解决这个问题 什么

好的解决方案 这是一个技术问题 这是一个

政策问题

这实际上只是

一个需要聪明人

齐心协力的老式问题

找出答案,好

消息是

世界各地的技术专家和政策制定者

都想解决这个问题,

如果我们将

在几年内实现绕月运行的酒店轨道,

我们创造了五种疫苗并在

一年来抗击全球

流行病

我们绝对可以找到一种方法来通过

手术检测

加密环境或私人

环境中

的儿童性虐待内容答案不是不

加密答案是我们将不得不

更加努力地工作 让私人

环境

对每个人都安全

我们需要做的第二件事是

你在听 你

在哪里听

我们去年做的市场调查中,我们

问了一大群美国人你想

在互联网上获得更多隐私

,绝大多数人说是的,

真正有趣的是

当你深入研究这种行为时 lly

在现实生活中表现出来,

想要隐私和意识到这意味着什么之间存在脱节,

所以我们也会询问人们

关于加密的问题,只有 10% 的

人回答说他们对加密了解很多

24 很少或

有点决定如何获得更多

隐私

在这个平台上的这些是为你制作的,但

没有完全披露

当你点击一个框说“是”我想

在这个平台上获得更多隐私时的权衡是什么

你不认为我

让找到像玛丽这样的孩子变得更难

你正在考虑保护你和

你的家人,

所以在我们对这里

发生的所有权衡取舍开诚布公之前,

我们不会找到一个平衡的解决

方案,因为我向你保证,

这个解决方案不是坐在

这个连续体的两端之一是

今天要说明的最后一点,

这非常重要

,那就是我们相信所有人的隐私,

包括图像中的孩子

和 v

我们必须承认,每次

分享玛丽的图像或视频时,她的隐私

都受到侵犯,因为不

承认

这些图像和照片中儿童的隐私正在

发生,现在

我们正在剥夺他们作为未来成年人的隐私,

我们知道这些 图像和视频

永远

不会消失,但我们必须向他们承诺

,我们将

尽我们所能,让他们

看不到曙光,

他们会在余生中继续困扰这些孩子,并

试图将其移除,

承认这是对他们隐私的侵犯

是我们至少可以做到的

,当我回想如果我将来

遇到

玛丽并且她说

你现在做了你能做的一切

我不得不说不

和 我会说不,因为我们还没有

完成工作

来找出那些平衡解决方案,

这很难,而且以前从未

做过,

但如果我使用加密平台,我们将不得不亲自为我做这件事

我会没事的 ķ 既然他们正在

寻找那种环境中的儿童性虐待,

但我承认这对我来说是一件有争议的

事情,

如果你不同意

这一点,或者如果这对你来说不是真的,我尊重你,

但我们必须进行这些公开和

诚实的对话 如果我们要

解决这个问题,

因为绝对有一个

世界可以保护我们的在线隐私

,我们可以更快地找到玛丽,我们只

需要建立它,

谢谢