How augmented reality could change the future of surgery Nadine HachachHaram

According to the theories
of human social development,

we’re now living
through the fourth great epoch

of technological advancement,

the Information Age.

Connectivity through digital technology
is a modern miracle.

We can say it has broken down barriers
of time and space which separate people,

and it’s created a condition for an age

where information, ideas
can be shared freely.

But are these great accomplishments
in digital technology

really the endgame
in terms of what can be achieved?

I don’t think so,

and today I’d like to share with you

how I believe digital technology
can take us to even greater heights.

I’m a surgeon by profession,

and as I stand here today
talking to all of you,

five billion people around the world
lack access to safe surgical care.

Five billion people.

That’s 70 percent
of the world’s population,

who according to the WHO’s
Lancet Commission

can’t even access
simple surgical procedures

as and when they need them.

Let’s zoom in on Sierra Leone,

a country of six million people,

where a recent study showed
that there are only 10 qualified surgeons.

That’s one surgeon
for every 600,000 people.

The numbers are staggering,

and we don’t even need to look that far.

If we look around us here in the US,

a recent study reported that we need
an extra 100,000 surgeons by 2030

to just keep up with the demand
for routine surgical procedures.

At the rate that we’re going,
we won’t be meeting those numbers.

As a surgeon, this is
a global issue that bothers me.

It bothers me a lot,

because I’ve seen firsthand

how lack of access
to safe and affordable healthcare

can blight the lives of ordinary people.

If you’re a patient
that needs an operation

and there isn’t a surgeon available,

you’re left with some
really difficult choices:

to wait, to travel,

or not to have an operation at all.

So what’s the answer?

Well, part of you are carrying
some of that solution with you today:

a smartphone, a tablet, a computer.

Because for me,

digital communications technology
has the power to do so much more

than just to allow us to shop online,

to connect through social media platforms
and to stay up to date.

It has the power to help us solve
some of the key issues that we face,

like lack of access
to vital surgical services.

And today I’d like to share with you

an example of how I think
we can make that possible.

The history of surgery
is filled with breakthroughs

in how science and technology
was able to help the surgeons of the day

face their greatest challenges.

If we go back several hundred years,

an understanding of microbiology

led to the development
of antiseptic techniques,

which played a big role in making sure

patients were able
to stay alive postsurgery.

Fast-forward a few hundred years

and we developed
keyhole or arthroscopic surgery,

which combines video technology
and precision instruments

to make surgery less invasive.

And more recently, a lot of you
will be aware of robotic surgery,

and what robotics brings to surgery
is much like modern automated machinery,

ultraprecision,

the ability to carry out procedures
at the tiniest scales

with a degree of accuracy
that even surpasses the human hand.

But robotic surgery also introduced
something else to surgery:

the idea that a surgeon

doesn’t actually have to be standing
at the patient’s bedside to deliver care,

that he could be looking at a screen

and instructing a robot
through a computer.

We call this remote surgery.

It is incumbent on us

to find solutions that solve these answers
in a cost-effective and scalable way,

so that everyone, no matter
where they are in the world,

can have these problems addressed.

So what if I told you

that you didn’t really need
a million-dollar robot

to provide remote surgery?

That all you needed
was a phone, a tablet, or a computer,

an internet connection,

a confident colleague on the ground

and one magic ingredient:

an augmented reality
collaboration software.

Using this augmented reality
collaboration software,

an expert surgeon
can now virtually transport himself

into any clinical setting

simply by using his phone
or tablet or computer,

and he can visually and practically
interact in an operation

from start to finish,

guiding and mentoring a local doctor
through the procedure step by step.

Well, enough of me telling you about it.

I’d now like to show you.

We’re now going to go live
to Dr. Marc Tompkins,

an orthopedic surgeon
at the University of Minnesota.

He’s going to perform
an arthroscopic surgery for us,

a keyhole surgery of the knee,

and I’d like to disclose

that this patient has consented
to having their operation streamed.

I’d also like to point out
that in the interest of time,

we’re just going to go
through the first steps,

marking up the patient

and just identifying
a few key anatomical landmarks.

Hello, Dr. Tompkins, can you hear me?

Dr. Mark Tompkins: Good morning, Nadine.

Nadine Hachach-Haram:
Everyone from TED says hello.

Audience: Hi.

NHH: Alright, Dr. Tompkins,
let’s get started.

So let’s start with our incisions
and where we’re going to make these,

on either side of the patellar tendon.

So if you can make
your incisions there and there,

that should hopefully
get us into the knee.

MT: All right, I’m going in.

NHH: Great.

So we’re just getting
inside the joint now.

So why don’t we go around
and have a quick look at the meniscus.

MT: Perfect.

NHH: Great, so we can see there’s
a small tear there on the meniscus,

but otherwise it looks alright.

And if you turn
and head to this direction,

follow my finger,

let’s have a quick look
at the ACL and the PCL.

That’s your ACL there,
that looks quite healthy,

no problems there.

So we’ve just identified
that small meniscus tear there,

but otherwise the fluid
around the joint looks OK as well.

All right, thank you very much,
Dr. Tompkins. Thank you for your time.

I’ll let you continue.

Have a good day. Bye.

(Applause)

So I hope through
this simple demonstration

I was able to illustrate to you
just how powerful this technology can be.

And I’d like to point out
that I wasn’t using any special equipment,

just my laptop and a really simple webcam.

We’re so used to using digital technology

to communicate through voice
and text and video,

but augmented reality
can do something so much deeper.

It allows two people to virtually interact

in a way that mimics
how they would collaborate in person.

Being able to show someone
what you want to do,

to illustrate and demonstrate and gesture,

is so much more powerful
than just telling them.

And it can make
for such a great learning tool,

because we learn better
through direct experience.

So how is this making
a difference around the world?

Well, back in my teaching hospital,

we’ve been using this to support
local district general hospitals

and providing skin cancer surgery
and trauma treatment.

Now, patients can access
care at a local level.

This reduces their travel time,
improves their access,

and saves money.

We’ve even started seeing its use
in wound care management with nurses

and in outpatient management.

Most recently, and quite exciting,

it was used in supporting a surgeon
through a cancer removal of a kidney.

And I’d like to just share with you
a very quick video here.

I apologize for some
of the gruesome views.

(Video) Doctor 1: OK. Show me again.

Doctor 2: If you see here,

that’s the upper part,
the most outer part of your tumor.

Doctor 1: Yes.

Doctor 2: So it’s
three centimeters deep,

so this should be three centimeters.

Doctor 1: Yes, yes.

Doctor 2: OK,
so you need to get a 3.5 margin.

Doctor 1: I’m going to show you anyway

and tell me what you think about it.

NHH: We’re also seeing the use
of this technology at a global scale,

and one of the most
heartwarming stories I can recall

is from the town of Trujillo
in the north of Lima in Peru,

where this technology
was used to support the provision

of cleft lip and palate
surgery to children,

children from poor backgrounds who
didn’t have access to health insurance.

And in this town, there was
a hospital with one surgeon

working hard to provide this care,

Dr. Soraya.

Now, Dr. Soraya was struggling
under the sheer demand

of her local population,

as well as the fact that she wasn’t
specifically trained in this procedure.

And so, with the help of a charity,

we were able to connect her
with a cleft surgeon in California,

and using this technology, he was able
to guide her and her colleagues

through the procedure step by step,

guiding them, training them
and teaching them.

Within a few months,

they were able to perform
30 percent more operations

with less and less complications.

And now Dr. Soraya and her team
can perform these operations

independently, competently
and confidently.

And I remember one quote
from a mother who said,

“This technology
gave my daughter her smile.”

For me, this is the real power
of this technology.

The beauty is that it breaks boundaries.

It transcends all
technological difficulties.

It connects people.
It democratizes access.

Wi-Fi and mobile technology
are growing rapidly,

and they should play a role
in boosting surgical provision.

We’ve even seen it used in conflict zones
where there’s considerable risk

in getting specialist surgeons
to certain locations.

In a world where
there are more mobile devices

than there are human beings,

it truly has a global reach.

Of course, we’ve still got a long way

before we can solve the problem
of getting surgery to five billion people,

and unfortunately,

some people still
don’t have access to internet.

But things are rapidly moving
in the right direction.

The potential for change is there.

My team and I are growing
our global footprint,

and we’re starting to see
the potential of this technology.

Through digital technology,

through simple, everyday devices
that we take for granted,

through devices of the future,

we can really do miraculous things.

Thank you.

(Applause)

根据
人类社会发展理论,

我们现在正
经历着第四

个技术进步的伟大时代,

即信息时代。

通过数字技术实现连接
是一个现代奇迹。

可以说,它打破了人与人之间
的时间和空间的隔阂,

为一个信息、思想可以自由分享的时代创造了条件

但是

,就可以实现的目标而言,这些数字技术方面的伟大成就真的是最终结果吗?

我不这么认为

,今天我想和大家分享

一下我是如何相信数字技术
可以将我们带到更高的高度的。

我的职业是外科医生

,当我今天站在这里
与大家交谈时,全世界有

50 亿人
无法获得安全的外科护理。

五十亿人。

这是世界人口的 70%

,根据世界卫生组织的
柳叶刀委员会,他们

甚至无法

在需要时进行简单的外科手术。

让我们放大一下塞拉利昂

这个拥有 600 万人口的国家,

最近的一项研究表明
,那里只有 10 名合格的外科医生。

每 600,000 人就有一名外科医生。

数字是惊人的

,我们甚至不需要看那么远。

如果我们环顾美国

,最近的一项研究报告称,
到 2030 年,我们需要额外的 100,000 名外科医生

才能满足
对常规外科手术的需求。

按照我们前进的速度,
我们不会达到这些数字。

作为一名外科医生,这是
一个困扰我的全球性问题。

这让我很困扰,

因为我亲眼目睹


缺乏安全和负担得起的医疗保健

如何影响普通人的生活。

如果您是
需要手术的患者,

并且没有外科医生可用,

那么您将面临一些
非常困难的选择

:等待、旅行

或根本不进行手术。

那么答案是什么?

好吧,今天你们中的一部分人随身携带了
一些解决方案

:智能手机、平板电脑、电脑。

因为对我来说,

数字通信
技术的作用远

不止让我们能够在线购物、

通过社交媒体平台连接
和了解最新信息。

它有能力帮助我们解决
我们面临的一些关键问题,

比如无法
获得重要的外科服务。

今天,我想与大家分享

一个我
认为我们可以如何实现这一目标的例子。

外科历史充满

了科学和
技术如何帮助当时的外科医生

面对最大挑战的突破。

如果我们回到几百年前,

对微生物学的了解

导致
了防腐技术的发展,

这在确保

患者
能够在术后存活方面发挥了重要作用。

快进几百年

,我们开发了
锁孔或关节镜手术,

它结合了视频技术
和精密仪器

,使手术的侵入性更小。

最近,你们中的很多人
都会意识到机器人手术

,机器人技术给手术带来
的东西很像现代自动化机械,

超精密

,能够以甚至超过人类的精确度
以最小的规模

进行手术
手。

但机器人手术还
为手术引入了其他

东西:外科医生

实际上不必
站在患者床边提供护理

,他可以看着屏幕


通过计算机指导机器人。

我们称之为远程手术。

我们有责任

找到
以具有成本效益和可扩展的方式解决这些问题的解决方案,

以便每个人,无论
他们身在何处,都

可以解决这些问题。

那么,如果我告诉你

,你真的不需要价值
百万美元的机器人

来提供远程手术呢?

你所需要的
只是一部手机、一台平板电脑或一台电脑、

一个互联网连接、

一个自信的地面同事

和一个神奇的成分

:增强现实
协作软件。

使用这款增强现实
协作软件

,专家外科医生
现在可以通过手机、平板电脑或计算机虚拟地将自己传送

到任何临床环境中

并且他可以在手术中从头到尾进行视觉和实际
交互

指导和指导当地医生
通过程序一步一步。

好吧,我告诉你的已经够多了。

我现在想给你看。

我们现在要向明尼苏达
大学的整形外科医生 Marc Tompkins 医生直播


将为我们进行关节镜手术,

膝盖的锁孔手术

,我想

透露这位患者已
同意将他们的手术流式传输。

我还想
指出,为了节省时间,

我们将只
完成第一步,

标记患者


确定一些关键的解剖标志。

你好,汤普金斯博士,你能听到我说话吗?

Mark Tompkins 博士:早上好,Nadine。

Nadine Hachach-Haram:
TED 的每个人都打招呼。

观众:你好。

NHH:好的,汤普金斯博士,
让我们开始吧。

所以让我们从我们的切口开始
,我们将在哪里做这些,

在髌腱的两侧。

所以如果你能
在那里和那里做你的切口,

那应该有希望
让我们进入膝盖。

MT:好的,我要进去了。

NHH:太好了。

所以我们现在才
进入联合体。

那么我们为什么不
四处走走看看半月板。

MT:完美。

NHH:太好了,所以我们可以看到
半月板上有一个小裂口,

但除此之外看起来还不错。

如果您
转身朝这个方向前进,请

跟随我的手指,

让我们快速浏览
一下 ACL 和 PCL。

那是你的 ACL,
看起来很健康,

没有问题。

所以我们刚刚发现
那里有小半月板撕裂,


关节周围的液体看起来也不错。

好的,非常感谢
汤普金斯博士。 感谢您的时间。

我让你继续。

祝你有美好的一天。 再见。

(掌声)

所以我希望通过
这个简单的演示,

我能够向
大家说明这项技术的强大之处。

我想
指出我没有使用任何特殊设备,

只是我的笔记本电脑和一个非常简单的网络摄像头。

我们已经习惯于使用数字

技术通过语音
、文本和视频进行交流,

但增强现实
可以做一些更深入的事情。

它允许两个人以

一种模仿
他们亲自协作的方式进行虚拟交互。

能够向某人
展示您想做什么,

进行说明、演示和手势,

比仅仅告诉他们要强大得多。

它可以
成为如此出色的学习工具,

因为我们
通过直接经验学习得更好。

那么,这如何
在世界范围内产生影响?

好吧,回到我的教学医院,

我们一直在用它来支持
当地的地区综合医院,

并提供皮肤癌手术
和创伤治疗。

现在,患者可以
在当地获得护理。

这减少了他们的旅行时间,
改善了他们的访问,

并节省了金钱。

我们甚至已经开始看到它
在护士伤口护理管理

和门诊管理中的应用。

最近,非常令人兴奋的是,

它被用于支持外科医生
切除肾脏的癌症。

我想在这里与您分享
一个非常快速的视频。

我为
一些可怕的观点道歉。

(视频)1号医生:好的。 再给我看看。

医生2:如果你看这里,


是你的肿瘤的上部,最外面的部分。

医生1:是的。

医生2:所以是
三厘米深,

所以应该是三厘米。

医生1:是的,是的。

医生 2:好的,
所以你需要得到 3.5 的保证金。

医生1:无论如何我都会给你看

,告诉我你的想法。

NHH:我们也看到
了这项技术在全球范围内的使用,

我记得最感人的故事之一

来自
秘鲁利马北部的特鲁希略镇

,该
技术用于支持供应

唇裂和腭裂
手术的儿童,

来自贫困背景
但无法获得医疗保险的儿童。

在这个镇上,有
一家医院,一名外科医生

正在努力提供这种护理,

索拉亚医生。

现在,Soraya 医生
在当地人口的绝对需求下苦苦挣扎

,而且她没有
接受过该程序的专门培训。

因此,在慈善机构的帮助下,

我们能够将她
与加利福尼亚的一位唇腭裂外科医生联系起来,

并使用这项技术,他能够一步一步
地指导她和她的同事

完成手术,

指导他们、培训他们
和 教他们。

在几个月内,

他们能够执行的
手术数量增加了 30%

,而并发症也越来越少。

现在,Soraya 博士和她的团队
可以

独立、称职
和自信地执行这些手术。

我记得
一位母亲的话,她说:

“这项技术
让我女儿笑了。”

对我来说,这是这项技术的真正力量

美妙之处在于它打破了界限。

它超越了所有的
技术难题。

它连接人们。
它使访问民主化。

Wi-Fi 和移动技术
正在迅速发展

,它们应该
在促进手术供应方面发挥作用。

我们甚至已经看到它在冲突地区使用,在这些地区

将专业外科医生
带到某些地点存在相当大的风险。

在一个
移动设备比人类还多的世界里

它确实具有全球影响力。

当然,要解决让 50 亿人接受手术的问题,我们还有很长的路要走

,不幸的是,

有些人仍然
无法访问互联网。

但事情正在
朝着正确的方向迅速发展。

改变的潜力是存在的。

我和我的团队正在扩大
我们的全球足迹

,我们开始看到
这项技术的潜力。

通过数字技术,

通过
我们认为理所当然的简单日常

设备,通过未来的设备,

我们真的可以做奇迹般的事情。

谢谢你。

(掌声)