Technology and the Future of Theatre

more than 60 years ago

norbert viner wrote that to be

successful in this new world

either the engineers must become poets

or the poets must become engineers

i’d argue that this was always the case

in theatre

i’m the director of digital development

at the royal shakespeare company

and it’s the first role of its kind

within the organization

and it’s been specifically created to

bring together

artists and technologists poets and

engineers

to imagine the future of theatre it came

from an

interest in the possibilities created by

the profound changes

and new technologies of the internet age

this is the royal shakespeare theatre

the rst

in stratford-upon-avon it’s our home

and every night over a thousand people

come here for a shared experience

with and bear witness to some of the

best storytelling technology there is

the actor but the actor at the heart of

the play has always been supported by

other technologies

the poet and the engineer have never

truly been separated

and my role is a new one but has always

existed in different forms

because candlelight was a technology

electricity was a technology the

printing press was a technology and we

wouldn’t

have or be able to perform shakespeare’s

shakespeare’s plays today without that

technology

technologies of the time brought into

the theater and used as part of the

theatre making toolkit

now as we encounter new technologies we

see the new possibilities

the royal shakespeare theatre i’m

standing on today here

right now is not a photograph it’s a

millimeter accurate scan

captured using cutting-edge lidar

technology

and rendered into a games engine we can

do anything we like with this image

our theater is now not only a 3d space

in real life

but a virtual 3d space too this stage

a smart stage i’m standing on means that

we can connect

and broadcast in 3d space too

scanned in a pandemic now more than ever

we see the desire for connection

liveness togetherness and storytelling

what a virtual 3d space allows us to do

is not only to broadcast but to redefine

how we be together working alongside

each other with all the tools that we

have to make theatre

but back to craft another great quote is

by arthur c

clarke who says any sufficiently

advanced technology is indistinguishable

from magic

and look no further than the tempest

shakespeare’s last and arguably most

magical and innovative play in 2016

it was the 400th anniversary of

shakespeare’s death and in the years

leading up to it our artistic director

greg doran wanted to explore the tempest

through a 21st century lens

and i began my research in the place

where we mainly go for our ideas now

the internet during my search i found

a clip from the consumer electronics

show keynote speech from intel

ceo it was a small two-minute youtube

clip easily findable for those in the

industry

but not no connection with theatre and

watching the clip i saw the promise of a

virtual and physical world come together

using augmented reality

i saw a whole whale on a screen and then

a whale leaving the screen and moving

over people’s heads

in the auditorium it was technology as

magic

the people who were in that auditorium

were trying to touch the whale

above them and gasped in excitement

seeing it transform

and it made me think about all those

people who had heard a voice

on a phone for the first time all those

people who ran

out of the cinema thinking the train was

coming towards them

our relationship with the promise of

magic is completely connected to the

promise of theater

i wanted to see what would happen by

bringing this new technology into our

theater

to create a virtual and real world come

together and shift ourselves from the

idea

of digital as another space

knowing no one at intel i emailed their

customer service website and waited

patiently for a response and two weeks

later i had a reply

with an email back saying let’s talk

from a call came an invitation to

stratford-upon-avon

and from that invitation to a week-long

visit a team of poets

and a team of engineers both innovative

both visionary but talking two different

languages

meeting eating together and finding ways

to imagine together

it was an intel engineer who said do you

know we have enough

processing power to render a character

in real time

and in that moment we didn’t know what

this meant at all

i mean we couldn’t conceive of the

possibilities and we literally

didn’t know what he meant processing

power

rendering these are not words that we

were using in our world

but as he explained we realized that

this was puppetry

the movement of an actor driving a

digital avatar in real time

a new way to represent that most magical

of characters

ariel and a new way to bring to life the

magic of shakespeare’s

imagination

two years later that vision took flight

336 joints in the avatar the equivalent

to recreating

every joint in the human body 200 000

files running simultaneously to bring

the avatar to the audience

50 million times more memory than the

first

flight to space so many tiny challenges

solved through the creativity of two

teams

what we pre what we projected what would

we project onto the avatar

we tried some of the most high-tech and

expensive different solutions

and at the end we used simple technology

of the double layering of a mosquito net

those two worlds coming together made

140 performances

reaching over a hundred thousand

audience members broadcasting to over

500 cinemas

and more importantly a contribution to

the toolkit available for future makers

of cinema theater but more importantly

we had welcomed a new technology that

crossed generations

that brought them together new audiences

came in with the technology

and went away with the shakespeare and

our current audiences came in with the

shakespeare and now with the technology

and that was the start into our worlds

where we were creating with our 21st

century engineers

the coders the programmers developers

riggers

3d modelers motion capture artists

the new communities that we take with us

now and imagine

on this 3d virtual stage

because the embrace of new technologies

and forms has always allowed us to be

more open

and this is the seven ages of man seen

from as you like it

performed for the first time a

volumetrically captured actor

performing the scene with a digitally

engineered set created on your tabletop

because the embrace of new technologies

and forms has allowed us to be more open

to experiment

on different digital platforms and thus

to expand and diversify our thinking

about our audience

and conversely to understand and harness

our potential

it’s shown how theatre is a driving

force and can work alongside those who

are solving problems

to imagine and enable communities to

stay open to the new tools and

technologies that are taking us there

so let’s converge this craft and

connection accelerated by a disruption

of a pandemic we are far faced with a

stark adaptation

and new forms of connection some are

born from necessary functional means

but as theater makers how can we get a

sense of togetherness

when we are apart what if our audiences

could breathe or gesture or the data

from their own movement or mood

many aspects of the nuance of connection

in our real worlds

connect with performances virtually

what if we pushed our technology to

unlock new possibilities of the internet

to expand reach in real time push server

power

to service our connection in real time

and move from puppetry

and character to real-time connected

worlds at scale

this is starting to happen this stage

becomes our stage and our stages connect

to become our world

and the promise of theatre is its

liveness

and being together but what if you could

choose your stage

make home your destination not just as a

sat nav

instruction but as a space for life

performance

we are experimenting with the feedback

loop between the performer and the

audience

and experimenting with virtual

co-presence in how we can breathe

together

and be together and experience together

the uk cultural icon david bowie once

said tomorrow belongs to those who see

it coming

because it shouldn’t just be the

engineer or the industry representative

at the kes keynote

holding the conversation about the

future our future is connected

it’s inclusive and it’s together where

we go

we’ll go with the technology we’ll be

with our poets and our engineers

and our audiences and our communities to

those who can see the technology

differently

and work with the engineers to imagine

and those who are open to explore

our processing powers are more than

faster better

smarter they are magical

you

60 多年前,

诺伯特·维纳 (norbert viner) 写道,要想

在这个新世界取得成功,

要么工程师必须成为诗人,

要么诗人必须成为工程师

皇家莎士比亚公司

,这是该组织中的第一个此类角色

,它的创建是为了

艺术家和技术专家、诗人和

工程师聚集

在一起,想象戏剧的未来,它来自

对深刻变化

和新技术所创造的可能性的兴趣 这是互联网时代

的皇家莎士比亚剧院

埃文河畔斯特拉特福的第一家 它是我们的

家 每天晚上都有超过一千人

来到这里分享

经验并见证一些

最好的讲故事技术

有演员但是 剧中的核心演员

一直得到

其他技术

的支持 诗人和工程师从未

真正做到过 分离了

,我的角色是一个新角色,但

一直以不同的形式存在,

因为烛光是一种技术,

电力是一种技术,

印刷机是一种技术,

如果没有这种技术,我们今天就

不可能或能够表演莎士比亚的

莎士比亚戏剧

。 时间

带入剧院并用作

剧院制作工具包的一部分

现在当我们遇到新技术时,我们

看到了新的

可能性我今天站在皇家莎士比亚剧院

现在不是照片而是

毫米精确扫描

使用捕获 尖端的激光雷达

技术

并渲染到游戏引擎中 我们可以

使用此图像做任何我们喜欢的事情

我们的剧院现在不仅

是现实生活中的 3d 空间,

而且也是虚拟 3d 空间 这个舞台

我站在的智能舞台意味着

我们

现在比以往任何时候都可以在大流行中扫描的 3D 空间中进行连接和广播

我们看到了对连接的渴望

讲述虚拟 3D 空间允许我们做

的不仅仅是广播,而是重新定义

我们如何

使用我们必须制作剧院的所有工具一起工作,

但回到制作另一个伟大的报价

是亚瑟 c

克拉克谁说 任何足够

先进的技术都无法

与魔法区分开来

,看看暴风雨

莎士比亚的最后一部,可以说是最具

魔法和创新性的戏剧,2016

年是

莎士比亚逝世 400 周年,在此之前的几年

里,我们的艺术总监

格雷格·多兰想要探索

21 世纪镜头下的暴风雨

,我开始研究的

地方是我们现在主要寻求想法的地方

在我搜索的过程中,我在互联网上找到

了一段来自消费电子展的剪辑,

来自英特尔首席执行官的主题演讲,

那是一个两分钟的小 youtube

剪辑对于业内人士来说很容易找到,

但与剧院无关,

观看剪辑我看到了

虚拟和物理的承诺

我在屏幕上看到一头鲸鱼,然后

一头鲸鱼离开屏幕,在观众席上

从人们的头顶上方移动,

这就像技术一样

神奇

,在观众席上的

人们正试图触摸他们上方的鲸鱼

看到它的转变

,我兴奋地喘着粗气,这让我想起了那些

第一次在电话里听到声音的

人所有那些跑出电影院的人,他们

以为火车

正朝他们走来,

我们与承诺的关系

魔术与

剧院的承诺完全相连 给他们的

客户服务网站发了电子邮件,

耐心地等待回复,两周

后我收到了回复

,回复了一封电子邮件,说让我们

谈谈交流 所有人都收到了去

埃文河畔斯特拉特福的邀请

,从那次邀请到为期一周的

访问,一个诗人

团队和一个工程师团队既富有创新精神,

又富有远见,但会说两种不同的

语言,

他们聚在一起吃饭,想方设法

一起想象。

英特尔工程师说你

知道我们有足够的

处理能力来实时渲染一个角色

,在那一刻我们根本不知道

这意味着什么

我的意思是我们无法想象这些

可能性,我们真的

不知道 他的意思是处理

能力

渲染这些不是我们

在我们的世界中使用的词,

但正如他解释的那样,我们意识到

这是木偶剧

演员

实时驾驶数字化身的动作

一种新的方式来表现最神奇

的角色

爱丽儿 两年后,莎士比亚想象中的魔力变为现实,这种新方法

在化身中飞走了 336 个关节,

相当于重建

了人体中的每一个关节 n 身体 200 000 个

文件同时运行,

将虚拟形象呈现给观众

比第一次太空飞行多 5000 万倍的内存

如此多的微小挑战

通过两个团队的创造力解决

了 我们预想的内容 我们预测的内容 我们将

投影到虚拟形象上的内容

我们 尝试了一些最高技术和最

昂贵的不同解决方案

,最后我们使用了简单

的双层蚊帐技术,

这两个世界融合在一起进行了

140 场演出,

覆盖超过 10 万

观众,向 500

多家电影院播放 重要的是

对未来影院制造商可用的工具包的贡献,

但更重要的是,

我们欢迎一种

跨越几代

人的新技术,将他们聚集在一起

莎士比亚,现在有了技术

,那是我们世界的

开始 我们正在与 21

世纪的

工程师一起创造 编码员 程序员 开发人员

装配

3d 建模师 动作捕捉艺术家

我们现在随身携带

在这个 3d 虚拟舞台上想象的新社区,

因为新技术

和形式的拥抱总是让我们成为

更开放

,这是从你喜欢的角度看到的七个男人的年龄,

这是第一次由

体积捕捉的演员

使用

在你的桌面上创建的数字工程布景表演场景,

因为新技术

和形式的拥抱使我们能够 更开放

在不同的数字平台上进行实验,

从而扩展和多样化

我们对观众的思考

,反过来理解和利用

我们的潜力,

它表明戏剧是一种驱动

力,可以与那些解决问题的人一起工作

,让社区能够想象

对将我们带到那里的新工具和技术保持开放的态度,

让我们融合在一起 大流行

的破坏加速了工艺和联系

我们面临着

严峻的适应

和新的联系形式有些是

从必要的功能手段中诞生的,

但是作为戏剧制作人

当我们分开时,我们如何才能获得团结感呢?

观众可以呼吸或手势或

来自他们自己的动作或情绪的数据

我们现实世界中

连接的细微差别的许多方面 与表演虚拟连接

如果我们推动我们的技术来

解锁互联网的新可能性

以扩大实时范围 推送服务器

实时服务于我们的连接,

并从木偶

和角色转移到大规模实时连接的

世界

这开始发生这个阶段

成为我们的舞台,我们的舞台

连接成为我们的世界

,剧院的承诺是它的

活力

和存在 一起,但如果你能

选择你的舞台,

让家成为你的目的地,不仅仅是作为一个

卫星导航

指令,而是作为一个空间 FE

表演

我们正在试验

表演者和观众之间的反馈循环,

并试验虚拟

共存,让我们一起呼吸,

在一起

,一起体验

英国文化偶像大卫鲍伊曾经

说过,明天属于那些看到

它到来的人

因为不应该只是

工程师或行业代表

在 kes 主题演讲中

就未来进行对话,

我们的未来是相互联系的,

它是包容性的,它是一起

的 我们的工程师

、我们的观众和我们的社区对于

那些能够以不同的方式看待技术

并与工程师一起想象的人

以及那些愿意探索

我们的处理能力的人不仅仅是

更快更好

更聪明他们是神奇的