What your smart devices know and share about you Kashmir Hill and Surya Mattu

Kashmir Hill: So for my
birthday last year,

my husband got me an Amazon Echo.

I was kind of shocked, actually,

because we both work
in privacy and security.

(Laughter)

And this was a device that would sit
in the middle of our home

with a microphone on,

constantly listening.

We’re not alone, though.

According to a survey by NPR
and Edison Research,

one in six American adults
now has a smart speaker,

which means that they have
a virtual assistant at home.

Like, that’s wild.

The future, or the future dystopia,
is getting here fast.

Beyond that, companies are offering us
all kinds of internet-connected devices.

There are smart lights, smart locks,
smart toilets, smart toys,

smart sex toys.

Being smart means the device
can connect to the internet,

it can gather data,

and it can talk to its owner.

But once your appliances can talk to you,

who else are they going to be talking to?

I wanted to find out,

so I went all-in and turned my
one-bedroom apartment in San Francisco

into a smart home.

I even connected our bed to the internet.

As far as I know, it was just
measuring our sleeping habits.

I can now tell you
that the only thing worse

than getting a terrible night’s sleep

is to have your smart bed
tell you the next day

that you “missed your goal
and got a low sleep score.”

(Laughter)

It’s like, “Thanks, smart bed.

As if I didn’t already
feel like shit today.”

(Laughter)

All together, I installed 18
internet-connected devices in my home.

I also installed a Surya.

Surya Mattu: Hi, I’m Surya.

(Laughter)

I monitored everything the smart home did.

I built a special router that let me look
at all the network activity.

You can think of my router
sort of like a security guard,

compulsively logging
all the network packets

as they entered and left the smart home.

KH: Surya and I are both journalists,
he’s not my husband,

we just work together at Gizmodo.

SM: Thank you for clarifying.

The devices Kashmir bought –

we were interested in understanding

what they were saying
to their manufacturers.

But we were also interested
in understanding

what the home’s digital
emissions look like

to the internet service provider.

We were seeing what the ISP could see,
but more importantly,

what they could sell.

KH: We ran the experiment for two months.

In that two months,

there wasn’t a single hour
of digital silence in the house –

not even when we went away for a week.

SM: Yeah, it’s so true.

Based on the data, I knew when
you guys woke up and went to bed.

I even knew when Kashmir
brushed her teeth.

I’m not going to out your brushing habits,

but let’s just say it was very clear to me
when you were working from home.

KH: Uh, I think you just outed them
to, like, a lot of people here.

SM: Don’t be embarrassed,
it’s just metadata.

I knew when you turned on your TV
and how long you watched it for.

Fun fact about the Hill household:

they don’t watch a lot of television,

but when they do,
it’s usually in binge mode.

Favorite shows include
“Difficult People” and “Party Down.”

KH: OK, you’re right,
I loved “Party Down.”

It’s a great show,
and you should definitely watch it.

But “Difficult People”
was all my husband, Trevor.

And Trevor was actually a little upset
that you knew about his binges,

because even though he’d been the one
to connect the TV to the router,

he forgot that the TV was watching us.

It’s actually not the first time
that our TV has spied on us.

The company that made it, VIZIO,

paid a 2.2 million-dollar settlement
to the government just last year,

because it had been collecting
second-by-second information

about what millions of people
were watching on TV, including us,

and then it was selling that information
to data brokers and advertisers.

SM: Ah, classic surveillance economy move.

The devices Kashmir bought
almost all pinged their servers daily.

But do you know which device
was especially chatty?

The Amazon Echo.

It contacted its servers
every three minutes,

regardless of whether
you were using it or not.

KH: In general, it was disconcerting

that all these devices were having
ongoing conversations

that were invisible to me.

I mean, I would have had
no idea, without your router.

If you buy a smart device,
you should probably know –

you’re going to own the device,

but in general, the company
is going to own your data.

And you know, I mean,
maybe that’s to be expected –

you buy an internet-connected device,
it’s going to use the internet.

But it’s strange to have these devices

moving into the intimate space
that is the home

and allowing companies to track
our really basic behavior there.

SM: So true.

Even the most banal-seeming data
can be mined by the surveillance economy.

For example, who cares
how often you brush your teeth?

Well, as it turns out, there’s a dental
insurance company called Beam.

They’ve been monitoring their customers'
smart toothbrushes since 2015 –

for discounts on their
premiums, of course.

KH: We know what
some of you are thinking:

this is the contract of the modern world.

You give up a little privacy,

and you get some convenience
or some price breaks in return.

But that wasn’t my experience
in my smart home.

It wasn’t convenient, it was infuriating.

I’ll admit, I love my smart vacuum,

but many other things in the house
drove me insane:

we ran out of electrical outlets,

and I had to download
over a dozen apps to my phone

to control everything.

And then every device had its own log-in,

my toothbrush had a password …

(Laughter)

And smart coffee, especially,
was just a world of hell.

SM: Wait, really? Cloud-powered
coffee wasn’t really working for you?

KH: I mean, maybe I’m naive,
but I thought it was going to be great.

I thought we’d just wake up in the morning
and we’d say, “Alexa, make us coffee.”

But that’s not how it went down.

We had to use this really particular,
brand-specific phrase to make it work.

It was, “Alexa, ask the Behmor
to run quick start.”

And this was just, like,
really hard to remember

first thing in the morning,

before you have had your caffeine.

(Laughter)

And apparently, it was hard to say,

because the Echo Dot
that was right next to our bed

just couldn’t understand us.

So we would basically start every day
by screaming this phrase at the Echo Dot.

(Laughter)

And Trevor hated this.

He’d be like, “Please, Kashmir,

just let me go to the kitchen and push
the button to make the coffee run.”

And I’d be like, “No, you can’t!

We have to do it the smart way!”

(Laughter)

I’m happy to report that our marriage
survived the experiment,

but just barely.

SM: If you decide to make your home smart,

hopefully, you’ll find it
less infuriating than Kashmir did.

But regardless, the smart things you buy

can and probably are used
to target and profile you.

Just the number of devices you have
can be used to predict

how rich or poor you are.

Facebook’s made this tech,
and they’ve also patented it.

KH: All the anxiety you currently feel
every time you go online,

about being tracked,

is about to move into your living room.

Or into your bedroom.

There’s this sex toy called the We-Vibe.

You might wonder why
a sex toy connects to the internet,

but it’s for two people
who are in a long-distance relationship,

so they can share their love from afar.

Some hackers took a close look at this toy

and saw it was sending
a lot of information

back to the company that made it –

when it was used,
how long it was used for,

what the vibration settings were,
how hot the toy got.

It was all going into a database.

So I reached out to the company,

and I said, “Why are you collecting
this really sensitive data?”

And they said, “Well, it’s great
for market research.”

But they were data-mining
their customers' orgasms.

And they weren’t telling them about it.

I mean, even if
you’re cavalier about privacy,

I hope that you would admit
that’s a step too far.

SM: This is why I want
to keep my sex toys dumb.

KH: That’s great.

We’re all very glad to know that.

(Laughter)

SM: A data point I’m willing to share.

(Laughter)

The devices Kashmir bought
range from useful to annoying.

But the thing they all had in common

was sharing data with
the companies that made them.

With email service providers
and social media,

we’ve long been told that if it’s free,
you’re the product.

But with the internet of things, it seems,

even if you pay, you’re still the product.

So you really have to ask:

Who’s the true beneficiary
of your smart home,

you or the company mining you?

KH: Look, we’re a tech savvy crowd here.

I think most of us know
that these things connect to the internet

and send data out.

And fine, maybe you’re OK with living
in that commercial panopticon,

but others aren’t.

We need the companies to rethink
the design of these devices

with our privacy in mind,

because we’re not all willing
to participate in “market research,”

just because a device we bought
has a Wi-Fi connection.

And I have to tell you,

even when you’re aware,
generally, this is happening,

it’s really easy to forget that normal
household items are spying on you.

It’s easy to forget
these things are watching you,

because they don’t look like cameras.

They could look like …

well, they could look like a dildo.

Thank you.

(Applause)