Visualizing the worlds Twitter data Jer Thorp
Transcriber: Andrea McDonough
Reviewer: Bedirhan Cinar
A couple of years ago I started using Twitter,
and one of the things that really charmed me about Twitter
is that people would wake up in the morning
and they would say, “Good morning!”
which I thought,
I’m a Canadian,
so I was a little bit,
I liked that politeness.
And so, I’m also a giant nerd,
and so I wrote a computer program
that would record 24 hours of everybody on Twitter
saying, “Good morning!”
And then I asked myself my favorite question,
“What would that look like?”
Well, as it turns out, I think it would look something like this.
Right, so we’d see this wave of people
saying, “Good morning!” across the world as they wake up.
Now the green people, these are people that wake up
at around 8 o’clock in the morning,
Who wakes up at 8 o’clock or says, “Good morning!” at 8?
And the orange people,
they say, “Good morning!” around 9.
And the red people, they say, “Good morning!” around 10.
Yeah, more at 10’s than, more at 10’s than 8’s.
And actually if you look at this map,
we can learn a little bit about how people wake up
in different parts of the world.
People on the West Coast, for example,
they wake up a little bit later
than those people on the East Coast.
But that’s not all that people say on Twitter, right?
We also get these really important tweets, like,
“I just landed in Orlando!! [plane sign, plane sign]”
Or, or, “I just landed in Texas [exclamation point]!”
Or “I just landed in Honduras!”
These lists, they go on and on and on,
all these people, right?
So, on the outside, these people are just telling us
something about how they’re traveling.
But we know the truth, don’t we?
These people are show-offs!
They are showing off that they’re in Cape Town and I’m not.
So I thought, how can we take this vanity
and turn it into utility?
So using a similar approach that I did with “Good morning,”
I mapped all those people’s trips
because I know where they’re landing,
they just told me,
and I know where they live
because they share that information on their Twitter profile.
So what I’m able to do with 36 hours of Twitter
is create a model of how people are traveling
around the world during that 36 hours.
And this is kind of a prototype
because I think if we listen to everybody
on Twitter and Facebook and the rest of our social media,
we’d actually get a pretty clear picture
of how people are traveling from one place to the other,
which is actually turns out to be a very useful thing for scientists,
particularly those who are studying how disease is spread.
So, I work upstairs in the New York Times,
and for the last two years,
we’ve been working on a project called, “Cascade,”
which in some ways is kind of similar to this one.
But instead of modeling how people move,
we’re modeling how people talk.
We’re looking at what does a discussion look like.
Well, here’s an example.
This is a discussion around an article called,
“The Island Where People Forget to Die”.
It’s about an island in Greece where people live
a really, really, really, really, really, really long time.
And what we’re seeing here
is we’re seeing a conversation that’s stemming
from that first tweet down in the bottom, left-hand corner.
So we get to see the scope of this conversation
over about 9 hours right now,
we’re going to creep up to 12 hours here in a second.
But, we can also see what that conversation
looks like in three dimensions.
And that three-dimensional view is actually much more useful for us.
As humans, we are really used to things
that are structured as three dimensions.
So, we can look at those little off-shoots of conversation,
we can find out what exactly happened.
And this is an interactive, exploratory tool
so we can go through every step in the conversation.
We can look at who the people were,
what they said,
how old they are,
where they live,
who follows them,
and so on, and so on, and so on.
So, the Times creates about 6,500 pieces of content every month,
and we can model every single one
of the conversations that happen around them.
And they look somewhat different.
Depending on the story
and depending on how fast people are talking about it
and how far the conversation spreads,
these structures, which I call these conversational architectures,
end up looking different.
So, these projects that I’ve shown you,
I think they all involve the same thing:
we can take small pieces of data
and by putting them together,
we can generate more value,
we can do more exciting things with them.
But so far we’ve only talked about Twitter, right?
And Twitter isn’t all the data.
We learned a moment ago
that there is tons and tons,
tons more data out there.
And specifically, I want you to think about one type of data
because all of you guys,
everybody in this audience, we,
we, me as well,
are data-making machines.
We are producing data all the time.
Every single one of us, we’re producing data.
Somebody else, though, is storing that data.
Usually we put our trust into companies to store that data,
but what I want to suggest here
is that rather than putting our trust
in companies to store that data,
we should put the trust in ourselves
because we actually own that data.
Right, that is something we should remember.
Everything that someone else measures about you,
you actually own.
So, it’s my hope,
maybe because I’m a Canadian,
that all of us can come together
with this really valuable data that we’ve been storing,
and we can collectively launch that data
toward some of the world’s most difficulty problems
because big data can solve big problems,
but I think it can do it the best
if it’s all of us who are in control.
Thank you.