Can machines read your emotions Kostas Karpouzis
With every year, machines surpass humans
in more and more activities
we once thought only we were capable of.
Today’s computers can beat us
in complex board games,
transcribe speech in dozens of languages,
and instantly identify almost any object.
But the robots of tomorrow may go futher
by learning to figure out
what we’re feeling.
And why does that matter?
Because if machines
and the people who run them
can accurately read our emotional states,
they may be able to assist us
or manipulate us
at unprecedented scales.
But before we get there,
how can something so complex as emotion
be converted into mere numbers,
the only language machines understand?
Essentially the same way our own brains
interpret emotions,
by learning how to spot them.
American psychologist Paul Ekman
identified certain universal emotions
whose visual cues are understood
the same way across cultures.
For example, an image of a smile
signals joy to modern urban dwellers
and aboriginal tribesmen alike.
And according to Ekman,
anger,
disgust,
fear,
joy,
sadness,
and surprise are equally recognizable.
As it turns out, computers are rapidly
getting better at image recognition
thanks to machine learning algorithms,
such as neural networks.
These consist of artificial nodes that
mimic our biological neurons
by forming connections
and exchanging information.
To train the network, sample inputs
pre-classified into different categories,
such as photos marked happy or sad,
are fed into the system.
The network then learns to classify
those samples
by adjusting the relative weights
assigned to particular features.
The more training data it’s given,
the better the algorithm becomes
at correctly identifying new images.
This is similar to our own brains,
which learn from previous experiences
to shape how new stimuli are processed.
Recognition algorithms aren’t just
limited to facial expressions.
Our emotions manifest in many ways.
There’s body language and vocal tone,
changes in heart rate, complexion,
and skin temperature,
or even word frequency and sentence
structure in our writing.
You might think that training
neural networks to recognize these
would be a long and complicated task
until you realize just how much
data is out there,
and how quickly modern computers
can process it.
From social media posts,
uploaded photos and videos,
and phone recordings,
to heat-sensitive security cameras
and wearables that monitor
physiological signs,
the big question is not how to collect
enough data,
but what we’re going to do with it.
There are plenty of beneficial uses
for computerized emotion recognition.
Robots using algorithms to identify
facial expressions
can help children learn
or provide lonely people
with a sense of companionship.
Social media companies are considering
using algorithms
to help prevent suicides by flagging posts
that contain specific words or phrases.
And emotion recognition software can help
treat mental disorders
or even provide people with low-cost
automated psychotherapy.
Despite the potential benefits,
the prospect of a massive network
automatically scanning our photos,
communications,
and physiological signs
is also quite disturbing.
What are the implications for our privacy
when such impersonal systems
are used by corporations to exploit
our emotions through advertising?
And what becomes of our rights
if authorities think they can identify
the people likely to commit crimes
before they even make
a conscious decision to act?
Robots currently have a long way to go
in distinguishing emotional nuances,
like irony,
and scales of emotions,
just how happy or sad someone is.
Nonetheless, they may eventually be able
to accurately read our emotions
and respond to them.
Whether they can empathize with our fear
of unwanted intrusion, however,
that’s another story.