• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living

2

Egg companies made $1.22 billion in profit off a $6 carton — now they’re buying their way out of a price-fixing case with 53 million donated eggs

3

Meet the Zillennials: The luckiest micro-generation in the workforce, born between 1993 and 1998

1

Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living

2

Egg companies made $1.22 billion in profit off a $6 carton — now they’re buying their way out of a price-fixing case with 53 million donated eggs

3

Meet the Zillennials: The luckiest micro-generation in the workforce, born between 1993 and 1998
TechFuture of Work

Computers can’t read your mind yet, but they’re getting closer

Barb Darrow
By
Barb Darrow
Barb Darrow
Down Arrow Button Icon
Barb Darrow
By
Barb Darrow
Barb Darrow
Down Arrow Button Icon
September 11, 2015, 10:56 AM ET
Affectiva
Add Fortune on Google for similar content.

Can a computer tell if you’re in a good mood or ready to rip someone’s head off? Sort of.

Artificial intelligence (AI) startups like Affectiva and Emotient are making headway in this area and their technology has already been applied in market research and advertising applications where the difference between a commercial that bores you and one that captivates (or even enrages) you is the difference between success and failure.

Affectiva, for example, offers a cloud based service that reads facial expressions, which it calls (God help us) “Emotion as a Service.” Customers include big companies, ad agencies, and market research firms. Last week, the company launched a free test of a mobile software development kit to new prospects.

Gabi Zijderveld, Affectiva’s vice president of marketing, claimed it has compiled the world’s largest “emotion” repository with data on 3.2 million faces from people in 75 countries. This acts as sort of baseline on emotions, in terms of facial expressions.

For those who wonder if a computer can distinguish between a smile and a grimace, or maybe even a fake smile and the real deal, the company built a classifier to do just that, she said. “You have to look at the whole face, not just the lips pulled up at the sides, but the eyes, the eyebrow furrows, all the characteristics.”

It’s important to note the difference between what Affectiva does and facial or image recognition. Affectiva’s database could not identify a given person out of the 3.2 million faces it has in-house, but it can ascertain by looking at key points on the face if that person is happy, sad, angry. It can, Zijderveld said, even distinguish between a smile and a smirk, something that some humans cannot do.

She also stressed that Affectiva’s customers, big companies that run what amounts to online focus groups to gauge reactions to advertisements, is strictly “opt in.” Users are typically asked to participate in a survey, hit yes, and then instructed to turn on their web cams to participate, she explained. Zijderveld spoke more on this on the Datacenter Show podcast this week.

Hershey (HSY), the chocolate giant, is working with Affectiva and its partner Wild Blue Technologies on a new in-store device that prompts users to smile in return for a treat.

The “Smile Sampler” is sort of like a vending machine that will be deployed at as-yet-unnamed retailers.

For those who worry about someone collecting an image of them grinning goofily at a machine waiting for a chocolate kiss, there’s no need to fret, said Wild Blue president Steven McLean.

“The images are not really photos. They are instantly converted to a map of your face that only the machine can read. It is stored locally and after X amount of time deleted.”

Wild Blue also uses facial recognition from another vendor to prevent customers from collecting repeat treats all day. In that case, the Smile Sampler will ask them to come back tomorrow, he said.

Frank Jimenez, Hershey’s senior director of insights-driven performance and retail evolution (quite the title!) said the goal is to help retailers bring more customers into lightly travelled center aisles.

“Our hypothesis is when you come into the store you look forward to getting a treat, smile, and we reward you. The shop wins, the retailer wins, and the brand wins.”

affectiva man

Affectiva co-founder and chief strategy officer Rana el Kaliouby said other than the enterprise-focused service, the company’s SDK for Apple (AAPL), Android and Microsoft (MSFT) Windows devices lets developers “emotion enable” their applications.

Advertising and marketing applications are obvious uses for this technology but down the road it could also be used to help robots ascertain the moods and emotions of their human associates.

There is tons of intelligence out there in today’s computer systems fueled by massive public clouds like Amazon (AMZN) Web Services, and big data analytics, but it is “emotional intelligence” that remains lacking, el Kaliouby told Fortune. And that’s the gap companies like Affectiva, Emotient, IBM(IBM) with Watson, and others are trying to fill.

For more on artificial intelligence, check out the video below:

Subscribe to Data Sheet, Fortune’s daily newsletter on the business of technology.

About the Author
Barb Darrow
By Barb Darrow
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

After a nearly 800% explosion, this AI supplier is about to make its U.S. debut and could signal if the market can still boom—or is headed for a bust
AItech stocks
After a nearly 800% explosion, this AI supplier is about to make its U.S. debut and could signal if the market can still boom—or is headed for a bust
By Jason MaJuly 5, 2026
56 minutes ago
Humanoid robot holding soccer ball.
InnovationSports
Meet the soccer-playing humanoid robot that just delivered the game ball at the Brazil v. Norway FIFA World Cup match
By Catherina GioinoJuly 5, 2026
3 hours ago
Alibaba gets reprieve on lobbying ban tied to DoD blacklist
LawChina
Alibaba gets reprieve on lobbying ban tied to DoD blacklist
By Kate O'Keeffe and BloombergJuly 5, 2026
3 hours ago
The stock market is about to suffer a ‘snapback’ and will lose much of this year’s gains as ‘speculation is hitting extreme levels,’ BofA warns
InvestingS&P 500
The stock market is about to suffer a ‘snapback’ and will lose much of this year’s gains as ‘speculation is hitting extreme levels,’ BofA warns
By Jason MaJuly 5, 2026
4 hours ago
Nvidia supplier Hon Hai’s sales beat on continued AI demand
AsiaServers
Nvidia supplier Hon Hai’s sales beat on continued AI demand
By Debby Wu and BloombergJuly 5, 2026
6 hours ago
SK Hynix seeks access to AI investors in $29 billion U.S. listing
InvestingChips
SK Hynix seeks access to AI investors in $29 billion U.S. listing
By Bailey Lipschultz, Jeran Wittenstein, Yiqin Shen and BloombergJuly 5, 2026
6 hours ago

Most Popular

Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living
Success
Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living
By Preston ForeJuly 4, 2026
2 days ago
Egg companies made $1.22 billion in profit off a $6 carton — now they’re buying their way out of a price-fixing case with 53 million donated eggs
Law
Egg companies made $1.22 billion in profit off a $6 carton — now they’re buying their way out of a price-fixing case with 53 million donated eggs
By Wyatte Grantham-Philips and The Associated PressJuly 2, 2026
3 days ago
Meet the Zillennials: The luckiest micro-generation in the workforce, born between 1993 and 1998
AI
Meet the Zillennials: The luckiest micro-generation in the workforce, born between 1993 and 1998
By Nick LichtenbergJuly 3, 2026
3 days ago
Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI
AI
Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI
By Marco Quiroz-GutierrezJuly 5, 2026
10 hours ago
The stock market is about to suffer a 'snapback' and will lose much of this year's gains as 'speculation is hitting extreme levels,' BofA warns
Investing
The stock market is about to suffer a 'snapback' and will lose much of this year's gains as 'speculation is hitting extreme levels,' BofA warns
By Jason MaJuly 5, 2026
4 hours ago
$25 billion CEO says one-hour interviews are a waste of time—he puts candidates through six hours of tests and wants them to order wine at lunch
Success
$25 billion CEO says one-hour interviews are a waste of time—he puts candidates through six hours of tests and wants them to order wine at lunch
By Orianna Rosa RoyleJuly 3, 2026
3 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.