• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
NewslettersBrainstorm Health

A Major Healthcare A.I. Has a Serious Racial Bias: Brainstorm Health

By
Sy Mukherjee
Sy Mukherjee
Down Arrow Button Icon
By
Sy Mukherjee
Sy Mukherjee
Down Arrow Button Icon
October 24, 2019, 5:48 PM ET

Good afternoon, readers.

Algorithms can be racist—seriously. Biases are often built into programs which then carry out what their programmers (perhaps innocently and unwittingly) build into the code.

But that’s a major problem in an increasingly digital world, intentions aside. And it’s especially problematic in the healthcare arena.

Unfortunately, a new study published in the journal Science finds that an unnamed, but widely-used, A.I. algorithm meant to manage population health fell prey to these very problems. The program is meant to analyze health risks across wide populations, specifically for chronically ill patients who may require an extra level of care.

But the underlying metrics used to calculate these risks were questionable. And they had the broader effect of discriminating against people based on race, particularly black Americans.

“We show that a widely used algorithm, typical of this industry-wide approach and affecting millions of patients, exhibits significant racial bias: At a given risk score, Black patients are considerably sicker than White patients, as evidenced by signs of uncontrolled illnesses,” wrote the study authors. “Remedying this disparity would increase the percentage of Black patients receiving additional help from 17.7 to 46.5%.”

Read on for the day’s news.

Sy Mukherjee, @the_sy_guy, sayak.mukherjee@fortune.com

DIGITAL HEALTH

Viz.ai raises $50 million for A.I.-fueled stroke diagnostics. Digital health firm Viz.ai has raised $50 million from partners including GV, Kleiner Perkins, Threshold Ventures, and Greenoaks in order to build up its A.I.-fueled stroke detection platform. The company's tech is used to sniff out suspected cases of a certain kind of stroke by analyzing CT scans. (Reuters)

INDICATIONS

Vertex, British drug watchdog finally reach an agreement. The wins keep coming for Vertex Pharmaceuticals this week. First, the company won a major approval for its cystic fibrosis combo therapy Trikafta, which could potentially treat 90% of patients with the rare disorder. Now, the U.K.'s hard-nosed drug pricing/value watchdog has come to an agreement over three of Vertex's other cystic fibrosis drugs, making them available on the market. The agency had initially deemed the treatments to not be cost-effective. (PharmaTimes)

THE BIG PICTURE

CVS to pull certain J&J baby powder from the shelves. Pharmacy chains CVS and Rite Aid are yanking certain Johnson & Johnson baby powder products from their shelves following the drug giant's voluntary recall (related to asbestos concerns. "CVS Pharmacy is complying with Johnson & Johnson’s voluntary recall of Johnson’s Baby Powder 22 oz. and is removing this product from all stores and from CVS.com," CVS said in a statement. "We also initiated a ‘Do Not Sell’ register prompt in our stores to prevent the sale of this item during the product removal process." (CNBC)

REQUIRED READING

What's Next for Google After Claiming 'Quantum Supremacy'? by Robert Hackett

How Tesla Made More Profit from Less Revenue, by David Z. Morris

You Might Have to Pay for Gmail. You Always Did, by Aaron Pressman

Another Wrinkle Emerges in the WeWork Saga, by Erik Sherman

Find past coverage. Sign up for other Fortune newsletters.

About the Author
By Sy Mukherjee
See full bioRight Arrow Button Icon

Latest in Newsletters

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Newsletters

Nima Ghamsari smiles
NewslettersTerm Sheet
Blend’s post-IPO reset: CEO Nima Ghamsari bets that AI can turn it all around
By Lily Mae LazarusApril 2, 2026
54 minutes ago
Can Elon Musk take SpaceX IPO to infinity and beyond?
NewslettersFortune Tech
Can Elon Musk take SpaceX IPO to infinity and beyond?
By Alexei OreskovicApril 2, 2026
1 hour ago
In the age of AI anxiety, the 100 Best Companies to Work For are betting on their people
NewslettersCEO Daily
In the age of AI anxiety, the 100 Best Companies to Work For are betting on their people
By Diane BradyApril 2, 2026
4 hours ago
Lean In’s new 25-year-old CEO has a plan to close the AI gender gap
NewslettersMPW Daily
Lean In’s new 25-year-old CEO has a plan to close the AI gender gap
By Emma HinchliffeApril 1, 2026
18 hours ago
How AI will make your Shake Shack order even faster
NewslettersCIO Intelligence
How AI will make your Shake Shack order even faster
By John KellApril 1, 2026
19 hours ago
Elon Musk’s coterie of companies are getting more and more pushback from Democrats
NewslettersTerm Sheet
Elon Musk’s coterie of companies are getting more and more pushback from Democrats
By Jessica MathewsApril 1, 2026
1 day ago

Most Popular

Two-thirds of parents say their adult Gen Z kids still rely on them financially  for support—even though it's putting them under strain
Success
Two-thirds of parents say their adult Gen Z kids still rely on them financially  for support—even though it's putting them under strain
By Fortune EditorsMarch 31, 2026
2 days ago
Current price of gold as of April 1, 2026
Personal Finance
Current price of gold as of April 1, 2026
By Fortune EditorsApril 1, 2026
23 hours ago
Jerome Powell says the $39 trillion national debt is ‘not unsustainable,’ but warns the trajectory ‘will not end well’
Economy
Jerome Powell says the $39 trillion national debt is ‘not unsustainable,’ but warns the trajectory ‘will not end well’
By Fortune EditorsMarch 30, 2026
3 days ago
Current price of oil as of April 1, 2026
Personal Finance
Current price of oil as of April 1, 2026
By Fortune EditorsApril 1, 2026
24 hours ago
Gen Z fled San Francisco for Texas and Florida. Now they're turning 'welcomer cities' into the next big tech towns
Real Estate
Gen Z fled San Francisco for Texas and Florida. Now they're turning 'welcomer cities' into the next big tech towns
By Fortune EditorsApril 2, 2026
5 hours ago
A man used AI to call 3,000 Irish bartenders to track the cost of Guinness. Now pubs are lowering their prices to compete
AI
A man used AI to call 3,000 Irish bartenders to track the cost of Guinness. Now pubs are lowering their prices to compete
By Fortune EditorsMarch 30, 2026
3 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.