• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises

2

Despite having a $165 million net worth, Scarlett Johansson says work-life balance doesn’t exist—and the first step to success is admitting that

3

Nearly 50,000 Lake Tahoe residents have to find a new power source after their energy source looks to redirect lines to data centers

1

The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises

2

Despite having a $165 million net worth, Scarlett Johansson says work-life balance doesn’t exist—and the first step to success is admitting that

3

Nearly 50,000 Lake Tahoe residents have to find a new power source after their energy source looks to redirect lines to data centers
TechAI

Ensuring customers have confidence, trust in AI models falls to AI chiefs

By
John Kell
John Kell
Contributing Writer and author of CIO Intelligence
Down Arrow Button Icon
By
John Kell
John Kell
Contributing Writer and author of CIO Intelligence
Down Arrow Button Icon
May 16, 2024, 10:00 AM ET
Chief AI officers must think about customers' privacy concerns.
Chief AI officers must think about customers' privacy concerns.Illustration by Michele Marconi

Arnab Chakraborty, a senior managing director at consulting giant Accenture, recently recalled a conversation he had with a C-suite leader at a multinational restaurant chain. The executive admitted that leadership still wasn’t fully aware of all the ways artificial intelligence was being used by its workforce. 

Recommended Video

“For them to scale AI, and generative AI more importantly across the enterprise, we need to address these risks,” says Chakraborty. Lately, the conversations Chakraborty has with chief executives, board members, and chief security officers focus on understanding the risks of AI and figuring out how to comply with evolving regulations. 

The gap in AI awareness at that restaurant company may explain why over the past five years, 17 states have enacted 29 bills regulating AI. Of those, 12 were focused on ensuring data privacy and accountability. These laws generally aim to protect consumers from the unauthorized use of their data and ensure they have clear insight into how AI systems collect and use the data they willingly share. Hundreds more are aimed at targeting deepfakes, preventing discrimination, or addressing how the tools can be used for hiring.

“Name your favorite state,” says Intuit chief privacy officer Elise Houlik. “I bet they have an AI regulation proposed.”

Millions use Intuit’s financial products, including TurboTax, QuickBooks, and Credit Karma, giving Intuit a lot of direct access to highly sensitive data. “It is a powerful responsibility,” says Houlik. “When someone makes the decision to give us their data, we have to take that super seriously.”

With new generative AI capabilities emerging, Intuit takes a cross-functional approach to thinking through product development, including perspectives from technologists, security professionals, compliance, and legal.

“There has to be that balancing act between the commercial value of the technology and doing it the right way,” says Houlik.

“I think the legislative surface is becoming more and more stringent,” says Vijay Sankaran, chief technology officer at Johnson Controls, which makes industrial products that make buildings more sustainable. “We try to be very proactive about that.”

Johnson Controls has put up “significant” controls around data and to protect from different aspects of risk. It follows the National Institute of Standards and Technology, or NIST, framework to manage cybersecurity risks. Johnson Controls also practices DevSecOps, which is short for “development, security, and operations,” and integrates security practices at every phase of the software development life cycle, from design to testing to deployment. 

In 2022, Johnson Controls launched a privacy center that sought to proactively share with customers what data Johnson Controls used, how it ensured that data was secure, and the frameworks the company followed to ensure it was compliant with applicable laws in all jurisdictions. 

Johnson Controls also set up an AI council that established principles around data security and explained the company’s use of AI in a digestible manner. “I think it is really important for us to make sure that our customers have confidence in the types of AI models that we’re producing,” says Sankaran.

Each year, Accenture helps clients work through roughly 50,000 AI projects. Before any project begins, it goes through an assessment process that determines level of risk. As an example, one client may be working on developing a loan origination AI system, models that could create bias based on age, race, or gender and thus impact final loan decisions. 

Because that project was deemed high-risk at the start, “it will then initiate a whole series of testing that has to happen in terms of what datasets we are actually looking to use for this particular solution,” says Chakraborty. That could help the client avoid running afoul of emerging laws regulating bias in AI—lawmakers in at least seven states are considering proposals on the issue. 

When Jeremy Barnes thinks about data privacy at cloud-based software provider ServiceNow, he says consistency is key. 

“Our principals, because we’ve been thinking about them for a long time for the most part, they stayed fairly stable,” says Barnes, ServiceNow’s vice president of AI product and platform. That steadiness helps employees stay educated on ensuring that the data they do touch, especially when intersected with artificial intelligence, is safe.

But what continues to evolve is how ServiceNow applies those principles. How do they turn them into policies employees can follow? What are the standard operating procedures for customer data? When a product is built, what are the proper AI guidelines and data privacy requirements that need to be considered? 

“There is no one solution you can turn on, tick the box, and it’s done. You have to be able to adapt,” says Barnes. “The world is changing so fast with AI. Anyone who says they know the full solution is probably not looking in the right places.”

Data breaches like the ongoing saga at UnitedHealth Group highlight the elevated risks that companies are facing, especially as AI gives bad actors new tools to play with to create deepfake images, audio, and video that can more easily trip up employees. A survey from consulting firm Ernst & Young found that one-third of workers are worried they may be responsible for causing a cybersecurity breach, with Gen Z and millennial workers less likely to feel equipped to respond to those threats than older colleagues.

“You have to have a level of adaptability,” says Ibrahim Gokcen, chief data and analytics officer at management consulting firm Aon. “How do you then quickly adopt the organization—the right training and upskilling of the employees—because ultimately, a lot of these data protection, data privacy, and cyber-related things sit with an individual employee? The weakest point is usually an individual employee.”

Aon closely monitors data protection laws that are emerging in various markets, including the United Kingdom, Canada, and the state of California. As both a practitioner of AI and a consumer of Microsoft’s enterprise offerings, Aon says it acts as a “fast follower” on the technology. “That gives us ways of understanding the regulations and implications and making sure once they are law that we comply with them, because we have the right processes and infrastructure to operate in that environment,” says Gokcen.

This article is part of the Chief AI Officer’s must-read guide to AI’s potential.

About the Author
By John KellContributing Writer and author of CIO Intelligence

John Kell is a contributing writer for Fortune and author of Fortune’s CIO Intelligence newsletter.

See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

connor vukelich
Future of WorkGen Z
Meet the 20-year-old CEO who launched a company in high school to solve Gen Z’s entry-level job crisis
By Jake AngeloMay 16, 2026
34 minutes ago
IDEO invented ‘human-centered design.’ Can it survive an AI world where everything looks the same?
Asiadesign thinking
IDEO invented ‘human-centered design.’ Can it survive an AI world where everything looks the same?
By Nicholas GordonMay 16, 2026
2 hours ago
Mark Zuckerberg, chief executive officer of Meta Platforms Inc., left, and US President Donald Trump during a dinner with tech leaders in the State Dining Room of the White House in Washington, DC, US, on Thursday, Sept. 4, 2025. US President Donald Trump said he would be imposing tariffs on semiconductor imports "very shortly" but spare goods from companies like Apple Inc. that have pledged to boost their US investments. Photographer: Will Oliver/EPA/Bloomberg via Getty Images
Big TechDonald Trump
How Trump’s ‘unusual’ brokerage account traded around his own market-moving decisions—selling hyperscalers and buying energy stocks during the war
By Eva RoytburgMay 15, 2026
9 hours ago
Berkshire triples Alphabet stake and buys Delta stock while dumping Amazon in Greg Abel’s first quarter as CEO
InvestingBerkshire Hathaway
Berkshire triples Alphabet stake and buys Delta stock while dumping Amazon in Greg Abel’s first quarter as CEO
By Josh Funk and The Associated PressMay 15, 2026
10 hours ago
SpaceX said to plan public IPO filing as soon as Wednesday
Big TechIPOs
SpaceX said to plan public IPO filing as soon as Wednesday
By Anthony Hughes, Bailey Lipschultz and BloombergMay 15, 2026
10 hours ago
America’s productivity boom started before AI, and a Stanford economist who decoded the Great Resignation says working from home is the reason why
Future of Workremote work
America’s productivity boom started before AI, and a Stanford economist who decoded the Great Resignation says working from home is the reason why
By Marco Quiroz-GutierrezMay 15, 2026
13 hours ago

Most Popular

The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
Politics
The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
By Jake AngeloMay 12, 2026
4 days ago
Despite having a $165 million net worth, Scarlett Johansson says work-life balance doesn’t exist—and the first step to success is admitting that
Success
Despite having a $165 million net worth, Scarlett Johansson says work-life balance doesn’t exist—and the first step to success is admitting that
By Preston ForeMay 13, 2026
3 days ago
Nearly 50,000 Lake Tahoe residents have to find a new power source after their energy source looks to redirect lines to data centers
Travel & Leisure
Nearly 50,000 Lake Tahoe residents have to find a new power source after their energy source looks to redirect lines to data centers
By Catherina GioinoMay 12, 2026
4 days ago
Current price of oil as of May 15, 2026
Personal Finance
Current price of oil as of May 15, 2026
By Joseph HostetlerMay 15, 2026
20 hours ago
The airplane fuel shortage is a myth propagated by airlines who want to cancel unprofitable flights, says private jet CEO
Energy
The airplane fuel shortage is a myth propagated by airlines who want to cancel unprofitable flights, says private jet CEO
By Jim EdwardsMay 14, 2026
2 days ago
Top economist says $39 trillion national debt leaves government worse prepared for recession than ever
Economy
Top economist says $39 trillion national debt leaves government worse prepared for recession than ever
By Eva RoytburgMay 14, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.