The company will start formally notifying users of the change on Oct. 7. There’s no opt-out: If you don’t want your chatbot conversations influencing your ads, the only option is not to use Meta AI at all.

Emily Bender, a linguist at the University of Washington and coauthor of the widely cited “Stochastic Parrots” paper on the risks of large language models (LLMs), told Fortune the company is blurring a dangerous line.

“They’re already farming your clicks and posts to target ads. Now they’re mining your conversations with chatbots,” Bender said. “The obvious next concern is whether the chatbot itself will start nudging people to disclose information that makes them more targetable.”

It’s surveillance under the guise of personalization, Bender argues, with unprecedented abilities to extract personal details from users.

“Before, Meta’s systems watched who you connected to and what your communities were doing. Now it’s directly: What are you saying to the company?” she said. “And, of course, they can combine that with all the other data they already have.”

Bender says Meta is capitalizing on what she calls the “illusion of privacy.” People often confide in chatbots about things they’d never post publicly, lulled into a sense the AI is a neutral listener.

“There’s this illusion of privacy, when in fact what you’re doing is you’re serving up this data to a company,” she said.

Yet Meta describes the update as a “natural progression” of its personalization strategy.

Christy Harris, Meta’s privacy and data-policy manager, told reporters during a media briefing that people already assumed their chatbot interactions were feeding into ad targeting.

“We want to be super transparent about it and provide a heads-up before we actually begin using this data in a new way, even if people already thought that we were doing this,” she said, according to CNBC.

Harris offered a cheery example: If you ask Meta AI about planning a family vacation, you might see more family-travel Reels in your feed, along with hotel ads. Those interactions, whether typed into a phone or processed through microphones on Meta’s Ray-Ban glasses, will now be treated as new advertising signals.

Meta told Fortune its AI work is currently focused on “building a great consumer experience,” stressing that ads will not appear inside chatbot conversations themselves.

The company also pointed to existing privacy tools: People can “reset or correct an AI” through settings, and data retention follows Meta’s broader privacy policy.

Meta has poured billions into generative-AI infrastructure, racing to “superintelligence” and promising its current Meta AI assistant can help users generate images, draft messages, or plan their day. The company says the assistant already has more than 1 billion monthly active users, although that figure includes activity across its suite of apps, not just the stand-alone service.

CEO Mark Zuckerberg has been clear about the endgame: Conversational AI has to pay for itself. In May, he said Meta AI would eventually generate revenue either through ads or subscription services. Wednesday’s announcement is the first large-scale step toward making AI chats part of Meta’s core ad business.

Risks for younger users

The implications of this change across Meta’s services could be especially acute for teenagers and young adults, who make up the majority of Instagram’s user base and are increasingly drawn to AI companions. 

Bender calls these chatbots “a scourge” and warns their framing as friendly, always-available companions can be harmful. 

“We’ve seen people dying because of it,” she said, referring to reported cases of people harmed by chatbot interactions. “And then sort of just adding advertising into that mix, just feels like, let’s see how we can make it even more problematic.”

She worries the more Meta ties AI assistants to its ad business, the stronger the incentives become to keep users talking—not to help them, but to maximize engagement. 

“It probably also adds to the financial incentives for Meta to keep people chatting with the chatbots—to optimize on engagement, which is one of the vectors for harm,” she said.

Meta countered that its protections for young people extend to AI interactions.

“With Instagram Teen Accounts, teens are defaulted into the strictest setting of our sensitive content control so that they’re even less likely to be recommended sensitive content—and teens under 16 can’t change this setting without a parent’s permission. This is no different for interactions with AI at Meta,” a spokesperson told Fortune.