Longstanding methods for assessing the skills and performance of an employee, as well as hiring practices, are being upended and re-imagined, according to business leaders who spoke at the Fortune Brainstorm Tech conference on Tuesday in Park City, Utah. 

Technical skills, contrary to what you might think, are not paramount in the age of AI. In fact, for many employers, technical skills are becoming less important.

“For the first time this summer on our platform we saw a shift,” said Hayden Brown, CEO of Upwork, an online jobs marketplace for freelancers. In the past, when Upwork asked employers on its platform about the most important skills they were hiring for, the answer invariably involved deep expertise in certain technical areas, Brown said. “For the first time this summer, it’s now soft skills. It’s human skills; it’s things like problem solving, judgement, creativity, taste.” 

Jim Rowan, the head of AI at consulting firm Deloitte, which sponsored the Brainstorm discussion, said an employee’s “fluency” should not be an end goal in itself. More important is intellectual curiosity around new tools and technology.

And that’s something that needs to start at the top.

“We’ve done a lot of work with executive teams to make sure the top levels of the organization and the boards are actually familiar with AI,” said Rowan. “That helps because then they can communicate better with their teams and see what they’re doing.” 

For Toni Vanwinkle, VP of Digital Employee Experience at Adobe, it’s critical for employees at all levels of an organization to have an “aha moment” with AI technology. And the best way to bring that about is for each employee to get their “first ten hours” in. 

“Go play with it,” Vanwinkle says. “Sort your email box, take the notes in your meeting, create a marketing campaign, whatever it is that you do.” Through that initial process of personal exploration, you start to understand the potential of the technology, she says.

The next step, Vanwinkle says, is collaboration, discussions, and experimentation among colleagues within the same departments or functionalities.

“This whole spirit of experiment, learn fast. That twitch muscle can turn into something of value when people talk openly,” Vanwinkle says.

The importance of embracing experimentation, and fostering it as a value within the organization, was echoed by Indeed chief information officer Anthony Moisant.

“I think about the pilots we run, most of them fail. And I’m not embarrassed at all to say that,” Moisant says. It all comes down to what a particular organization is optimizing for, and in the case of Indeed, Moisant says, “what we go for is fast twitch muscle. Can we move faster?”

By encouraging more low stakes experiments with AI, companies can gain valuable insights and experience that employees can leverage quickly when it counts. “The only way to move faster is to take a few bets early on, without real long term strategic ROI,” says Moisant.

Workday Vice President of AI Kathy Pham emphasizes that with new tools like AI, getting a full picture of an employee’s value and performance may take a bit longer than some people are used to. “Part of the measurement is better understanding what the return is and over what period of time,” she said.