Apple will revamp Siri to catch up to its chatbot competitors

Apple’s top software executives decided early last year that Siri, the company’s virtual assistant, needed a brain transplant.

The decision came after executives Craig Federighi and John Giannandrea spent weeks testing OpenAI’s new chatbot, ChatGPT. The product’s use of generative artificial intelligence, which can write poetry, create computer code and answer complex questions, made Siri look antiquated, said two people familiar with the company’s work, who didn’t have permission to speak publicly.

Introduced in 2011 as the original virtual assistant in every iPhone, Siri had been limited for years to individual requests and had never been able to follow a conversation. It often misunderstood questions. ChatGPT, on the other hand, knew that if someone asked for the weather in San Francisco and then said, “What about New York?” that user wanted another forecast.

The realization that new technology had leapfrogged Siri set in motion the tech giant’s most significant reorganization in more than a decade. Determined to catch up in the tech industry’s AI race, Apple has made generative AI a tent pole project — the company’s special, internal label that it uses to organize employees around once-in-a-decade initiatives.

Apple is expected to show off its AI work at its annual developers conference June 10 when it releases an improved Siri that is more conversational and versatile, according to three people familiar with the company’s work, who didn’t have permission to speak publicly. Siri’s underlying technology will include a new generative AI system that will allow it to chat rather than respond to questions one at a time.

The update to Siri is at the forefront of a broader effort to embrace generative AI across Apple’s business. The company is also increasing the memory in this year’s iPhones to support its new Siri capabilities. And it has discussed licensing complementary AI models that power chatbots from several companies, including Google, Cohere and OpenAI.

An Apple spokesperson declined to comment.

Apple executives worry that new AI technology threatens the company’s dominance of the global smartphone market because it has the potential to become the primary operating system, displacing the iPhone’s iOS software, said two people familiar with the thinking of Apple’s leadership, who didn’t have permission to speak publicly. This new technology could also create an ecosystem of AI apps, known as agents, that can order Ubers or make calendar appointments, undermining Apple’s App Store, which generates about $24 billion in annual sales.

Apple also fears that if it fails to develop its own AI system, the iPhone could become a “dumb brick” compared with other technology. While it is unclear how many people regularly use Siri, the iPhone currently takes 85% of global smartphone profits and generates more than $200 billion in sales.

That sense of urgency contributed to Apple’s decision to cancel its other big bet — a $10 billion project to develop a self-driving car — and reassign hundreds of engineers to work on AI.

Apple has also explored creating servers that are powered by its iPhone and Mac processors, two of these people said. Doing so could help Apple save money and create consistency between the tools used for processes in the cloud and on its devices.

Rather than compete directly with ChatGPT by releasing a chatbot that does things like write poetry, the three people familiar with its work said, Apple has focused on making Siri better at handling tasks that it already does, including setting timers, creating calendar appointments and adding items to a grocery list. It also would be able to summarize text messages.

Apple plans to bill the improved Siri as more private than rival AI services because it will process requests on iPhones rather than remotely in data centers. The strategy will also save money: OpenAI spends about 12 cents per 1,000 words that ChatGPT generates because of cloud computing costs.

(The New York Times sued OpenAI and its partner, Microsoft, in December for copyright infringement of news content related to AI systems.)

But Apple faces risks by relying on a smaller AI system housed on iPhones rather than a larger one stored in a data center. Research has found that smaller AI systems could be more likely to make errors, known as hallucinations, than larger ones.

“It’s always been the Siri vision to have a conversational interface that understands language and context, but it’s a hard problem,” said Tom Gruber, a co-founder of Siri who worked at Apple until 2018. “Now that the technology has changed, it should be possible to do a much better job of that. So long as it’s not a one-size-fits-all effort to answer anything, then they should be able to avoid trouble.”

Apple has several advantages in the AI race, including more than 2 billion devices in use around the world where it can distribute AI products. It also has a leading semiconductor team that has been making sophisticated chips capable of powering AI tasks like facial recognition.

But for the past decade, Apple has struggled to develop a comprehensive AI strategy, and Siri has not had major improvements since its introduction. The assistant’s struggles blunted the appeal of the company’s HomePod smart speaker because it couldn’t consistently perform simple tasks like fulfilling a song request.

The Siri team has failed to get the kind of attention and resources that went to other groups inside Apple, said John Burkey, who worked on Siri for two years before founding a generative AI platform, Brighten.ai. The company’s divisions, such as software and hardware, operate independently of one another and share limited information. But AI needs to be threaded through products to succeed.

“It’s not in Apple’s DNA,” Burkey said. “It’s a blind spot.”

Apple has also struggled to recruit and retain leading AI researchers. Over the years, it has acquired AI companies led by leaders in the field, but they all left after a few years.

The reasons for their departures vary, but one factor is Apple’s secrecy. The company publishes fewer papers on its AI work than Google, Meta and Microsoft, and it doesn’t participate in conferences in the same way that its rivals do.

“Research scientists say: ‘What are my other options? Can I go back into academia? Can I go to a research institute, some place where I can work a bit more in the open?’” said Ruslan Salakhutdinov, a leading AI researcher, who left Apple in 2020 to return to Carnegie Mellon University.

In recent months, Apple has increased the number of AI papers it has published. But prominent AI researchers have questioned the value of the papers, saying they are more about creating the impression of meaningful work than providing examples of what Apple may bring to market.

Tsu-Jui Fu, an Apple intern and AI doctoral student at the University of California, Santa Barbara, wrote one of Apple’s recent AI papers. He spent last summer developing a system for editing photos with written commands rather than Photoshop tools. He said that Apple supported the project by providing him with the necessary GPUs to train the system but that he had no interaction with the AI team working on Apple products.

Although he said he had interviewed for full-time jobs at Adobe and Nvidia, he plans to return to Apple after he graduates because he thinks he can make a bigger difference there.

“AI product and research is emerging in Apple, but most companies are very mature,” Fu said in an interview with The New York Times. “At Apple, I can have more room to lead a project instead of just being a member of a team doing something.”

© 2024 The New York Times Company