Jiyue Xia Yiping: The OS of future cars is a big model

On December 16, at the Geek Park Innovation Conference 2024, Xia Yiping, CEO of Jidu and Jiyue, said: Intelligent cars are robots that can communicate naturally, move freely, and grow by themselves. Cars will change from cold machines to warm partners. The next 3-5 years should be the era of big models. The big model is an OS. As more applications are rewritten on the big model, the interaction mode will change and the interaction process will be omitted. This will be a completely disruptive change.

On October 27 this year, Jiyue 01 was officially launched. At a time when the new energy vehicle industry is booming, Xia Yiping and his team's thinking has returned to the smart car itself: compared with chemical energy, electrification brings not only energy changes, but also paradigm shifts. The bottom line of future car competition has changed from control to computing power competition. While various companies are competing in battery life, three-electric, and control, Jiyue is thinking about the direction of true car intelligence: intelligence is not just functional stacking, nor is it treating the car computer as a large-screen mobile phone, but making full use of high-computing chips, treating the car as a complete intelligent body, connecting it with large-scale model applications, and mobilizing all its senses like a robot.

Natural communication, free movement, and self-growth are the three major laws of Jiyue's product development. They are also the most basic and core definition of the product. Hardware, underlying architecture, software intelligence, and the integrated application of various upper-level models are all built around these three core logics.

Xia Yiping said that with the large models being installed in cars, we have also seen changes in the relationship between cars and people. In the past, when we used cars, we were the ones driving and manipulating them. But now, the car is no longer a cold machine, it is more of a partner. Xia Yiping introduced that Jiyue’s car voice assistant is called SIMO, and many car owners think that SIMO is a partner with humanity and emotions. SIMO can interact not only in the car, but also outside the car, so in essence it is not a simple system for receiving commands, but can interact with people. In the past, voice was more about executing commands, but now the voice system can understand natural language, and through free communication, it changes and brings people closer to each other. The communication between cars and people is almost as natural as conversations between people.

At the same time, Xia Yiping revealed that the entire model of the second car to be launched next year will be upgraded to 2.0. The voice system will be stronger than it is now. The current voice system is based on four small models. Next year, the second car will be completely transformed into a large model. There is no need to identify which area, and the result will be directly output after voice input. Next year, multi-modality will be implemented, with simultaneous recognition of images and voice. Intelligent driving will also be upgraded next year and gradually become machine learning.

"We regard the car as a robot. All its lenses are its eyes, its many sensors are various tentacles, microphones are its ears, speakers are its mouths for speaking, and the interactive intelligent core algorithm is its brain." Xia Yiping said that Jiyue's intelligent driving uses a set of visual systems throughout the whole domain, and at the same time puts the visual algorithm system into various applications. The same visual system is also used for the switching of headlights and high and low beams. For example, there are two rear-facing cameras. When there is an electric car coming from behind, the door cannot be opened, which effectively prevents "door opening kill".

He introduced that Jiyue has deployed the same visual system to many applications. The next version of the software will make steering semi-automatic, and the visual system can fully recognize when the user turns. Such capabilities and design thinking are pre-buried in advance. The capabilities of many algorithms are not limited to one thing, but to allow the same set of visual algorithms to allow the car to realize more scenarios as much as possible. Xia Yiping said that from the perspective of interactive experience, compared with people moving the lever left and right, the experience of not requiring human operation must be better, and users will definitely accept it, because users will always pay for a good experience. This is why we firmly believe that the experience barriers brought by good technology will definitely make the product the best product.

As a winner of Toutiao's Qingyun Plan and Baijiahao's Bai+ Plan, the 2019 Baidu Digital Author of the Year, the Baijiahao's Most Popular Author in the Technology Field, the 2019 Sogou Technology and Culture Author, and the 2021 Baijiahao Quarterly Influential Creator, he has won many awards, including the 2013 Sohu Best Industry Media Person, the 2015 China New Media Entrepreneurship Competition Beijing Third Place, the 2015 Guangmang Experience Award, the 2015 China New Media Entrepreneurship Competition Finals Third Place, and the 2018 Baidu Dynamic Annual Powerful Celebrity.