China's first "pure vision" intelligent driving solution released, leading the world in urban intelligent driving

On October 17, before the official launch of the automotive robot Jiyue 01, Jiyue released its first domestic BEV+Transformer "pure vision" high-level intelligent driving technology solution, which has now achieved pilot assisted driving on urban roads in Shanghai. At the same time, the first domestic occupancy network technology (Occupancy Network, "OCC") jointly developed by Jiyue and Baidu was also announced to the public for the first time. The introduction of this technology will further enhance the "pure vision" high-level intelligent driving capabilities of automotive robots.

In addition, Jiyue also demonstrated the world's leading intelligent car cabin interaction capabilities, and the intelligent AI partner SIMO can complete almost all functional operations of the vehicle. Baidu Chairman and CEO Robin Li said: "Based on Baidu's AI underlying capabilities, Jiyue 01 is fully open and empowered, and will become the smartest and most understanding car robot at present."

Jiyue's "pure vision" advanced intelligent driving solution runs on Shanghai's urban roads

As the industry's first smart car fully enabled by Apollo's advanced autonomous driving capabilities, the Jiyue 01 is equipped with dual NVIDIA DRIVE Orin chips, and its advanced intelligent driving has covered "multi-domain integration" in highway, urban, and parking scenarios.

In the 1.0 stage, Jiyue developed a high-end intelligent driving solution that integrates "pure vision + laser radar", with two independent systems backing up and complementing each other. With the rapid upgrade of the underlying AI visual algorithm capabilities, Jiyue's high-end intelligent driving has entered the 2.0 stage, no longer relying on laser radar, and gradually reducing its dependence on high-precision maps. The "pure vision" technical solution based on BEV+Transformer is highly mature, laying the foundation for the generalization of scenes on a larger scale in cities across the country.

At present, the core function of the Jiyue high-end intelligent assisted driving system, point-to-point pilot assistance (PPA), has run through the main core roads in Shanghai city with pure visual capabilities. In a video of the city pilot assisted driving road test released by Jiyue's official social account, a Jiyue 01 equipped with only a pure visual perception architecture ran through the Shanghai Lujiazui-Bund-Nanpu Bridge and other sections in one shot, with zero takeovers throughout the whole process, calmly dealing with various complex road conditions, fully demonstrating the strength that an international top echelon should have.

(Jiyue 01 high-level intelligent driving "pure vision" urban road test)

In order to further raise the upper limit of the "pure vision" technical solution and provide a safer and more assured user experience, Jiyue and Baidu jointly developed OCC occupancy network technology. BEV+Transformer's "pure vision" solution + OCC occupancy network technology will become Jiyue's complete system for high-end intelligent driving. It is now capable of mass production and will soon be put into practical use, representing the absolute leading level of domestic high-end intelligent driving.

With the "pure vision" of BEV+Transformer, it can quickly and accurately predict the position and trajectory of road participants. Combined with the industry-leading OCC occupancy network technology, it can help automotive robots restore 3D scenes more accurately, obtain three-dimensional structural information with higher resolution than lidar point clouds, reduce missed detections and false detections, and make up for spatial height information that vision does not have. While breaking through the capacity limit and improving safety, it completely replaces lidar and greatly improves generalization capabilities.

In the OCC occupancy network technology demonstration video released by Jiyue, OCC technology reconstructs and restores 3D scenes in real time in the visual world of the car robot. Jiyue 01's perception system uses voxels to clearly display standard obstacles such as railings, green plants, and roadblocks. It also accurately identifies special-shaped obstacles such as construction vehicles and street lights in trees, and can adapt to more complex scenes and different environments.

Xia Yiping, CEO of Jiyue, said: "In order to always maintain the leading intelligent competitiveness of automotive robots, Jiyue's end-to-end training of pure vision solutions is being rapidly iterated at a speed of 'weekly'. Next, with the rapid increase in delivery volume, Jiyue's high-end intelligent driving will show exponential evolution based on an efficient data closed-loop system."

The smartest car robot with "human-like" natural communication

As the world's first "AI car robot", in addition to its world-leading high-level intelligent driving capabilities, Jiyue 01 also has excellent intelligent cabin voice interaction capabilities. It is the first domestic launch to be equipped with Qualcomm's 4th-generation Snapdragon automotive digital cockpit platform 8295 chip, and for the first time fully enabled dual NPU (60TOPS). Thanks to its super computing power, the 35.6-inch 6K ultra-clear integrated large screen interaction is smooth and unstuck. It is the first in the industry to achieve full localization of voice AI algorithms, and the global and offline voice recognition speed is as fast as 500ms. It also supports functions such as driver-free wake-up and simultaneous chat in four audio zones, and can still interact at high speed without the network.

At the Baidu World Conference on October 17, Baidu Chairman and CEO Robin Li demonstrated the world-leading voice interaction capabilities of the Jiyue 01, which is fully empowered by Baidu AI. The Jiyue 01's smart cockpit eliminates physical buttons to the greatest extent, and users can control almost all functions of the vehicle using only voice commands.

In the demonstration, the voice interaction of Jiyue 01 perfectly interprets "fast, accurate, and stable". It not only covers complex scenarios such as inside and outside the car, four-way simultaneous conversation, and continuous conversation, but also integrates multi-modal interactions such as voice, gesture, and visual recognition to bring personalized experience according to user preferences and habits. With a word of SIMO, even the most vague instructions can show the smartest interaction results. In the future, Jiyue 01 will also be equipped with a large vehicle-side voice model to help "natural communication" to advance further.

The Jiyue 01 will be officially launched at the end of October and will be delivered at the same time. All high-level intelligent capabilities can be used out of the box, which is the industry's leading. At present, the car robot Jiyue 01 has been pre-sold on September 19, with a pre-sale price starting from 259,900 yuan, and more than 15,000 orders in 24 hours. On October 8, the first batch of Jiyue 01 mass-produced vehicles have been shipped in batches to offline experience centers across the country, and will soon open a full-function test drive experience to the majority of users.

As a winner of Toutiao's Qingyun Plan and Baijiahao's Bai+ Plan, the 2019 Baidu Digital Author of the Year, the Baijiahao's Most Popular Author in the Technology Field, the 2019 Sogou Technology and Culture Author, and the 2021 Baijiahao Quarterly Influential Creator, he has won many awards, including the 2013 Sohu Best Industry Media Person, the 2015 China New Media Entrepreneurship Competition Beijing Third Place, the 2015 Guangmang Experience Award, the 2015 China New Media Entrepreneurship Competition Finals Third Place, and the 2018 Baidu Dynamic Annual Powerful Celebrity.