At the Yunqi Conference held on September 20, Banma and Tongyi released a new smart cabin technology brand "Yuanshen AI", marking that automobile smart cockpits will fully enter the era of true large-model AI. Cai Ming, chief product officer of Banma Smart, said, “Zanma Smart will realize AI in All by fully applying AI capabilities to various smart cockpit scenarios. We are committed to building Yuanshen AI into a leading smart cockpit AI platform and forming a new platform around smart cockpits. AI plug-in ecosystem for cabin services ”

AI in All promotes the arrival of the "iPhone moment" in smart cabins

After more than 10 years of development of smart cars, users have yet to get a smooth smart cockpit product experience. On the one hand, the interaction method based on screen touch increases driving risks. In many cases, the functions of smart devices do not fully match the actual usage scenarios, causing users to have to adapt to the device instead of the device adapting to the user. On the other hand, the APP packaging service method limits the development of cockpit digital ecosystem. Compared with smartphones, smart cockpit applications are fewer in number and less active. The in-vehicle APP ecosystem will be outdated before it develops.

Cai Ming pointed out at the meeting that interactive changes and service reshaping will accelerate the arrival of the "iPhone moment" in smart cockpits. He believes that improving natural language communication through advanced large-model technology will be the first step to break through bottlenecks. This improvement will have as profound an impact on smart cockpits as touch screen technology revolutionized smartphones; and AI-based services Reshaping will form a service ecosystem that is truly suitable for smart cockpit scenarios.

Cai Ming said that from neural networks to array MICs, Zebra Intelligence has conducted comprehensive independent research and development and created an industry-leading human-computer interaction solution. Banma is not only committed to agent-specific cooperation, but also by disassembling APP functions into atomized capabilities to achieve scenario-based flexible assembly. It will work with industry partners to jointly promote the transformation of Internet services into intelligent agents and lead industry innovation.

Based on the latest Tongyi large model, Yuanshen AI is committed to becoming the leading platform cockpit AI

At the Yunqi Conference, Alibaba Cloud IntelligenceNeng has released a new version of Tongyi large model and Tongyi 2.0VL end-side multi-modal large model, which is especially suitable for smart cockpit and cabin-driving integration scenarios that require powerful computing power. It will bring revolution to human-vehicle interaction in these fields. The impact of this change is comparable to the position of touch screen technology in the history of smartphone development.

"Yuanshen AI" is based on Alibaba's latest Tongyi large model technology and is specially designed for smart cockpit scenarios, building a "1+3" AI technology system. The "1" in this system refers to silky natural communication as the first interaction method, while the "3" represents the three main intelligent capabilities: perceiving different scenarios, organizing various services, and learning user habits. Through this design, Yuanshen AI can create an intelligent and personalized next-generation AI cockpit experience for car manufacturer customers.

Cai Ming pointed out that "Yuanshen AI" symbolizes that the technical system is like the "intelligent soul" of the car. "The brain is the home of the soul", and "Yuanshen AI" will play an important role in the brain of the smart cabin. "The awakening of the soul determines the cognitive realm." The embodiment of "Yuan Shen AI" is not simply a large model on the car, but based on an in-depth understanding of the cockpit scene and through systematic AI technology, the smart cabin experience is improved to a new level.

In terms of natural communication, to change the current situation where touch interaction and current voice interaction are not suitable for use scenarios, Yuanshen AI has a full-stack self-developed AI voice technology, which is based on the accumulation of 20 billion voice interactions by Zebra Zhixing to continuously improve anthropomorphic interaction. The ability makes people interact with cars as naturally as people interact with each other.

In terms of perceiving scenes (Echo AI), Yuanshen AI achieves full-modal active understanding of the cockpit, all-cabin in-vehicle scene sensing, multi-perspective off-car scene sensing, and It can be safely used in all working conditions such as weak network and high information load scenarios.

In terms of organizational services (Eco AI), Yuanshen AI breaks through the problems of complex interactions and low frequency of use caused by APP encapsulation services. Yuanshen AI uses an original generative scenario engine to think and make decisions around user needs and scenarios, and organize atoms reasonably. Optimize service supply and provide the most appropriate services when users need them most. Based on the intelligent agent growth management platform, Banma Zhixing has teamed up with the first batch of application partners such as DingTalk, Quark, and Alipay to jointly create exclusive AI services for cockpit scenarios. The mobile agent technology created by Banma Zhixing and Tongyi will promote the AI-based application of more in-vehicle apps.

In terms of cognitive evolution (Evo AI), Yuanshen AI has formed knowledge accumulation based on 7 million user portrait maps.It combines digital and physical world information and multi-modal cross-domain understanding to continuously learn from users and achieve cognitive growth; it ensures user privacy and security through technologies and management strategies such as end-to-end models and end-to-end storage, and user isolation of desensitized data.

Yuanshen AI has received support and cooperation from mainstream chip companies at home and abroad. At the Computing Conference Innovation Application Pavilion, Zebra demonstrated its Yuanshen AI technology capabilities based on the NVIDIA Orin X chip platform and Qualcomm 8295 chip platform, which was widely recognized by visitors.

During the meeting, Banma iXing entered into strategic contracts with chip companies such as UNISOC and Black Sesame Intelligence to effectively support the rapid development of smart cabin AI based on the in-depth collaboration between OS and chips.

Establishing a new paradigm for the relationship between people and vehicles, Yuan Shen AI aims to “1 touch/100 cockpit service awakenings”

At the press conference, Banma Zhixing demonstrated a typical Agent product based on Yuanshen AI.

The "Flash Note Car Listening" jointly created with DingTalk is based on natural dialogue and has functions such as pre-meeting traceability, weak network participation, conversational summaries, automatic setting of schedules and to-dos, and is optimized by AI algorithms. The advanced array noise reduction microphone, headrest broadcast and other integrated hardware and software configurations allow business users to be more calm while driving and effectively balance work and life.

Facing urban travel life, AI-based applications such as Alipay, Damai, and AutoNavi have been implemented. Agents can make more reasonable itinerary planning, dining and ticket reservations/purchases based on time, location, preferences, etc., allowing users to make temporary decisions The travel life is more leisurely.

Cai Ming emphasized that the "Yuanshen AI" launched by Banma will help car companies create differentiated and cost-controllable next-generation AI through customized deployment of a device-cloud integrated AI framework and multi-core adapted device models. The cockpit, at the same time, brings users more natural human-vehicle interaction, richer scene services, and a better understanding of your personality.

Smart driving and smart cockpit have become the two core areas of automobile intelligence. At the meeting, Banma Zhixing proposed that it would benchmark Tesla FSD in the field of intelligent driving and arouse endless enthusiasm with "100 cockpit services."With the goal of "more than one touch interaction", we continue to evolve core technologies and products.

It is understood that Banma is a leading automotive operating system and artificial intelligence technology company. It has independently developed vehicle intelligent OS technology and cockpit AI technology. As a provider of platform-level products and solutions in the automotive field, it has already cooperated with car brands There are more than 30, with more than 150 commercial models in the market. The total number of cooperative mass-produced intelligent vehicles exceeds 7 million, and the number of monthly active users exceeds 3.7 million.

With the rich experience in R&D and mass production, as well as the AI ​​capabilities of Alibaba and Ant Group, Banma launched "Yuanshen AI" and received support and cooperation from software and hardware ecosystem companies to jointly accelerate the AI ​​development of the cockpit digital ecosystem. , reshaping a new paradigm of the relationship between people and vehicles.