Ambarella Collaborates on Transformer Automated Driving Software Stack

Ambarella, a leading provider of AI-based driver assistance technology, has joined forces with Plus, a developer of advanced autonomous driving software, to leverage transformer models on Ambarella's CV3 chip. This collaboration marks a significant advancement in the field of autonomous driving technology.

PlusVision, the transformer-based AD perception software stack developed by Plus, is known for its high performance and low power consumption. It is now compatible with Ambarella's CV3-AD AI domain controller family of systems-on-chip (SoCs), opening up new possibilities for the integration of cutting-edge technology in autonomous vehicles.

The innovative birds-eye-view vision technology created by Plus allows OEMs to incorporate L2+ and L3 autonomy features in the next generation of vehicle models using the same perception software. The Ambarella CV3 SoC has already been adopted by industry leaders such as Kodiak and Sany for self-driving trucks and autonomous construction vehicles, respectively.

Moreover, companies like Bosch and Leapmotor, in collaboration with Stellantis for European markets, are also utilizing the Ambarella CV3 chip for their vehicles. This widespread adoption underscores the versatility and reliability of the CV3 system on chip in enabling advanced autonomous driving capabilities.

PlusVision, with its transformer-based deep neural network AI perception software, merges Plus's L4 perception capabilities with a vast and diverse dataset collected from millions of real-world driving miles across different regions. This wealth of data has enhanced the intelligence of PlusVision, providing OEMs with detailed and informative output to refine their autonomous driving strategies.

The implementation of a uniform perception software like PlusVision is crucial for enabling data-driven, customized policies that can be seamlessly integrated across various vehicle models and trim levels. This approach ensures consistency and efficiency in developing autonomous driving solutions tailored to specific market needs.

The PlusVision stack, running on the mid-range CV3-AD655 SoC, delivers exceptional performance by processing data from 11 cameras simultaneously at 30 frames per second. With a front-camera detection range exceeding 200 meters, this setup enables long-distance perception essential for safe driving in high-speed conditions.

Through close collaboration, the teams at Plus and Ambarella have optimized the transformer-based PlusVision model for the CVflow AI engine within the CV3-AD SoCs, ensuring efficient and low-power AI processing. This optimization not only enhances processing performance but also provides OEMs with the flexibility to integrate additional software and develop unique features.

David Liu, CEO and co-founder of Plus, expressed his enthusiasm about the collaboration, stating, "We are delighted to collaborate with Ambarella in offering PlusVision’s leading-edge perception capabilities on their CV3-AD SoCs." This partnership aims to provide Tier-1 suppliers and OEMs with a versatile and efficient perception solution to meet evolving autonomy requirements.

Fermi Wang, president and CEO of Ambarella, emphasized the significance of the collaboration in driving innovation in the automotive industry. He highlighted the transformative impact of transformer-based AI perception software solutions in accelerating the development of next-generation vehicles, enabling Tier-1 suppliers and OEMs to differentiate their offerings effectively.

For more information on the collaboration between Ambarella and Plus, visit www.ambarella.com.