Origin Evolution for Automotive

AI Inference for the Most Advanced Automotive Needs

Whether deployed in-cabin for driver distraction or in the advanced driver assistance system (ADAS) stack for object recognition and point cloud processing, AI forms the backbone of the future of safer, smarter cars.

DOWNLOAD PRODUCT BRIEF

AI Demands Higher Performance

Auto makers are adding more AI, including advanced LLM and multimodal capabilities, as they enable safety and usability use cases such as autonomous driving/ADAS, driver attention monitoring, passenger detection, and infotainment. While local inference is essential for all safety-critical systems, LLMs may be 20 to 50X larger than more traditional AI networks. Automotive inference capabilities on today's processors are already limited, and automakers are looking for alternative, more efficient architectures for next generation systems.

Ideal Processing Architecture

Origin Evolution™ for Automotive offers out-of-the-box compatibility with popular LLM and CNN networks. Attention-based processing optimization and advanced memory management ensure optimal AI performance across a variety of today’s standard and emerging neural networks. Featuring a hardware and software co-designed architecture, Origin Evolution for Automotive scales to 96 TFLOPS in a single core, with multi-core performance to PetaFLOPs.

Innovative Architecture

Origin Evolution uses Expedera’s unique packet-based architecture to achieve unprecedented NPU efficiency. Packets, which are contiguous fragments of neural networks, are an ideal way to overcome the hurdle of large memory movements and differing network layer sizes, which are exacerbated by LLMs. Packets are routed through discrete processing blocks, including Feed Forward, Attention, and Vector, which accommodate the varying operations, data types, and precisions required when running different LLM and CNN networks. Origin Evolution includes a high-speed external memory streaming interface that is compatible with the latest DRAM and HBM standards.

Choose the Features You Need
Customization brings many advantages, including increased performance, lower latency, reduced power consumption, and eliminating dark silicon waste. Expedera works with automotive customers to understand and optimize to their use case(s), PPA goals, and deployment needs during their design stage. Using this information, we configure Origin Evolution to create a customized solution that perfectly fits the application.

Unique Packet Architecture

Ultra-Efficient Neural Network Processing

Accepting standard, custom, and black box networks in a variety of AI representations, Origin Evolution offers a wealth of user features such as mixed precision quantization. Expedera’s unique packet-based processing reduces much larger networks into smaller, contiguous fragments, overcoming the hurdle of large memory movements and offering much higher processor utilization. Packets are routed through discrete processing blocks, including Feed Forward, Attention, and Vector, which accommodate the varying operations, data types, and precisions required when running different types of networks. Internal memory handles intermediate needs, while the memory streaming interface interfaces with off-chip storage.

  • 96 TFLOPS performance
  • Support for standard, custom, and proprietary neural networks
  • Readily customized for specific use cases and deployment needs
  • Full software stack provided, including compiler, estimator, scheduler, and quantizer
  • Runs LLM, CNN and other network types
  • Delivered as Soft IP (RTL) or GDS

Download our White Papers

White Papers

Get in Touch With Us

Contact