• Skip to main content
  • Skip to footer

Expedera

  • Home
  • Products
    • Products Overview
    • Origin E1
    • Origin E2
    • Origin E6
    • Origin E8
    • TimbreAI T3
  • Applications
    • Mobile
    • Consumer
    • AR/VR/XR
    • Home Appliances
    • Automotive
    • Industrial
  • News
    • News
    • In the News
    • Blog
    • Webinars
    • Events
    • White Papers
  • About Us
    • Company
    • Leadership
    • Careers
    • Contact Us
  • Search
  • English
    • 简体中文

Search

Home Hero

Origin E6

Download Origin E6 Product Brief

Optimal AI Inference in a performance, power- and area-optimized package

The Origin™ E6 is a family of performance-optimized Neural Processing Unit (NPU) IP cores designed for image and point cloud-related Artificial Intelligence (AI) usage in smartphones, AR/VR headsets, and other devices. Products like these require performance-intensive AI inference but also mandate balancing performance with power and area requirements. The Origin E6 family optimizes power consumption through careful attention to utilization and reduced external memory requirements while lowering latency to an absolute minimum. The E6 offers performance from 16 to 32 TOPS.

Native Execution: a New NPU Paradigm
Typical AI accelerators—often repurposed CPUs (Central Processing Units) or GPUs (Graphic Processing Units)—rely on a complex software stack that converts a neural network into a long sequence of basic instructions. Execution of these instructions tends to be inefficient, with low processor utilization ranging from 20 to 40%. Taking a new approach, Expedera designed Origin specifically as an NPU that efficiently executes the neural network directly using metadata and achieves sustained utilization averaging 80%. The metadata indicates the function of each layer (such as convolution or pooling) and other important details, such as the size and shape of the convolution. No changes to your trained neural networks are required, and there is no perceivable reduction in model accuracy. This approach greatly simplifies the software, and Expedera provides a robust stack based on Apache TVM. Expedera’s native execution eases the adoption of new models and reduces time to market.

Support for a Wide Variety of Neural Networks
Artificial Intelligence is a fast-developing science, and new neural networks are released almost daily. Expedera’s Origin E6 NPU supports RNN, CNN, LSTM, and other neural networks. Native support is provided for Inception, MobileNet, YOLO v3, FSRCNN, EfficientNet, Unet and many other neural networks with input resolutions up to 8K, including support for transformers. In addition, Origin includes support for custom and proprietary networks and offers provisions for future-proofing your design.

Optimized for Your Specific Needs
While there are many general-purpose AI processors, a one-size-fits-all solution is rarely the most efficient. General-purpose AI processors are often larger than needed for a specific application and consume more power than necessary. The Origin E6 IP cores are optimized for a customer’s application-specific area and power requirements. Whether performance-optimized for a specific single or series of networks, sized to meet silicon area constraints or configured to meet system power requirements, the E6 will provide optimal PPA (power, performance, area). Expedera can typically achieve superior performance in about half the silicon area required by other NPUs. During the design process, Expedera works with clients to understand their specific application needs and constraints and provides cycle accurate PPA estimations before delivery of the IP.

The customer-reported data set below illustrates how Expedera’s natively efficient architecture, combined with optimization, leads to huge performance gains. Running a 4K video denoising algorithm, the customer wanted to increase throughput, since their former NPU could process only a few frames per second (FPS). Using Expedera’s Origin, FPS performance grew by 20X—while consuming less than half the power, a more than 40X increase in PPA.

Market-leading Power Efficiency
Understanding the comparative power efficiencies of NPUs can be complicated. Ours isn’t— Expedera’s Origin family averages a market-leading 18 TOPS/W, where we assume a TSMC 7nm process, running ResNet50 at an INT8 precision throughout with a 1GHz system clock. No sparsity, compression or pruning is applied, though all are supported and may further increase power efficiency. Origin has repeatedly been cited as the most power efficient NPU available.

Silicon-Proven and Deployed in Millions of Consumer Products
Choosing the right AI processor can ‘make or break’ a design. The Origin architecture is silicon-proven in leading-edge process nodes and successfully shipped in millions of consumer devices worldwide.

Features
Specifications
  • 16 – 32 TOPS performance, performance efficiency up to 18 TOPS/Watt
  • Scalable performance to 16K MACS
  • Support up to 8K input resolutions
  • Advanced activation memory management
  • Low latency
  • Compatible with various DNN models
  • Hardware scheduler for NN
  • Processes model as trained, no need for software optimizations
  • Use familiar open-source platforms like TFlite
  • Delivered as soft IP: portable to any process

Compute Capacity8K to 16K INT8 MACs
Multi-taskingRun up to 2 Simultaneous Jobs
Power Efficiency18 Effective TOPS/W (INT8)
NN SupportCNN, RNN, LSTM and other NN architectures
Layer SupportStandard NN functions, including Conv, Deconv, FC, Activations, Reshape, Concat, Elementwise, Pooling, Softmax etc.
Programmable general FP function, including Sigmoid, Tanh, Sine, Cosine, Exp, etc.

Data typesINT4/INT8/INT10/INT12/INT16 Activations/Weights
FP16/BFloat16 Activations/Weights
QuantizationChannel-wise Quantization (TFLite Specification)
Optional custom Quantization based on workload needs
LatencyDeterministic Performance Guarantees
Memory Smart System Memory Allocation and Scheduling
FrameworksTensorFlow, TFlite, ONNX
WorkloadsCapable of running large DNN networks

Advantages

Industry-leading performance and power efficiency.

Industry-leading performance and power efficiency.

Drastically reduces memory requirements.

Architected to serve wide range of compute requirements.

No DRAM required.

On-chip memory and system DRAM work together to improve bandwidth.

Drastically reduces memory requirements.

Drastically reduces memory requirements.

Run trained models unchanged without the need for hardware dependent optimizations.

Deterministic, real-time performance.

Improved performance for your workloads, while still running breadth of models.

Flexible for changing applications.

Simple software stack.

Simple software stack.

Achieve same accuracy your trained model.

Achieve same accuracy your trained model.

Simplifies deployment to end customers.

Simplifies deployment to end customers.

Benefits

  • Efficiency: industry-leading 18 TOPS/W enables greater processing efficiencies with lower power consumption
  • Simplicity: eliminates complicated compilers, easing design complexity, reducing cost, and speeding time-to-market
  • Configurability: independently configurable building blocks allow for design optimization– right sized deployments
  • Predictability: deterministic, QoS
  • Scalability: from 16 to 32 TOPS a single scalable architecture addresses a wide range of application performance requirements
  • Deployability: best-in-market TOPS/mm2 assures ideal processing/chip size designs
Download our White Papers

Download our White Papers

White Papers

Get in Touch With Us

Get in Touch With Us

Contact

STAY INFORMED

Subscribe
to our News

Sign up today and receive helpful
resources delivered directly
to your inbox.

Footer Logo
  • Products
    • Products Overview
    • Origin E1
    • Origin E2
    • Origin E6
    • Origin E8
    • TimbreAI T3
  • Applications
    • Mobile
    • Consumer
    • Home Appliances
    • Automotive
    • Industrial
  • News
    • News
    • Events
    • White Papers
  • About Us
    • Leadership
    • Careers
  • Contact Us

Copyright © 2023 Expedera, all rights reserved
• Terms of Services • Privacy Policy

This website uses cookies. Please see our Privacy Policy to learn more.
By continuing to use this site without changing your cookies settings, you consent to the use of our cookies. Accept Reject Cookie settings
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT