AlphaIC sampling Gluon chip for edge AI
source link: https://venturebeat.com/2022/02/07/alphaic-starts-sampling-gluon-chip-for-edge-ai/
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
AlphaIC sampling Gluon chip for edge AI
Join today's leading executives online at the Data Summit on March 9th. Register here.
Start-up AlphaIC yesterday announced that it has begun sampling its Gluon coprocessor for edge AI inference to customers. AlphaIC claims the chip delivers competitive performance compared to Nvidia in vision workloads such as object detection.
Gluon is based on AlphaIC’s proprietary architecture that has an instruction set architecture (ISA) optimized for AI, and has been in development for two years. The ISA refers to the instructions that a chip can process. AlphaIC calls it Real AI Processor (RAT) architecture. AlphaIC further has a SDK with support for TensorFlow. The company reports that other frameworks are in development.
A theoretical disadvantage isn’t holding Gluon back
As the company’s first chip based on the RAT architecture, Gluon has 8 TOPS — a metric that means trillions of operations per second, or “tera operations per second” — of compute capabilities for deep learning neural networks. Although this isn’t particularly high, and comparable to (or even lower than) other edge AI and smartphone chips, AlphaIC claims it has higher utilization (higher performance per TOPS), resulting in higher performance. Gluon further supports PCIe and LPDDR4 interfaces. The chip itself is manufactured on TSMC’s 16nm process, which puts it at a theoretical disadvantage compared to other chips that may have already moved to more advanced nodes such as 7nm or even 5nm.
Nevertheless, AlphaIC provided some benchmarks to prove the chip’s capabilities, as it claims Gluon has higher performance per watt and performance per TOPS than Nvidia’s edge chips. In Yolo-V2, Gluon reportedly achieves 153 frames per second while consuming just below 5W, and 308 frames per second in ResNet-50 at 3.5W.
For comparison, according to Nvidia, the Jetson TX2, which has a 7.5W TDP, achieves just 112fps in both Yolo-V3 and ResNet-50. The Jetson Xavier NX, which is rated at 10-20W and 21 TOPS, achieves 1100fps in ResNet-50.
As a coprocessor targeted at the edge segment, where power is often a constraint, Gluon is aimed at vision workloads such as classification and detection. Segments where these capabilities are applied they include surveillance, industrial, retail, and smart cities.
AlphaIC is based in Milpitas and raised $8 million a year ago. The company was founded in 2016 by Vinod Dham, a former Intel executive known as the “father of the Pentium.”
VentureBeat's mission is to be a digital town square for technical decision-makers to gain knowledge about transformative enterprise technology and transact. Learn More
Recommend
-
102
README.rst GluonNLP: Your Choice of Deep Learning...
-
56
README.md Gluon CV Toolkit
-
64
THE NEXT BIG small THING™ Gluon Erlang Abstract Machine A configurable and small virtual machine whi...
-
188
Presenting a hobby project that I’ve been doing for several months now. It is named after “gluon”, a particle which acts as the exchange particle for the strong force betwe...
-
38
The IT landscape is constantly evolving. For client applications, there is a clear trend towards bundled native applications and appstores. One of the answers Java has in this area is jpackage. With jpackage, developers can bundle their Java(FX)...
-
42
It has always been our goal to provide first class Java and JavaFX support for all client devices, not only for desktops but also for mobile and embedded devices. Today, we are thrilled to announce that the Gluon Client plugins which we announce...
-
7
Neuromorphic Chip Maker Takes Aim At The Edge Neuromorphic computing has garnered a lot of attention over the past few years, largely driven by its potential to deliver low-power artificial intelligence to the masses. Howeve...
-
6
Gluon Releases SceneBuilder 16 Apr 13, 2021 2 min read...
-
10
Neuromorphic edge AI chip debuts on Raspberry Pi and Comet Lake dev kits Oct 25, 2021 — by Eric Brown 142 views...
-
4
Open Window API # Opening a Window in Gluon is as simple as one function call, with more options available if you need them like window size or...
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK