Chip Giants Collaborate on New AI Specifications

Chip Giants Collaborate on New AI Specifications

Foto: Depositphotos

Arm, Intel, and Nvidia have jointly authored a paper describing an 8-bit floating point (FP8) specification and its two variants E5M2 and E4M3. This should provide a common interchangeable format that works for both AI training and inference.

This cross-industry specification alignment will allow AI models to operate and perform consistently across hardware platforms, accelerating AI software development. Computational requirements for AI have been growing at an exponential rate. Innovation is required across hardware and software to deliver the computational throughput needed to advance AI.

One of the promising areas of research to address this growing compute gap is to reduce the numeric precision requirements for deep learning to improve memory and computational efficiencies. Reduced-precision methods exploit the inherent noise-resilient properties of deep neural networks to improve compute efficiency.

FP8 minimizes deviations from existing IEEE 754 floating point formats with a good balance between hardware and software to leverage existing implementations, accelerate adoption and improve developer productivity. The guiding principle of this format proposal from Arm, Intel, and Nvidia is to leverage conventions, concepts, and algorithms built on IEEE standardization. This enables the greatest latitude for future AI innovation while still adhering to current industry conventions.

More from category

Qualcomm Introduces New IoT and Robotics Products

Qualcomm Introduces New IoT and Robotics Products

20 Mar 2023 comment

Qualcomm announced the first integrated 5G IoT processors that are designed to support four major operating systems, in addition to two new robotics platforms, and an accelerator program for IoT ecosystem partners.

Qualcomm Unveils Snapdragon 7+ Gen 2 Mobile Platform

Qualcomm Unveils Snapdragon 7+ Gen 2 Mobile Platform

18 Mar 2023 comment

Qualcomm announced a mobile chipset bringing some of its high-end flagship features into its Snapdragon 7-series.

Bosch Drives Forward the Development of 6G

Bosch Drives Forward the Development of 6G

12 Mar 2023 comment

Bosch is actively involved in projects, alliances, and initiatives at both the national and international levels to lay important foundations for 6G technology.