They should use 16-bit and 8-bit precision (with integer values), which are useful for inference, i.e. Intel promised that VNNI instructions would dramatically increase the performance of these processors in neural network operations, the “AI” applications for which these instructions are explicitly designed. The second extension was first featured in the Cooper Lake server Xeons, the first one (VNNI) was one of Intel’s highlights for the 10nm Ice Lake and Tiger Lake processors (10th and 11th generation Core for laptops). This designation subsumed the 512-bit VNNI instructions, also sometimes referred to as AVX512_VNNI, on the one hand, and support for BFloat16 (AVX512_BF16) data type operations on the other. You may have heard of VNNI (Vector Neural Network Instructions) before under the name DL Boost. It seems to bring huge performance improvements in a number of apps, despite the limited 256-bit width of Zen 4 SIMD units. But the Zen 4 cores support another instruction set extension that used to be Intel’s pride and joy, and now the roles have reversed a bit: VNNI. We’ve already discussed their benefits (bigger or smaller) here.

Ryzen 7000 with Zen 4 architecture is the first AMD processor to support 512-bit AVX-512 vector instructions.

Video enhance ai topaz labs