AVX / AVX2 / AVX-512 Performance + Power On Intel Rocket Lake
Written by Michael Larabel in Software on 7 April 2021. Page 3 of 6. 59 Comments

The NCNN neural network inference framework from Tencent does benefit greatly from AVX-512 as we have seen many times previously. (For reference, its build does have problems though just with AVX1.)

The average CPU power consumption during the NCNN benchmark run was 17% higher than the AVX2 enabled run. So in power efficiency terms still doesn't bode well but this is one of the workloads where if just caring about the best performance using AVX-512 does prove worthwhile.

Related Articles
Trending Linux News