FFmpeg Lands Support For NVIDIA AV1 Video Decoding With RTX 30 + NVDEC

[Toggleton]

https://www.xda-developers.com/google-av1-codec-improve-bandwidth-stadia-photos-meet-tv/

https://www.blog.google/products/duo...tay-connected/

google duo is the only one of these where Your device is encoding. For Youtube, netflix and other video streaming services will you only need to decode.
For low bitrate video calls like in google duo is libaom tuned with real time mode --rt and at a high speed setting(--cpu-used6 and up).
AV1 does really work great to hide artifacts at this low bitrate situations so this is a great use case for it.

I guess if stadia will switch to AV1 they will use FPGAs to stream it in real time. nvidia did tease that twitch is working on 1440p120fps AV1 trancoding https://www.nvidia.com/en-us/geforce...-av1-decoding/ Twitch did work with NGCODEC on VP9 trancoding https://blog.twitch.tv/en/2018/12/19...-35db26f6322f/
So i guess they will do the same with AV1 (I think the streamer will still stream with h.264 and twitch will do AV1 in the trancoding steps)
Here a talk from NGCODEC about that work(NGCodec was acquired by Xilinx in July 2019) https://www.youtube.com/watch?v=vcuQuQAX4gU

Not sure if AV1 as Live streaming codecs(Software encoding on the CPU) is the right choice yet https://openbenchmarking.org/test/pts/svt-av1 That are big CPUs with a lot of cores for 1080p in this test(this are results for svt-av1 0.8.0 not sure how the speed of it changed since that)

[aksdb]

google duo is the only one of these where Your device is encoding. For Youtube, netflix and other video streaming services will you only need to decode.
For low bitrate video calls like in google duo is libaom tuned with real time mode --rt and at a high speed setting(--cpu-used6 and up).
AV1 does really work great to hide artifacts at this low bitrate situations so this is a great use case for it.

I guess if stadia will switch to AV1 they will use FPGAs to stream it in real time. nvidia did tease that twitch is working on 1440p120fps AV1 trancoding https://www.nvidia.com/en-us/geforce...-av1-decoding/ Twitch did work with NGCODEC on VP9 trancoding https://blog.twitch.tv/en/2018/12/19...-35db26f6322f/
So i guess they will do the same with AV1 (I think the streamer will still stream with h.264 and twitch will do AV1 in the trancoding steps)
Here a talk from NGCODEC about that work(NGCodec was acquired by Xilinx in July 2019) https://www.youtube.com/watch?v=vcuQuQAX4gU

Not sure if AV1 as Live streaming codecs(Software encoding on the CPU) is the right choice yet https://openbenchmarking.org/test/pts/svt-av1 That are big CPUs with a lot of cores for 1080p in this test(this are results for svt-av1 0.8.0 not sure how the speed of it changed since that)

Thanks for these clarifications. I would not have expected Twitch to transcode those streams (probably same with Youtube Live). As a provider this would be exactly the kind of thing I would try to push to the edges instead of my datacenter. But I guess for the time being where there are no hardware encoders yet (on the mass market), it might still make sense to reduce the multiplexed traffic significantly. Once there are hardware encoders and they are used by the different capture cards (like Elgato) I assume Twitch (and others) would still prefer if the stream is directly encoded in AV1.

[Jabberwocky]

google duo is the only one of these where Your device is encoding. For Youtube, netflix and other video streaming services will you only need to decode.
For low bitrate video calls like in google duo is libaom tuned with real time mode --rt and at a high speed setting(--cpu-used6 and up).
AV1 does really work great to hide artifacts at this low bitrate situations so this is a great use case for it.

I was under the impression that dalaa and vp9 was really good at low bitrate. Is AV1 some how worse or just too slow?

I have not checked up on this tech in ~2 years.