New Intel Mesa Driver Patches Implement AV1 Decode For Vulkan Video

[phoronix]

Phoronix: New Intel Mesa Driver Patches Implement AV1 Decode For Vulkan Video

While there has been Vulkan Video support within Intel's open-source "ANV" driver since early 2023 and extended over time to handle H.265/HEVC decode, H.264 and H.265 encode, and more, the AV1 decode support has lagged behind until now...

https://www.phoronix.com/news/Intel-ANV-Vulkan-Video-AV1-Dec

[risho]

I've seen mention of vulkan video for a while now. I'm curious, if these things are vulkan compliant what would this have to do with intel? shouldn't all vulkan compliant drivers be able to use this? is this stuff a part of the standard vulkan graphics apis or is this something separate?

also does this mean that ultimately even older gpus that don't have dedicated av1 decode/encode hardware will gain access to hardware accelerated encode/decode?

[Quackdoc]

I've seen mention of vulkan video for a while now. I'm curious, if these things are vulkan compliant what would this have to do with intel? shouldn't all vulkan compliant drivers be able to use this? is this stuff a part of the standard vulkan graphics apis or is this something separate?

also does this mean that ultimately even older gpus that don't have dedicated av1 decode/encode hardware will gain access to hardware accelerated encode/decode?

The vulkan extension is just an interface to the hwdecode asics on gpu. no gpus will get expanded support.

[Pheoxy]

The vulkan extension is just an interface to the hwdecode asics on gpu. no gpus will get expanded support.

Exactly, it's just a more standardized way to access the hardware layer so vendors do not have to also create their own interface layer allowing them to focus more on the driver instead and saves on duplicated work.

I'm very interested in this as it makes scripts and handling workflows easier to manage and I don't have to do more work on verifying configuration settings between vendors with tools like ffmpeg.

[Quackdoc]

Exactly, it's just a more standardized way to access the hardware layer so vendors do not have to also create their own interface layer allowing them to focus more on the driver instead and saves on duplicated work.

I'm very interested in this as it makes scripts and handling workflows easier to manage and I don't have to do more work on verifying configuration settings between vendors with tools like ffmpeg.

well as long as you don't plan on using your scripts on arm/risc-v sbcs using their hwaccelerated stuff it should be fine. If you use vulkan processing like libplacebo you should also be getting more perf there.

[darkbasic]

av9 next please.

[Pheoxy]

well as long as you don't plan on using your scripts on arm/risc-v sbcs using their hwaccelerated stuff it should be fine. If you use vulkan processing like libplacebo you should also be getting more perf there.

I haven't seen anything about this. Vulkan video extensions don't seem to get much attention in details like this.

Do different architecture also have some affect I should be accounting for or be careful of?

[Quackdoc]

I haven't seen anything about this. Vulkan video extensions don't seem to get much attention in details like this.

Do different architecture also have some affect I should be accounting for or be careful of?

vulkan video is for GPU hwaccel asics. ARM and Riscv SBCs hwaccelerators are typically not part of the GPU. so in the first place, vulkan video accel doesn't really make sense for them.

[Pheoxy]

vulkan video is for GPU hwaccel asics. ARM and Riscv SBCs hwaccelerators are typically not part of the GPU. so in the first place, vulkan video accel doesn't really make sense for them.

Ah, ah well I didn't really expect much on current devices in arm64 for hardware acceleration anyways. Anything I use that needs acceleration usually gets pointed to my amd64 machines anyways.

[polarathene]

vulkan video is for GPU hwaccel asics. ARM and Riscv SBCs hwaccelerators are typically not part of the GPU. so in the first place, vulkan video accel doesn't really make sense for them.

Igalia seems to have plans for gstreamer and implementing mobile support based on these slides?

https://www.slideshare.net/slideshow/gst-vulkan-video-2024-edition/272667924

So perhaps there's some way that's wired up with mobile devices that offer vulkan drivers? They also talk about a zink experiment to leverage vulkan video.