H.264/H.265 Vulkan Encoder Support Merged Into FFmpeg

[phoronix]

Phoronix: H.264/H.265 Vulkan Encoder Support Merged Into FFmpeg

The FFmpeg multimedia library continues to enhance its support around the Vulkan Video APIs with the latest commits seeing H.264 and H.265/HEVC Vulkan encode support merged...

https://www.phoronix.com/news/FFmpeg-Vulkan-Encode-H.265

[Quackdoc]

apparently the h264 encoder has feature parity with vaapi, it should also allow you to do vulkan processing with a little less overhead. I have not yet tested that.

[uid313]

So this is encode for H.264 and H.265, what about decode for H.264 and H.265?

What about support for H.266 and AV1?

[avis]

So this is encode for H.264 and H.265, what about decode for H.264 and H.265?

Been there for ages.

What about support for H.266 and AV1?

AV1 decoding via Vulkan is already there, not sure if ffmpeg supports it, it must, check VK_KHR_video_decode_av1. Encoding is far off.

H.266/VVC is not supported by Vulkan or anything else in hardware at all because only Intel has a HW video decoder and it's still a week away, that's Lunar Lake.

[shmerl]

What's the story with pipewire / xdg portals screen recording support in ffmpeg? There were some recent patches but not sure where it went.

I want to get rid of OBS in a scenario of LAN streaming since OBS can't handle hardware acceleration for that.

[shmerl]

AV1 decoding via Vulkan is yet to be standardized. Encoding is far off.

AV1 decoding is already standardized? Only encoding is still wip.

https://registry.khronos.org/vulkan/specs/1.3-extensions/man/html/VK_KHR_video_decode_av1.html

[Quackdoc]

What's the story with pipewire / xdg portals screen recording support in ffmpeg? There were some recent patches but not sure where it went.

I want to get rid of OBS in a scenario of LAN streaming since OBS can't handle hardware acceleration for that.

still in limbo as far as I am aware, the dev has not updated the patchset yet. The latest patch is from may, but there was discussion on it in august where I suggested some changes to remove the hard requirement on portals.

[avis]

AV1 decoding is already standardized? Only encoding is still wip.

Thanks a lot, couldn't find it, I fixed the post.

[shmerl]

still in limbo as far as I am aware, the dev has not updated the patchset yet. The latest patch is from may, but there was discussion on it in august where I suggested some changes to remove the hard requirement on portals.

I see. I hope it will get somewhere, since current ffmpeg's screen grabbing is inadequate for Wayland.

[shmerl]

Vulkan video encoding with ffmpeg works with nvidia but not with amd yet. On AMD you need to set the environment variable RADV_PERFTEST=video_encode and then it will fail because amd is missing support for VK_KHR_video_maintenance1 extension (see https://gitlab.freedesktop.org/mesa/mesa/-/issues/11857).

Your bug is about anv. radv supports VK_KHR_video_maintenance1 already.