enricobuehler 2d37835545 feat(encode): AV1 on the Linux Vulkan Video encoder (real RFI) ...

Extend the raw Vulkan Video backend to AV1 (`VK_KHR_video_encode_av1`)
alongside HEVC, so AMD/Intel Linux hosts get the same clean-P-frame loss
recovery for AV1 that HEVC already has — no full IDR on packet loss.

ash 0.38.0+1.3.281 predates the AV1-encode extension (finalized in Vulkan
1.3.290) and bumping ash breaks the SDL/Vulkan client (it drops the
lifetime on AllocationCallbacks, which sdl3-sys still generates). So the
AV1-encode structs/flags/enums are vendored host-only in
`encode/linux/vk_av1_encode.rs`, copied verbatim from ash-master's
generated code and chained into ash's generic video-encode calls via raw
p_next — the common StdVideoAV1* types (from AV1 decode) are reused from
ash 1.3.281.

`vulkan_video.rs` gains a parallel AV1 path: AV1 Main profile/caps/session
(+ max-level session-create), a bit-packed sequence-header OBU + per-frame
temporal-delimiter framing (Vulkan AV1 encode, unlike H26x, emits only the
frame OBU), and per-frame StdVideoEncodeAV1PictureInfo with the RFI
reference model — a normal P inherits CDF context from its reference for
compression, while an IDR or recovery anchor sets primary_ref_frame=NONE +
error_resilient_mode so it decodes independent of the (possibly lost)
frames since its reference. HEVC recording is unchanged; the shared CSC /
ring / DPB-barrier pipeline is reused as-is. Codec routing in
`open_video_backend` extends the HEVC arm to HEVC|AV1.

The seq header enables only order-hint (+128px superblocks per caps),
matching FFmpeg's proven Vulkan AV1 config — enabling CDEF/restoration made
VCN emit frame-header sections our seq header didn't match, desyncing every
inter frame.

Headless-validated on real RADV (780M): open + 6-frame encode (I P P P P P)
decodes 0-error on both dav1d and ffmpeg/cbs; the RFI recovery anchor at
frame 4 is a clean P (not IDR), and dropping the "lost" frame 3 still
decodes clean (re-anchored to frame 2). HEVC smoke unchanged (no
regression). `cargo clippy --features vulkan-encode -- -D warnings` and the
no-feature build both green.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-07-12 22:06:24 +02:00

..

mod.rs

fix(encode): harden loss-recovery correctness across host encoders (F1–F7)

2026-07-12 11:17:19 +02:00

nvenc_cuda.rs

style(encode): rustfmt the direct-SDK NVENC Linux backend

2026-07-12 11:35:07 +02:00

rgb2yuv.comp

fix+perf(encode): clamp Vulkan CSC to source edge + cache dmabuf imports

2026-07-12 19:24:12 +02:00

rgb2yuv.spv

fix+perf(encode): clamp Vulkan CSC to source edge + cache dmabuf imports

2026-07-12 19:24:12 +02:00

vaapi.rs

fix(encode): harden loss-recovery correctness across host encoders (F1–F7)

2026-07-12 11:17:19 +02:00

vk_av1_encode.rs

feat(encode): AV1 on the Linux Vulkan Video encoder (real RFI)

2026-07-12 22:06:24 +02:00

vulkan_video.rs

feat(encode): AV1 on the Linux Vulkan Video encoder (real RFI)

2026-07-12 22:06:24 +02:00