96a35ca84c
ci / rust (push) Failing after 29s
ci / web (push) Failing after 35s
docker / build-push (., web/Dockerfile, punktfunk-web) (push) Successful in 5s
docker / build-push (ci, ci/rust-ci.Dockerfile, punktfunk-rust-ci) (push) Successful in 3s
docker / build-push (docs-site, docs-site/Dockerfile, punktfunk-docs) (push) Successful in 18s
ci / docs-site (push) Failing after 38s
apple / swift (push) Successful in 1m15s
docker / deploy-docs (push) Successful in 17s
New crate crates/punktfunk-client-linux (binary punktfunk-client), the native Linux client on the Option A architecture (2026-06-12 research): - GTK4/libadwaita shell linking punktfunk-core directly (no C ABI): mDNS host list, TOFU fingerprint prompt, SPAKE2 PIN pairing dialog, preferences (mode/bitrate/gamepad/shortcut capture), stats overlay, --connect host[:port] for scripting. - Video: FFmpeg software HEVC decode (LOW_DELAY, slice threads) -> RGBA -> GdkMemoryTexture inside GtkGraphicsOffload (the dmabuf subsurface path lights up when VAAPI lands; black-background keeps fullscreen scanout-eligible). - Audio: Opus -> PipeWire playback stream, the host virtual-mic's adaptive jitter ring inverted. - Input: keyboard as the exact inverse of the host VK table (evdev keycodes, layout-independent; unit-tested), absolute mouse through the Contain-fit transform, WHEEL_DELTA(120) scroll, compositor shortcut inhibition while streaming, Ctrl+Alt+Shift+Q release chord, F11 fullscreen. SDL3 gamepad capture (single pad-0 model) + rumble and DualSense lightbar feedback on the same thread. - Session pump owns video+audio pulls; the gamepad thread owns rumble+hidout — possible because NativeClient's plane receivers are now mutexed, making it Sync (Arc-shared, compiler-verified per-plane contract instead of the ABI's manual assertion). - Linux-gated deps + a stub main keep cargo build --workspace green on macOS. Validated live against serve --native on this box: 1920x1080@60, locked 60 fps, capture->decoded p50 ~6.4 ms (software decode, debug build). Teardown keys off AdwNavigationPage::hidden — NavigationView push fires a transient unmap/map cycle that must not end the session. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
7.8 KiB
7.8 KiB
title, description
| title | description |
|---|---|
| Status & Progress | Where the work stands, what's live on each box, and a running progress log. |
The living progress tracker. Milestone-level status lives in CLAUDE.md
and the design in the Implementation Plan; this page is the
current state + a dated log of what landed, kept up to date as work happens. Newest first.
Milestones at a glance
| Milestone | State |
|---|---|
M1 — punktfunk-core + C ABI (protocol · FEC · crypto) |
✅ complete & hardened |
| M2 — GameStream host (Moonlight-compatible) | ✅ working end-to-end; HDR/surround-audio polish open |
M3 — punktfunk/1 native protocol (QUIC control + UDP data) |
✅ full session planes, validated live |
| M4 — native client decode + present (Apple first) | 🟡 macOS stage 1 live; stage-2 presenter built + decode-tested (opt-in, present needs live validation). Linux GTK client stage 1 live (2026-06-12) |
Live on the boxes
| Box | Role | Compositor | Notes |
|---|---|---|---|
| home-worker-2 (dev) | KDE/KWin appliance | kwin (headless Plasma) | QEMU VM, passthrough RTX 5070 Ti; serve --native user unit |
| home-worker-3 (GNOME) | GNOME/Mutter appliance | mutter (RecordVirtual) | RTX 4090; autologin GNOME Wayland; serve --native user unit. See Ubuntu — GNOME |
| home-bazzite-1 | SteamOS-like host | gamescope | host-managed Steam session at client mode. See Bazzite Setup |
All three appliances advertise over mDNS (_punktfunk._udp) and require PIN pairing by default.
Progress log
2026-06-12
- Native Linux client — stage 1, first light (
crates/punktfunk-client-linux, binarypunktfunk-client). GTK4/libadwaita app on the Option A architecture picked after a six-angle research pass (toolkits / hw decode / Wayland presentation / input capture / prior art / codebase): linkspunktfunk-coredirectly as a crate (no C ABI;NativeClientisSyncnow), mDNS host list, TOFU + SPAKE2 PIN pairing dialogs (identity shared withclient-rs), FFmpeg software HEVC decode (LOW_DELAY+ slice threads) into aGtkGraphicsOffload-wrapped picture, PipeWire playback with the host mic-player's jitter ring inverted, SDL3 gamepad capture + rumble/lightbar feedback, layout-independent keyboard (exact inverse of the host's VK table), absolute mouse + WHEEL_DELTA scroll, compositor-shortcut inhibition, fullscreen, stats overlay. Validated live against this box'sserve --native: 1080p60 at a locked 60 fps, capture→decoded p50 ≈ 6.4 ms (software decode, debug build). Next: VAAPI dmabuf →GdkDmabufTexture(Tier-1 zero-copy on Intel/AMD clients), DualSense touchpad/motion/trigger replay over SDL3, then the stage-2 raw-Wayland presenter (wp_presentation feedback, tearing-control, Vulkan Video for NVIDIA clients). - Delegated pairing approval (§8b-1) — an unpaired device that tries to connect to a
pairing-required host now shows up as a pending request in the web console's Pairing page;
one click approves it (optionally relabeling) and pairs its certificate fingerprint — no PIN
fetched out of band. New mgmt endpoints (
/native/pending+ approve/deny), an in-memory pending queue inNativePairing(fp-deduped, capped, 10-min expiry), and an optional device name in theHello(back-compat trailing field;client-rs --namesends it). End-to-end tested. §8b-2 (approve from a paired device's own app) is the client-side follow-up. - CI + deployment landed (see the CI & Docker guide). Gitea Actions, three
workflows: Rust workspace checks inside the new
punktfunk-rust-cibuilder image (Ubuntu 26.04, full link-dep stack incl. a libcuda stub — 141/141 tests green in-container), web + docs-site build/typecheck,docker.ymlbuilding+pushingpunktfunk-web/punktfunk-docs/punktfunk-rust-cito the registry, andapple.yml(xcframework →swift build/swift test) on a new host-mode macOS runner (home-mac-mini-1, provisioned byscripts/ci/setup-macos-runner.sh; macOS Local-Network privacy forces it to run as a root LaunchDaemon). Host and native clients stay un-dockerized by design. This site now deploys automatically:deploy-docsships it to unom-1:3220, Caddy serves https://docs.punktfunk.unom.io — live and verified. - Concurrent sessions — the host no longer serves one client at a time. The accept loop spawns
each session (
JoinSet), bounded by--max-concurrent(default 4, a NVENC bound; overflow waits in the accept queue). Each session keeps its own virtual output + encoder; they share the host-lifetime input/audio/mic services — i.e. multiple devices viewing/controlling the same desktop on kwin/mutter/wlroots. Validated live on the GNOME box: two clients connected at once → two independent Mutter virtual outputs (1280×720 + 1920×1080) streaming simultaneously (39 MB + 48 MB). gamescope's independent-desktops (multi-user) isolation — per-session input/audio — is a follow-up. - Apple client latency HUD —
PunktfunkConnection.clockOffsetNs(from the C-ABI getter) +LatencyMetersurface a skew-corrected capture→client-receipt p50/p95 in the macOS HUD: the first cross-machine latency the real Apple client reports. (Stage-1AVSampleBufferDisplayLayerhas no present callback, so decode→present is excluded — that needs the stage-2 presenter.) Needs anxcframeworkrebuild +swift teston the Mac to validate. - Skew handshake in the connector + C ABI —
quic::clock_syncis now a shared core helper used by both the reference client andNativeClient; the connector runs it at connect and exposes the host clock offset over the C ABI (punktfunk_connection_clock_offset_ns). This is the substrate the Apple client needs for the decode→present (glass-to-glass) term. - Wall-clock skew handshake (
ClockProbe/ClockEcho, 8 NTP rounds afterStart) — makes the client's capture→reassembled latency valid cross-machine. Validated GNOME box → dev box: offset −1.57 ms removed, p50 1.30 ms skew-corrected. (05bc9ab) - Native LAN auto-discovery — host advertises
_punktfunk._udp(TXT: fingerprint, pairing, proto);punktfunk-client-rs --discoverlists hosts. Validated cross-LAN. (4fff464) - Third test box stood up — home-worker-3 (Ubuntu 26.04, RTX 4090, GNOME 50): first GNOME/Mutter
zero-copy streaming on a real desktop; 1 Gbps probe clean (625 MB/5 s,
send_dropped=0). Two physical-NVIDIA gotchas documented in Ubuntu — GNOME. - Encode|send thread split validated on real NIC (
send_dropped=0at 720p60 / 1080p120). (b295a5b)
Earlier (see roadmap + git log)
- 1 Gbps data plane: batched
sendmmsg/recvmmsg+ microburst-cap paced send thread. - Boot appliance: headless KDE session + host systemd units (no login).
- Speed test + settable bitrate: negotiation + bandwidth probe (host side).
- DualSense UHID + haptics; gamepads live; mic uplink; AV1 + surround (unit/live-capture tested).
In flight / next
See the Roadmap for the ordered list. Near-term:
- True glass-to-glass: Apple client present-stamp (decode→present) + host render→capture term.
- Apple stage-2 presenter (
VTDecompressionSession→CAMetalLayer) — built + decode-unit-tested + live-validated on glass behind thepunktfunk.presenterflag (capture→present ~11 ms p50); make it the default after a few resolution/HDR checks. - Mandatory PIN pairing + delegated pairing approval (an already-paired device approves a new one).
- gamescope multi-user isolation — per-session input/audio so concurrent sessions are independent desktops (the shared-desktop multi-view case landed).
- bazzite kept up to date (currently offline; one rebuild behind).