9c8fa9340c
apple / swift (push) Failing after 40s
audit / cargo-audit (push) Failing after 1m12s
windows-msix / package (push) Successful in 1m37s
windows / build (push) Successful in 1m14s
android / android (push) Successful in 4m48s
ci / web (push) Successful in 27s
ci / rust (push) Successful in 4m21s
ci / docs-site (push) Successful in 31s
ci / bench (push) Successful in 4m39s
decky / build-publish (push) Successful in 11s
docker / build-push (--build-arg FEDORA_VERSION=44, ci, ci/fedora-rpm.Dockerfile, punktfunk-fedora44-rpm) (push) Successful in 5s
docker / build-push (., web/Dockerfile, punktfunk-web) (push) Successful in 4s
docker / build-push (ci, ci/fedora-rpm.Dockerfile, punktfunk-fedora-rpm) (push) Successful in 4s
docker / build-push (ci, ci/rust-ci.Dockerfile, punktfunk-rust-ci) (push) Successful in 4s
docker / build-push (docs-site, docs-site/Dockerfile, punktfunk-docs) (push) Successful in 19s
deb / build-publish (push) Successful in 6m3s
flatpak / build-publish (push) Successful in 4m13s
rpm / build-publish (bazzite, punktfunk-fedora-rpm) (push) Successful in 8m15s
rpm / build-publish (fedora-44, punktfunk-fedora44-rpm) (push) Successful in 8m16s
docker / deploy-docs (push) Successful in 18s
Two bodies of work in one commit (the rename moved files the fixes also touched). Naming/structure cleanup (pre-launch): - Host modules m3.rs->punktfunk1.rs, m0.rs->spike.rs; CLI m3-host->punktfunk1-host, m0->spike; bare `punktfunk-host` now prints help. Types M3Options/M3Source-> Punktfunk1Options/Punktfunk1Source. - Clients consolidated out of crates/ into clients/: punktfunk-client-rs-> clients/probe (crate punktfunk-probe), client-linux->clients/linux, client-windows->clients/windows, punktfunk-android->clients/android/native (crate punktfunk-client-android; kept [lib] name=punktfunk_android so the JNI contract is unchanged). crates/ now holds only core + host. - Milestone codes M0-M4 purged from code/CLI/CLAUDE.md/README/docs/docs-site, kept only in docs/implementation-plan.md. docs/m2-plan.md-> docs/gamestream-host-plan.md. CI/gradle/flatpak paths updated. Client loss-recovery (video froze and never recovered after a brief drop): - Export punktfunk_connection_frames_dropped through the C ABI (the core already tracked it for the client keyframe-recovery loop; it was never reachable from the ABI clients). Regenerated punktfunk_core.h. - Apple (StreamPump + Stage2Pipeline) and Android (decode.rs) now poll frames_dropped and request a keyframe when it climbs -- the same loss-driven recovery Linux/Windows already had. Under infinite GOP the decoder silently conceals reference-missing frames, so the decode-error trigger rarely fires. Apple rumble robustness (worked then went spotty -- DualSense + Xbox): - Add CHHapticEngine stopped/reset handlers (rebuild on app background / audio interruption / server reset) and drop the permanent `broken` latch on a transient drive failure; latch only when the controller truly has no haptics. - Surface swallowed SDL set_rumble errors on Linux/Windows + diagnostic logging. Verified: cargo build/clippy/fmt --workspace, C-ABI harness, header drift. Not runnable on this box (verify in CI): Gitea workflows, gradle/Android, flatpak, Swift/decky. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
7.8 KiB
7.8 KiB
title, description
| title | description |
|---|---|
| Status & Progress | Where the work stands, what's live on each box, and a running progress log. |
The living progress tracker. Milestone-level status lives in CLAUDE.md
and the design in the Implementation Plan; this page is the
current state + a dated log of what landed, kept up to date as work happens. Newest first.
Milestones at a glance
| Milestone | State |
|---|---|
Core — punktfunk-core + C ABI (protocol · FEC · crypto) |
✅ complete & hardened |
| GameStream host (Moonlight-compatible) | ✅ working end-to-end; HDR/surround-audio polish open |
Native protocol — punktfunk/1 (QUIC control + UDP data) |
✅ full session planes, validated live |
| Native clients — decode + present (Apple first) | 🟡 macOS stage 1 live; stage-2 presenter built + decode-tested (opt-in, present needs live validation). Linux GTK client stage 1 live (2026-06-12) |
Live on the boxes
| Box | Role | Compositor | Notes |
|---|---|---|---|
| home-worker-2 (dev) | KDE/KWin appliance | kwin (headless Plasma) | QEMU VM, passthrough RTX 5070 Ti; serve --native user unit |
| home-worker-3 (GNOME) | GNOME/Mutter appliance | mutter (RecordVirtual) | RTX 4090; autologin GNOME Wayland; serve --native user unit. See Ubuntu — GNOME |
| home-bazzite-1 | SteamOS-like host | gamescope | host-managed Steam session at client mode. See Bazzite Setup |
All three appliances advertise over mDNS (_punktfunk._udp) and require PIN pairing by default.
Progress log
2026-06-12
- Native Linux client — stage 1, first light (
clients/linux, binarypunktfunk-client). GTK4/libadwaita app on the Option A architecture picked after a six-angle research pass (toolkits / hw decode / Wayland presentation / input capture / prior art / codebase): linkspunktfunk-coredirectly as a crate (no C ABI;NativeClientisSyncnow), mDNS host list, TOFU + SPAKE2 PIN pairing dialogs (identity shared withclient-rs), FFmpeg software HEVC decode (LOW_DELAY+ slice threads) into aGtkGraphicsOffload-wrapped picture, PipeWire playback with the host mic-player's jitter ring inverted, SDL3 gamepad capture + rumble/lightbar feedback, layout-independent keyboard (exact inverse of the host's VK table), absolute mouse + WHEEL_DELTA scroll, compositor-shortcut inhibition, fullscreen, stats overlay. Validated live against this box'sserve --native: 1080p60 at a locked 60 fps, capture→decoded p50 ≈ 6.4 ms (software decode, debug build). Next: VAAPI dmabuf →GdkDmabufTexture(Tier-1 zero-copy on Intel/AMD clients), DualSense touchpad/motion/trigger replay over SDL3, then the stage-2 raw-Wayland presenter (wp_presentation feedback, tearing-control, Vulkan Video for NVIDIA clients). - Delegated pairing approval (§8b-1) — an unpaired device that tries to connect to a
pairing-required host now shows up as a pending request in the web console's Pairing page;
one click approves it (optionally relabeling) and pairs its certificate fingerprint — no PIN
fetched out of band. New mgmt endpoints (
/native/pending+ approve/deny), an in-memory pending queue inNativePairing(fp-deduped, capped, 10-min expiry), and an optional device name in theHello(back-compat trailing field;client-rs --namesends it). End-to-end tested. §8b-2 (approve from a paired device's own app) is the client-side follow-up. - CI + deployment landed (see the CI & Docker guide). Gitea Actions, three
workflows: Rust workspace checks inside the new
punktfunk-rust-cibuilder image (Ubuntu 26.04, full link-dep stack incl. a libcuda stub — 141/141 tests green in-container), web + docs-site build/typecheck,docker.ymlbuilding+pushingpunktfunk-web/punktfunk-docs/punktfunk-rust-cito the registry, andapple.yml(xcframework →swift build/swift test) on a new host-mode macOS runner (home-mac-mini-1, provisioned byscripts/ci/setup-macos-runner.sh; macOS Local-Network privacy forces it to run as a root LaunchDaemon). Host and native clients stay un-dockerized by design. This site now deploys automatically:deploy-docsships it to unom-1:3220, Caddy serves https://docs.punktfunk.unom.io — live and verified. - Concurrent sessions — the host no longer serves one client at a time. The accept loop spawns
each session (
JoinSet), bounded by--max-concurrent(default 4, a NVENC bound; overflow waits in the accept queue). Each session keeps its own virtual output + encoder; they share the host-lifetime input/audio/mic services — i.e. multiple devices viewing/controlling the same desktop on kwin/mutter/wlroots. Validated live on the GNOME box: two clients connected at once → two independent Mutter virtual outputs (1280×720 + 1920×1080) streaming simultaneously (39 MB + 48 MB). gamescope's independent-desktops (multi-user) isolation — per-session input/audio — is a follow-up. - Apple client latency HUD —
PunktfunkConnection.clockOffsetNs(from the C-ABI getter) +LatencyMetersurface a skew-corrected capture→client-receipt p50/p95 in the macOS HUD: the first cross-machine latency the real Apple client reports. (Stage-1AVSampleBufferDisplayLayerhas no present callback, so decode→present is excluded — that needs the stage-2 presenter.) Needs anxcframeworkrebuild +swift teston the Mac to validate. - Skew handshake in the connector + C ABI —
quic::clock_syncis now a shared core helper used by both the reference client andNativeClient; the connector runs it at connect and exposes the host clock offset over the C ABI (punktfunk_connection_clock_offset_ns). This is the substrate the Apple client needs for the decode→present (glass-to-glass) term. - Wall-clock skew handshake (
ClockProbe/ClockEcho, 8 NTP rounds afterStart) — makes the client's capture→reassembled latency valid cross-machine. Validated GNOME box → dev box: offset −1.57 ms removed, p50 1.30 ms skew-corrected. (05bc9ab) - Native LAN auto-discovery — host advertises
_punktfunk._udp(TXT: fingerprint, pairing, proto);punktfunk-probe --discoverlists hosts. Validated cross-LAN. (4fff464) - Third test box stood up — home-worker-3 (Ubuntu 26.04, RTX 4090, GNOME 50): first GNOME/Mutter
zero-copy streaming on a real desktop; 1 Gbps probe clean (625 MB/5 s,
send_dropped=0). Two physical-NVIDIA gotchas documented in Ubuntu — GNOME. - Encode|send thread split validated on real NIC (
send_dropped=0at 720p60 / 1080p120). (b295a5b)
Earlier (see roadmap + git log)
- 1 Gbps data plane: batched
sendmmsg/recvmmsg+ microburst-cap paced send thread. - Boot appliance: headless KDE session + host systemd units (no login).
- Speed test + settable bitrate: negotiation + bandwidth probe (host side).
- DualSense UHID + haptics; gamepads live; mic uplink; AV1 + surround (unit/live-capture tested).
In flight / next
See the Roadmap for the ordered list. Near-term:
- True glass-to-glass: Apple client present-stamp (decode→present) + host render→capture term.
- Apple stage-2 presenter (
VTDecompressionSession→CAMetalLayer) — built + decode-unit-tested + live-validated on glass behind thepunktfunk.presenterflag (capture→present ~11 ms p50); make it the default after a few resolution/HDR checks. - Mandatory PIN pairing + delegated pairing approval (an already-paired device approves a new one).
- gamescope multi-user isolation — per-session input/audio so concurrent sessions are independent desktops (the shared-desktop multi-view case landed).
- bazzite kept up to date (currently offline; one rebuild behind).