enricobuehler
96a35ca84c
ci / rust (push) Failing after 29s
ci / web (push) Failing after 35s
docker / build-push (., web/Dockerfile, punktfunk-web) (push) Successful in 5s
docker / build-push (ci, ci/rust-ci.Dockerfile, punktfunk-rust-ci) (push) Successful in 3s
docker / build-push (docs-site, docs-site/Dockerfile, punktfunk-docs) (push) Successful in 18s
ci / docs-site (push) Failing after 38s
apple / swift (push) Successful in 1m15s
docker / deploy-docs (push) Successful in 17s
New crate crates/punktfunk-client-linux (binary punktfunk-client), the native Linux client on the Option A architecture (2026-06-12 research): - GTK4/libadwaita shell linking punktfunk-core directly (no C ABI): mDNS host list, TOFU fingerprint prompt, SPAKE2 PIN pairing dialog, preferences (mode/bitrate/gamepad/shortcut capture), stats overlay, --connect host[:port] for scripting. - Video: FFmpeg software HEVC decode (LOW_DELAY, slice threads) -> RGBA -> GdkMemoryTexture inside GtkGraphicsOffload (the dmabuf subsurface path lights up when VAAPI lands; black-background keeps fullscreen scanout-eligible). - Audio: Opus -> PipeWire playback stream, the host virtual-mic's adaptive jitter ring inverted. - Input: keyboard as the exact inverse of the host VK table (evdev keycodes, layout-independent; unit-tested), absolute mouse through the Contain-fit transform, WHEEL_DELTA(120) scroll, compositor shortcut inhibition while streaming, Ctrl+Alt+Shift+Q release chord, F11 fullscreen. SDL3 gamepad capture (single pad-0 model) + rumble and DualSense lightbar feedback on the same thread. - Session pump owns video+audio pulls; the gamepad thread owns rumble+hidout — possible because NativeClient's plane receivers are now mutexed, making it Sync (Arc-shared, compiler-verified per-plane contract instead of the ABI's manual assertion). - Linux-gated deps + a stub main keep cargo build --workspace green on macOS. Validated live against serve --native on this box: 1920x1080@60, locked 60 fps, capture->decoded p50 ~6.4 ms (software decode, debug build). Teardown keys off AdwNavigationPage::hidden — NavigationView push fires a transient unmap/map cycle that must not end the session. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
105 lines
7.8 KiB
Markdown
105 lines
7.8 KiB
Markdown
---
|
||
title: "Status & Progress"
|
||
description: "Where the work stands, what's live on each box, and a running progress log."
|
||
---
|
||
|
||
The living progress tracker. Milestone-level status lives in [`CLAUDE.md`](https://github.com)
|
||
and the design in the [Implementation Plan](/docs/implementation-plan); this page is the
|
||
**current state + a dated log** of what landed, kept up to date as work happens. Newest first.
|
||
|
||
## Milestones at a glance
|
||
|
||
| Milestone | State |
|
||
|---|---|
|
||
| **M1** — `punktfunk-core` + C ABI (protocol · FEC · crypto) | ✅ complete & hardened |
|
||
| **M2** — GameStream host (Moonlight-compatible) | ✅ working end-to-end; HDR/surround-audio polish open |
|
||
| **M3** — `punktfunk/1` native protocol (QUIC control + UDP data) | ✅ full session planes, validated live |
|
||
| **M4** — native client decode + present (Apple first) | 🟡 macOS stage 1 live; stage-2 presenter built + decode-tested (opt-in, present needs live validation). **Linux GTK client stage 1 live** (2026-06-12) |
|
||
|
||
## Live on the boxes
|
||
|
||
| Box | Role | Compositor | Notes |
|
||
|---|---|---|---|
|
||
| **home-worker-2** (dev) | KDE/KWin appliance | kwin (headless Plasma) | QEMU VM, passthrough RTX 5070 Ti; `serve --native` user unit |
|
||
| **home-worker-3** (GNOME) | GNOME/Mutter appliance | mutter (RecordVirtual) | RTX 4090; autologin GNOME Wayland; `serve --native` user unit. See [Ubuntu — GNOME](/docs/ubuntu-gnome) |
|
||
| **home-bazzite-1** | SteamOS-like host | gamescope | host-managed Steam session at client mode. See [Bazzite Setup](/docs/bazzite) |
|
||
|
||
All three appliances advertise over mDNS (`_punktfunk._udp`) and require PIN pairing by default.
|
||
|
||
## Progress log
|
||
|
||
### 2026-06-12
|
||
- **Native Linux client — stage 1, first light** (`crates/punktfunk-client-linux`, binary
|
||
`punktfunk-client`). GTK4/libadwaita app on the **Option A** architecture picked after a
|
||
six-angle research pass (toolkits / hw decode / Wayland presentation / input capture /
|
||
prior art / codebase): links `punktfunk-core` directly as a crate (no C ABI;
|
||
`NativeClient` is `Sync` now), mDNS host list, TOFU + SPAKE2 PIN pairing dialogs
|
||
(identity shared with `client-rs`), FFmpeg software HEVC decode (`LOW_DELAY` + slice
|
||
threads) into a `GtkGraphicsOffload`-wrapped picture, PipeWire playback with the host
|
||
mic-player's jitter ring inverted, SDL3 gamepad capture + rumble/lightbar feedback,
|
||
layout-independent keyboard (exact inverse of the host's VK table), absolute mouse +
|
||
WHEEL_DELTA scroll, compositor-shortcut inhibition, fullscreen, stats overlay.
|
||
**Validated live** against this box's `serve --native`: 1080p60 at a locked 60 fps,
|
||
capture→decoded **p50 ≈ 6.4 ms** (software decode, debug build). Next: VAAPI dmabuf →
|
||
`GdkDmabufTexture` (Tier-1 zero-copy on Intel/AMD clients), DualSense
|
||
touchpad/motion/trigger replay over SDL3, then the stage-2 raw-Wayland presenter
|
||
(wp_presentation feedback, tearing-control, Vulkan Video for NVIDIA clients).
|
||
- **Delegated pairing approval (§8b-1)** — an unpaired device that tries to connect to a
|
||
pairing-required host now shows up as a **pending request** in the web console's Pairing page;
|
||
one click approves it (optionally relabeling) and pairs its certificate fingerprint — no PIN
|
||
fetched out of band. New mgmt endpoints (`/native/pending` + approve/deny), an in-memory pending
|
||
queue in `NativePairing` (fp-deduped, capped, 10-min expiry), and an optional **device name** in
|
||
the `Hello` (back-compat trailing field; `client-rs --name` sends it). End-to-end tested.
|
||
§8b-2 (approve from a paired device's own app) is the client-side follow-up.
|
||
- **CI + deployment landed** (see the [CI & Docker](/docs/ci) guide). Gitea Actions, three
|
||
workflows: Rust workspace checks inside the new `punktfunk-rust-ci` builder image (Ubuntu 26.04,
|
||
full link-dep stack incl. a libcuda stub — 141/141 tests green in-container), web + docs-site
|
||
build/typecheck, `docker.yml` building+pushing `punktfunk-web`/`punktfunk-docs`/`punktfunk-rust-ci`
|
||
to the registry, and `apple.yml` (xcframework → `swift build`/`swift test`) on a new **host-mode
|
||
macOS runner** (`home-mac-mini-1`, provisioned by `scripts/ci/setup-macos-runner.sh`; macOS
|
||
Local-Network privacy forces it to run as a root LaunchDaemon). Host and native clients stay
|
||
un-dockerized by design. **This site now deploys automatically**: `deploy-docs` ships it to
|
||
unom-1:3220, Caddy serves <https://docs.punktfunk.unom.io> — live and verified.
|
||
- **Concurrent sessions** — the host no longer serves one client at a time. The accept loop spawns
|
||
each session (`JoinSet`), bounded by `--max-concurrent` (default 4, a NVENC bound; overflow waits
|
||
in the accept queue). Each session keeps its own virtual output + encoder; they share the
|
||
host-lifetime input/audio/mic services — i.e. **multiple devices viewing/controlling the same
|
||
desktop** on kwin/mutter/wlroots. Validated live on the GNOME box: two clients connected at once
|
||
→ **two independent Mutter virtual outputs (1280×720 + 1920×1080) streaming simultaneously**
|
||
(39 MB + 48 MB). gamescope's *independent-desktops* (multi-user) isolation — per-session
|
||
input/audio — is a follow-up.
|
||
- **Apple client latency HUD** — `PunktfunkConnection.clockOffsetNs` (from the C-ABI getter) +
|
||
`LatencyMeter` surface a skew-corrected **capture→client-receipt** p50/p95 in the macOS HUD: the
|
||
first cross-machine latency the real Apple client reports. (Stage-1 `AVSampleBufferDisplayLayer`
|
||
has no present callback, so decode→present is excluded — that needs the stage-2 presenter.)
|
||
Needs an `xcframework` rebuild + `swift test` on the Mac to validate.
|
||
- **Skew handshake in the connector + C ABI** — `quic::clock_sync` is now a shared core helper used
|
||
by both the reference client and `NativeClient`; the connector runs it at connect and exposes the
|
||
host clock offset over the C ABI (`punktfunk_connection_clock_offset_ns`). This is the substrate
|
||
the Apple client needs for the decode→present (glass-to-glass) term.
|
||
- **Wall-clock skew handshake** (`ClockProbe`/`ClockEcho`, 8 NTP rounds after `Start`) — makes the
|
||
client's capture→reassembled latency valid **cross-machine**. Validated GNOME box → dev box:
|
||
offset −1.57 ms removed, **p50 1.30 ms** skew-corrected. (`05bc9ab`)
|
||
- **Native LAN auto-discovery** — host advertises `_punktfunk._udp` (TXT: fingerprint, pairing,
|
||
proto); `punktfunk-client-rs --discover` lists hosts. Validated cross-LAN. (`4fff464`)
|
||
- **Third test box stood up** — home-worker-3 (Ubuntu 26.04, RTX 4090, GNOME 50): first GNOME/Mutter
|
||
zero-copy streaming on a real desktop; **1 Gbps probe clean** (625 MB/5 s, `send_dropped=0`).
|
||
Two physical-NVIDIA gotchas documented in [Ubuntu — GNOME](/docs/ubuntu-gnome).
|
||
- **Encode|send thread split** validated on real NIC (`send_dropped=0` at 720p60 / 1080p120). (`b295a5b`)
|
||
|
||
### Earlier (see roadmap + git log)
|
||
- **1 Gbps data plane**: batched `sendmmsg`/`recvmmsg` + microburst-cap paced send thread.
|
||
- **Boot appliance**: headless KDE session + host systemd units (no login).
|
||
- **Speed test + settable bitrate**: negotiation + bandwidth probe (host side).
|
||
- **DualSense** UHID + haptics; gamepads live; mic uplink; AV1 + surround (unit/live-capture tested).
|
||
|
||
## In flight / next
|
||
|
||
See the [Roadmap](/docs/roadmap) for the ordered list. Near-term:
|
||
- **True glass-to-glass**: Apple client present-stamp (decode→present) + host render→capture term.
|
||
- **Apple stage-2 presenter** (`VTDecompressionSession` → `CAMetalLayer`) — built + decode-unit-tested + live-validated on glass behind the `punktfunk.presenter` flag (capture→present ~11 ms p50); make it the default after a few resolution/HDR checks.
|
||
- **Mandatory PIN pairing + delegated pairing approval** (an already-paired device approves a new one).
|
||
- **gamescope multi-user isolation** — per-session input/audio so concurrent sessions are independent
|
||
desktops (the shared-desktop multi-view case landed).
|
||
- **bazzite** kept up to date (currently offline; one rebuild behind).
|