Skip to content

Performance: decode overlap, GQA-shared split attention, short-prompt GEMM tile (1.0.3) - #3

Merged
jkyberneees merged 5 commits into
mainfrom
perf/decode-overlap-attn-split-short-prefill
Oct 31, 2026
Merged

jkyberneees merged 5 commits into
mainfrom
perf/decode-overlap-attn-split-short-prefill

Commits

  1. Commits on Oct 31, 2026