Skip to content

Vulkan: RMS norm for short rows (per-head Q/K norm 2.4-2.7x faster, bit-identical) - #37

Open
danielhanchen wants to merge 5 commits into
masterfrom
vulkan-rms-norm-small-rows
Open

Vulkan: RMS norm for short rows (per-head Q/K norm 2.4-2.7x faster, bit-identical)#37
danielhanchen wants to merge 5 commits into
masterfrom
vulkan-rms-norm-small-rows

Commits

  1. Commits on Oct 22, 2026

  2. Commits on Oct 23, 2026

  3. Commits on Nov 7, 2026