Commit 24cd0d1
vulkan: Support FA with any multiple of 8 head sizes (ggml-org#15537)
The scalar FA shader already handled multiples of 8. The coopmat1 FA
shader assumed 16x16x16 and the shared memory allocations need the HSK
dimensions padded to a multiple of 16. NVIDIA's coopmat2 implementation
requires multiples of 16 for N and K, and needs the matrix dimensions
padded and loads clamped.
Store the FA pipelines in a map, indexed by the pipeline state.1 parent e3c01e6 commit 24cd0d1
File tree
5 files changed
+143
-137
lines changed- ggml/src/ggml-vulkan
- vulkan-shaders
- tests
5 files changed
+143
-137
lines changed
0 commit comments