Commit 0c5c04c

committed

Experimental FP8 KV Cache. Not wired into anything yet.

1 parent cf6d921 commit 0c5c04cCopy full SHA for 0c5c04c

2 files changed

+800

-0

lines changed

src
- llama-kv-cache-fp8.cpp
- llama-kv-cache-fp8.h

2 files changed

+800

-0

lines changed

Comments

(0)