Skip to content

Added an initial implementation of Q and KV Cache in fp8 and to use t…#2035

Draft
Anerudhan wants to merge 1 commit intoflashinfer-ai:mainfrom
Anerudhan:feature/cudnn/sdpa_fp8_qkv
Draft

Added an initial implementation of Q and KV Cache in fp8 and to use t…#2035
Anerudhan wants to merge 1 commit intoflashinfer-ai:mainfrom
Anerudhan:feature/cudnn/sdpa_fp8_qkv

Commits