Skip to content

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement#29558

Open
yewentao256 wants to merge 5 commits intomainfrom
wentao-enable-cudagraph-for-deepepHT
Open

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement#29558
yewentao256 wants to merge 5 commits intomainfrom
wentao-enable-cudagraph-for-deepepHT

Commits

Commits on Nov 27, 2025

Commits on Dec 1, 2025