Grouped expert routing (CPU only)#836

Merged

ikawrakow merged 9 commits intomainfrom

ik/try_grouped_topk_playing1

Oct 16, 2025

Commits on Oct 15, 2025

Better argsort (CPU)
Iwan Kawrakow
committed
Attemt at grouped topk
Iwan Kawrakow
committed

Commits on Oct 16, 2025

This seems to do the trick for grouped experts routing
Iwan Kawrakow
committed
Cleanup
Iwan Kawrakow
committed
Trying to merge, something is not right
Iwan Kawrakow
committed
Working merged grouped top_k (CPU)
Iwan Kawrakow
committed
Add command line option to enable grouped expert routing
Iwan Kawrakow
committed
Add grouped expert routing option to llama-bench
Iwan Kawrakow
committed
Merge remote-tracking branch 'origin/main' into ik/try_grouped_topk_playing1
Iwan Kawrakow
committed