IQ1_S_R4: better 1.5 bpw quants#185

Merged

ikawrakow merged 10 commits intomainfrom

Feb 5, 2025

Commits on Feb 4, 2025

iq1_s_r4: basics - quantize/dequantize
Iwan Kawrakow
committed
iq1_s_r4: gemm/gemv works on AVX2/Zen4
Iwan Kawrakow
committed
Don't forget to make sure we have a multiple of 4 rows per thread
Iwan Kawrakow
committed
iq1_s_r4: this is better
Iwan Kawrakow
committed
iq1_s_r4: fix Zen4 after AVX2 changes
Iwan Kawrakow
committed
iq1_s_r4: NEON gemm/gemv
Iwan Kawrakow
committed
iq1_s_r4: more bits for shared experts
Iwan Kawrakow
committed

Commits on Feb 5, 2025

Forgotten counter increment
Iwan Kawrakow
committed
iq1_s_r4: slightly faster AVX2/Zen4 gemm/gemv
Iwan Kawrakow
committed
Compiler warnings
Iwan Kawrakow
committed