Skip to content

Conversation

@ggerganov
Copy link
Member

ref #17726

  • diffs.reserve()
  • Better var names
  • Add optimization TODO

@ngxson
Copy link
Collaborator

ngxson commented Dec 3, 2025

I cherry-picked this change to #17740 btw

@ggerganov ggerganov merged commit 190c483 into master Dec 3, 2025
68 of 75 checks passed
@ggerganov ggerganov deleted the gg/server-compute-diffs-reserve branch December 3, 2025 15:22
khemchand-zetta pushed a commit to khemchand-zetta/llama.cpp that referenced this pull request Dec 4, 2025
gabe-l-hart added a commit to gabe-l-hart/llama.cpp that referenced this pull request Dec 4, 2025
* origin/master:
CUDA: generalized (mma) FA, add Volta support (ggml-org#17505)
chat : reserve memory in compute_diffs and improve naming (ggml-org#17729)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants