Commit e30f26b
llama : assume tied weights if lm_head/output weights is missing (ggml-org#5824)
This is to support model configurations with "tie_word_embeddings" set to true.
Co-authored-by: Don Mahurin <2797413+dmahurin@users.noreply.github.com>1 parent 2aba0cb commit e30f26b
1 file changed
+7
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3888 | 3888 | | |
3889 | 3889 | | |
3890 | 3890 | | |
3891 | | - | |
| 3891 | + | |
| 3892 | + | |
| 3893 | + | |
| 3894 | + | |
| 3895 | + | |
| 3896 | + | |
| 3897 | + | |
3892 | 3898 | | |
3893 | 3899 | | |
3894 | 3900 | | |
| |||
0 commit comments