You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+1-4Lines changed: 1 addition & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,21 +20,18 @@ Notes:
20
20
* System roles may not work well on certain models.
21
21
* Certain models do not support chat templates (which will be used when the system role is not "None").
22
22
* Certain devices and dtype options may not work for certain models. "Audo" in dtype does not work for all models either.
23
-
* For example, `Gemma-3-1B-It` does not work on WebGPU, and `SmolLM2-1.7B-Instruct` only works when dtype is set to`int8`, `uint8`, `bnb4` or `q4f16`.
23
+
* For example, `Gemma-3-1B-It` does not work on WebGPU, and `SmolLM2-1.7B-Instruct` only works for dtype =`int8`, `uint8`, `bnb4` or `q4f16`.
24
24
* After loading a model, you must refresh the page to load a different one. There is no way to release the old model from the memory, and trying to load more than two models proved to be problematic.
0 commit comments