Skip to content
This repository was archived by the owner on Dec 1, 2024. It is now read-only.

Commit 9e31b8c

Browse files
authored
Update Petals results in README
1 parent 53fe8b8 commit 9e31b8c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,7 @@ The corresponding effective batch sizes are in parentheses. Please see [here](be
7171
| ------ | -------- | ------- | -------- |
7272
| Hugging Face Accelerate | 25.12 (2 on GPU) | 0.62 (8 on CPU) | 0.01 (2 on disk) |
7373
| DeepSpeed ZeRO-Inference | 9.28 (16 on CPU) | 0.60 (4 on CPU) | 0.01 (1 on disk) |
74-
| Petals\* | - | - | 0.05 |
74+
| Petals | 8.25 (2 on GPU) | 2.84 (2 on GPU) | 0.08 (2 on GPU) |
7575
| FlexGen | 25.26 (2 on GPU) | 7.32 (144 on CPU) | 0.69 (256 on disk) |
7676
| FlexGen with Compression | **29.12** (72 on GPU) | **8.38** (512 on CPU) | **1.12** (144 on CPU) |
7777

0 commit comments

Comments
 (0)