Skip to content

Commit a048789

Browse files
committed
update speed estimate
1 parent 9bc2162 commit a048789

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -31,11 +31,11 @@ Add `--add-json "data/other-file.json"` to also append new keys in a secondary k
3131

3232
Add `--max-tokens 60` to set the split length. This depends on when/how the model breaks down. Set it *BELOW* seq len.
3333

34-
Speed comparison:
34+
Speed comparison (extremely variable with prompt):
3535
| CPU | 7B-MT-BT | 3B-MT |
3636
| --- | -------- | ----- |
37-
| Intel i7-12700KF (12 p-core) | 4.5 tok/s | 10.8 tok/s |
38-
| AMD Ryzen 5 3600 (6 core) | 1.5 tok/s | 3.6 tok/s |
37+
| Intel i7-12700KF (12 p-core) | 7 tok/s | 15 tok/s |
38+
| AMD Ryzen 5 3600 (6 core) | 4 tok/s | 8 tok/s |
3939

4040
#### Example input JSON file:
4141
```json

0 commit comments

Comments
 (0)