There was an error while loading. Please reload this page.
1 parent 9bc2162 commit a048789Copy full SHA for a048789
README.md
@@ -31,11 +31,11 @@ Add `--add-json "data/other-file.json"` to also append new keys in a secondary k
31
32
Add `--max-tokens 60` to set the split length. This depends on when/how the model breaks down. Set it *BELOW* seq len.
33
34
-Speed comparison:
+Speed comparison (extremely variable with prompt):
35
| CPU | 7B-MT-BT | 3B-MT |
36
| --- | -------- | ----- |
37
-| Intel i7-12700KF (12 p-core) | 4.5 tok/s | 10.8 tok/s |
38
-| AMD Ryzen 5 3600 (6 core) | 1.5 tok/s | 3.6 tok/s |
+| Intel i7-12700KF (12 p-core) | 7 tok/s | 15 tok/s |
+| AMD Ryzen 5 3600 (6 core) | 4 tok/s | 8 tok/s |
39
40
#### Example input JSON file:
41
```json
0 commit comments