Skip to content

Pull requests: bigcode-project/bigcode-inference-benchmark

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

📦 onnx support for santacoder
#20 by mayank31398 was closed Aug 10, 2024 Loading… updated Aug 10, 2024
Multi-value filter
#19 by jlamypoirier was merged Mar 3, 2023 Loading… updated Mar 3, 2023
Refactor metrics, save results, new benchmarking
#18 by jlamypoirier was merged Mar 2, 2023 Loading… updated Mar 3, 2023
Refactor repo
#17 by jlamypoirier was merged Feb 25, 2023 Loading… updated Feb 25, 2023
Misc additions
#16 by jlamypoirier was merged Feb 25, 2023 Loading… updated Feb 25, 2023
Support generic models and arguments
#15 by jlamypoirier was merged Feb 15, 2023 Loading… updated Feb 15, 2023
Fork model
#14 by jlamypoirier was closed Feb 14, 2023 Draft updated Feb 14, 2023
Pre allocate KV tensors and use inference mode
#13 by jlamypoirier was closed Feb 8, 2023 Draft updated Feb 8, 2023
Add code to vary input length
#5 by minimario was merged Dec 6, 2022 Loading… updated Feb 4, 2023
Add dockerfile, requirements and code style
#9 by jlamypoirier was merged Jan 14, 2023 Loading… updated Jan 14, 2023
add MQA results
#8 by mayank31398 was merged Dec 12, 2022 Loading… updated Dec 12, 2022
Add graphs
#7 by mayank31398 was merged Dec 12, 2022 Loading… updated Dec 12, 2022
run inference benchmarks with a better system
#6 by mayank31398 was merged Dec 10, 2022 Loading… updated Dec 10, 2022
Add MQA
#4 by mayank31398 was merged Dec 6, 2022 Loading… updated Dec 6, 2022
refactor for pipelines [WIP]
#2 by mayank31398 was merged Oct 17, 2022 Loading… updated Oct 17, 2022
add benchmark scripts
#1 by mayank31398 was merged Oct 16, 2022 Loading… updated Oct 16, 2022
ProTip! Type g i on any issue or pull request to go back to the issue listing page.