Skip to content

Pull requests: bigcode-project/bigcode-inference-benchmark

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

add benchmark scripts
#1 by mayank31398 was merged Oct 16, 2022 Loading… updated Oct 16, 2022
refactor for pipelines [WIP]
#2 by mayank31398 was merged Oct 17, 2022 Loading… updated Oct 17, 2022
Add MQA
#4 by mayank31398 was merged Dec 6, 2022 Loading… updated Dec 6, 2022
run inference benchmarks with a better system
#6 by mayank31398 was merged Dec 10, 2022 Loading… updated Dec 10, 2022
Add graphs
#7 by mayank31398 was merged Dec 12, 2022 Loading… updated Dec 12, 2022
add MQA results
#8 by mayank31398 was merged Dec 12, 2022 Loading… updated Dec 12, 2022
Add dockerfile, requirements and code style
#9 by jlamypoirier was merged Jan 14, 2023 Loading… updated Jan 14, 2023
Profiling and misc
#10 by jlamypoirier was merged Jan 30, 2023 Loading… updated Jan 30, 2023
Add code to vary input length
#5 by minimario was merged Dec 6, 2022 Loading… updated Feb 4, 2023
Pre allocate KV tensors and use inference mode
#13 by jlamypoirier was closed Feb 8, 2023 Draft updated Feb 8, 2023
Fork model
#14 by jlamypoirier was closed Feb 14, 2023 Draft updated Feb 14, 2023
Support generic models and arguments
#15 by jlamypoirier was merged Feb 15, 2023 Loading… updated Feb 15, 2023
Misc additions
#16 by jlamypoirier was merged Feb 25, 2023 Loading… updated Feb 25, 2023
Refactor repo
#17 by jlamypoirier was merged Feb 25, 2023 Loading… updated Feb 25, 2023
Refactor metrics, save results, new benchmarking
#18 by jlamypoirier was merged Mar 2, 2023 Loading… updated Mar 3, 2023
Multi-value filter
#19 by jlamypoirier was merged Mar 3, 2023 Loading… updated Mar 3, 2023
📦 onnx support for santacoder
#20 by mayank31398 was closed Aug 10, 2024 Loading… updated Aug 10, 2024
ProTip! Add no:assignee to see everything that’s not assigned.