Skip to content
#

bigcodebench

Star

Here is 1 public repository matching this topic...

abhaymundhara / llm-benchmark-suite

Star 2

Benchmark suite for evaluating LLMs and SLMs on coding and SE tasks. Features HumanEval, MBPP, SWE-bench, and BigCodeBench with an interactive Streamlit UI. Supports cloud APIs (OpenAI, Anthropic, Google) and local models via Ollama. Tracks pass rates, latency, token usage, and costs.

python benchmark evaluation gemini openai code-generation claude streamlit humaneval llm ollama swe-bench mbpp bigcodebench
  • Updated Dec 3, 2025
  • Python

Improve this page

Add a description, image, and links to the bigcodebench topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the bigcodebench topic, visit your repo's landing page and select "manage topics."

Learn more