Search results

Proposal: Unify Versioning for Codebase, Leaderboard, and Rules

✨ Feature RequestRequest for a new feature or enhancement of an existing oneRequest for a new feature or enhancement of an existing one

Status: Closed (completed).

Feature

#870 In mlcommons/algorithmic-efficiency;

· by fsschneider was closed on Sep 16, 2025

Models will always be initialized with default dropout in self-tuning ruleset

👷 In ProgressIssue is being worked onIssue is being worked on

🛑 AlgoPerf LeaderboardBlocking rolling AlgoPerf LeaderboardBlocking rolling AlgoPerf Leaderboard

Status: Closed (completed).

#753 In mlcommons/algorithmic-efficiency;

· by georgedahl was closed on Jun 26, 2025

LibriSpeech Conformer Workload OOMs or NCCL Errors When Run With Multiple Trials

🔥 PyTorchIssue that mainly deals with the PyTorch version of the codeIssue that mainly deals with the PyTorch version of the code

Status: Open.

#663 In mlcommons/algorithmic-efficiency;

· hjmshi opened on Feb 29, 2024

KeyError in prize qualification baseline.

Status: Closed (completed).

#623 In mlcommons/algorithmic-efficiency;

· by priyakasimbeg was closed on Feb 1, 2024

OGBG timing gap and torch compile bug

⏰ Timing gapSignificant difference (>= 10%) between pytorch and jax workloadsSignificant difference (>= 10%) between pytorch and jax workloads

🔥 PyTorchIssue that mainly deals with the PyTorch version of the codeIssue that mainly deals with the PyTorch version of the code

Status: Closed (completed).

#495 In mlcommons/algorithmic-efficiency;

· by priyakasimbeg was closed on Oct 11, 2023

Data Downloading segfaulting at sentencepiece

🚀 Launch BlockerIssues that are blocking launch of benchmarkIssues that are blocking launch of benchmark

Status: Closed (completed).

#470 In mlcommons/algorithmic-efficiency;

· by msaroufim was closed on Aug 11, 2023

WMT slower in Pytorch than Jax

⏰ Timing gapSignificant difference (>= 10%) between pytorch and jax workloadsSignificant difference (>= 10%) between pytorch and jax workloads

Status: Closed (completed).

#467 In mlcommons/algorithmic-efficiency;

· by priyakasimbeg was closed on Dec 13, 2023

Refactor <code>loss_fn</code> API and fix the scaling of the loss/grad in all submissions

Status: Merged (completed).

mlcommons/algorithmic-efficiencynumber 314

#314 In mlcommons/algorithmic-efficiency;

· by runame was closed on Feb 15, 2023

Add Adam baseline

Status: Closed (completed).

#287 In mlcommons/algorithmic-efficiency;

· by bilal2vec was closed on Feb 10, 2023

WMT Pytorch loss fluctuates over time

Status: Closed (completed).

#227 In mlcommons/algorithmic-efficiency;

· by priyakasimbeg was closed on Nov 1, 2022

Criteo OOM at batch size 524k, and convergence issues

🚀 Launch BlockerIssues that are blocking launch of benchmarkIssues that are blocking launch of benchmark

Status: Closed (completed).

#217 In mlcommons/algorithmic-efficiency;

· by znado was closed on Oct 11, 2023

ogbg returns NaN error

Status: Closed (completed).

#198 In mlcommons/algorithmic-efficiency;

· by priyakasimbeg was closed on Oct 26, 2022