Skip to content

Commit 19d91ec

Browse files
authored
[CI] Fix flaky test_eagle_correctness test (vllm-project#28364)
Signed-off-by: NickLucche <nlucches@redhat.com>
1 parent 7ae5a5f commit 19d91ec

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

tests/v1/e2e/test_spec_decode.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -433,9 +433,9 @@ def test_eagle_correctness(
433433
print(f"ref_output: {ref_output.outputs[0].text}")
434434
print(f"spec_output: {spec_output.outputs[0].text}")
435435

436-
# Heuristic: expect at least 66% of the prompts to match exactly
436+
# Heuristic: expect at least 60% of the prompts to match exactly
437437
# Upon failure, inspect the outputs to check for inaccuracy.
438-
assert matches > int(0.66 * len(ref_outputs))
438+
assert matches > int(0.6 * len(ref_outputs))
439439
del spec_llm
440440
torch.cuda.empty_cache()
441441
cleanup_dist_env_and_memory()

0 commit comments

Comments
 (0)