Skip to content

Commit 70f8b96

Browse files
authored
[Bugfix] Fix FusedMoEPrepareAndFinalize for cuda-disalike backends (vllm-project#18178)
Signed-off-by: Mengqing Cao <cmq0113@163.com>
1 parent dd2a945 commit 70f8b96

File tree

1 file changed

+1
-0
lines changed
  • vllm/model_executor/layers/fused_moe

1 file changed

+1
-0
lines changed

vllm/model_executor/layers/fused_moe/layer.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,7 @@
4343
from .pplx_prepare_finalize import PplxPrepareAndFinalize
4444
else:
4545
fused_experts = None # type: ignore
46+
FusedMoEPrepareAndFinalize = None # type: ignore
4647
if is_rocm_aiter_moe_enabled():
4748
from vllm.model_executor.layers.fused_moe.rocm_aiter_fused_moe import ( # noqa: E501
4849
rocm_aiter_biased_group_topk as grouped_topk)

0 commit comments

Comments
 (0)