Skip to content

[CI Failure][NIGHTLY FIRE DRILL]: Language Models Test (Pooling) #22836

@robertgshaw2-redhat

Description

@robertgshaw2-redhat

Name of failing test

models/language/pooling/test_intfloat.py::test_embed_models_mteb models/language/pooling/test_override_pooler_config.py::test_embed_models_using_normalize[half-intfloat/multilingual-e5-small] models/language/pooling/test_snowflake_arctic_embed.py::test_embed_models_mteb[model_info0] models/language/pooling/test_snowflake_arctic_embed.py::test_embed_models_mteb[model_info5]

Basic information

  • Flaky test
  • Can reproduce locally
  • Caused by external libraries (e.g. bug in transformers)

🧪 Describe the failing test

models/language/pooling/test_intfloat.py::test_embed_models_mteb models/language/pooling/test_override_pooler_config.py::test_embed_models_using_normalize[half-intfloat/multilingual-e5-small] models/language/pooling/test_snowflake_arctic_embed.py::test_embed_models_mteb[model_info0] models/language/pooling/test_snowflake_arctic_embed.py::test_embed_models_mteb[model_info5]

📝 History of failing test

CC List.

cc @DarkLight1337

Metadata

Metadata

Assignees

Labels

ci-failureIssue about an unexpected test failure in CI

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions