Skip to content

Conversation

@mtojek
Copy link
Contributor

@mtojek mtojek commented Jul 9, 2021

Fixes: #94

This PR introduces support for service variants for system tests. So far they are supported only in the service command.

Zrzut ekranu 2021-07-9 o 13 30 48

@mtojek mtojek self-assigned this Jul 9, 2021
@mtojek mtojek changed the title Use service variants for tests Use service variants for system tests Jul 9, 2021
@elasticmachine
Copy link
Collaborator

elasticmachine commented Jul 9, 2021

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2021-07-09T14:07:51.995+0000

  • Duration: 24 min 53 sec

  • Commit: d89ee74

Test stats 🧪

Test Results
Failed 0
Passed 316
Skipped 4
Total 320

Trends 🧪

Image of Build Times

Image of Tests

@mtojek mtojek marked this pull request as ready for review July 9, 2021 11:34
@mtojek mtojek requested a review from jsoriano July 9, 2021 11:34
@mtojek mtojek changed the title Use service variants for system tests Use service variants in system tests Jul 9, 2021
Copy link
Member

@jsoriano jsoriano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! LGTM, but could we run the CI job with all the integrations, or at least with mysql? In elastic/integrations#1145 I added the variants defined in Beats but I didn't test them 😬

v2443:
SERVICE_VERSION: 2.4.43
v2423:
SERVICE_VERSION: 2.4.23
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have we considered to add something to skip variants? This may be needed in the future.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have the "skip" option for the entire test config not for particular variant. Maybe a follow up issue?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

}

for _, cfgFile := range cfgFiles {
for _, variantName := range anyVariants(variantsFile) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There should be some way to run with a single variant.

Copy link
Contributor Author

@mtojek mtojek Jul 9, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added CLI option for this:

elastic-package test system --variant foo

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great! Thanks.

@mtojek
Copy link
Contributor Author

mtojek commented Jul 9, 2021

could we run the CI job with all the integrations, or at least with mysql? In elastic/integrations#1145 I added the variants defined in Beats but I didn't test them 😬

I can copy the mysql package to the test packages here, so we can test it. I will create a separate PR.

@jsoriano
Copy link
Member

jsoriano commented Jul 9, 2021

could we run the CI job with all the integrations, or at least with mysql? In elastic/integrations#1145 I added the variants defined in Beats but I didn't test them grimacing

I can copy the mysql package to the test packages here, so we can test it. I will create a separate PR.

Oh, forget it, I mixed things when I saw the apache tests passing 🙂

@mtojek
Copy link
Contributor Author

mtojek commented Jul 9, 2021

/test

@mtojek mtojek requested a review from jsoriano July 9, 2021 14:33
@mtojek mtojek merged commit 9193720 into elastic:master Jul 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

3 participants