Skip to content

Create build matrices & test matrices for integration test workflow #409

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 44 commits into from
Closed

Create build matrices & test matrices for integration test workflow #409

wants to merge 44 commits into from

Conversation

@sunmou99
Copy link
Contributor

@sunmou99 sunmou99 commented May 4, 2021 •
edited
Loading

  • Divided the matrix into build matrices & test matrices. Now we can test on different devices in parallel.
  • Summary log has two parts: build summary & test summary. Changed the summarize script accordingly.
  • Both testapps & logs are uploaded as artifacts. retention: 2 days.
  • Download iOS Simulator if the device doesn't exist.
  • Android Emulator test log is moved to Emulator's internal storage, because some Emulators don't have external storage.
  • other small fixes
@google-cla google-cla bot added the cla: yes label May 4, 2021
@jonsimantov
Copy link
Contributor

I merged in some pretty major changes to the integration tests workflow, probably worth resolving the conflicts. Note that it uses a non-default ref for checking out the repo now.
@sunmou99 sunmou99 requested review from DellaBitta and jonsimantov May 5, 2021 20:32
@github-actions github-actions bot added the tests: failed This PR's integration tests failed. label May 5, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label May 5, 2021
@sunmou99 sunmou99 added the tests-requested: quick Trigger a quick set of integration tests. label May 5, 2021
@github-actions github-actions bot added tests: in-progress This PR's integration tests are in progress. and removed tests-requested: quick Trigger a quick set of integration tests. tests: failed This PR's integration tests failed. labels May 5, 2021
@sunmou99 sunmou99 added the tests-requested: quick Trigger a quick set of integration tests. label May 5, 2021
@github-actions github-actions bot removed the tests-requested: quick Trigger a quick set of integration tests. label May 5, 2021
@github-actions
Copy link

github-actions bot commented May 5, 2021 •
edited
Loading

❌  Integration test FAILED

Requested by @sunmou99 on commit 8f36d81
Last updated: Wed May 5 17:50:56 PDT 2021
View integration test results

Build Config Build failures Test failures (Test Config)
Android (built on Linux) messaging (Pixel2+28)
Android (built on MacOS) messaging (Pixel2+28)
iOS (built on MacOS) database (iPhone-8+12.0)

@github-actions github-actions bot added the tests: failed This PR's integration tests failed. label May 6, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label May 6, 2021
@sunmou99 sunmou99 added tests-requested: quick Trigger a quick set of integration tests. tests-requested: full Trigger a FULL set of integration tests (uses expanded test matrix). and removed tests-requested: quick Trigger a quick set of integration tests. tests: failed This PR's integration tests failed. tests-requested: full Trigger a FULL set of integration tests (uses expanded test matrix). labels May 6, 2021
@sunmou99 sunmou99 closed this May 6, 2021
@firebase firebase locked and limited conversation to collaborators Jun 6, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

cla: yes tests-requested: quick Trigger a quick set of integration tests.

2 participants

@sunmou99 @jonsimantov