Skip to content

Conversation

manuroe
Copy link
Contributor

@manuroe manuroe commented Apr 27, 2021

I think CHANGES.md describes all I did:

  • Tests: Use UnitTests suffix for unit tests classes.
  • Tests: Cut some existing tests to separate unit tests and integration tests.
  • Tests: Create 4 test plans for the macOS target: AllTests, AllTestsWithSanitizers, UnitTests and UnitTestsWithSanitizers.
  • GH Actions: Run unit tests on every PR and develop branch update.
  • GH Actions: Run integration tests nightly on develop using last Synapse release.

Test plans are only for the macOS target. I failed to share the same test plan with 2 different targets. When I tried it wanted to execute all tests from MatrixSDKTests-macOS and MatrixSDKTests-iOS, which are the same.
Given that macOS is the preferred and quickest target for dev, I preferred to focus on it. For readiness and simplicity, test plans do not have macOS in their name but there are test plans for this target, not for iOS.

Note that AllTests plan which includes integration tests is failing at the moment for many reasons we need to fix. It will be impossible to fully run it because of rate-limiting issue in Synapse that will be fixed in the coming release.

In term of CI strategy:

  • CI.yml is launched on every PR and develop update. It runs the UnitTests plan and pod lib lint
  • nightly. is launched on develop every weekdays morning. It runs UnitTestsWithSanitizers and AllTestsWithSanitizers plans

FYI, a test plan can be selected here:

image

@manuroe manuroe force-pushed the manu/TestPlans branch 2 times, most recently from 5f8146a to 6aa44f8 Compare April 28, 2021 05:43
manuroe added 5 commits April 28, 2021 07:49
They are still specific to the macOS target but this is so much readable
Nobody will check  those builds during weekend. I hope.
They have 2 configurations each. This means 2 different builds which are longer to run because of sanitizer checks. That's why there are triggered only nightly.

This setup is advised at 
https://developer.apple.com/videos/play/wwdc2019/413?time=2270
@manuroe manuroe marked this pull request as ready for review April 28, 2021 10:57
To indicate there is at least another kind
@manuroe manuroe merged commit 50bf8f6 into develop May 3, 2021
@manuroe manuroe deleted the manu/TestPlans branch May 3, 2021 09:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants