Skip to content

Commit 96cfdaf

Browse files
committed
TestPlans: Add documentation
1 parent 9ad2dc8 commit 96cfdaf

File tree

3 files changed

+24
-5
lines changed

3 files changed

+24
-5
lines changed

.github/workflows/nightly.yml

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -3,9 +3,6 @@ name: Nightly checks
33
on:
44
schedule:
55
- cron: '0 3 * * 1-5'
6-
7-
# TODO: To remov
8-
pull_request:
96

107
workflow_dispatch:
118

CHANGES.rst

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,11 @@ Changes to be released in next version
1818
*
1919

2020
🧱 Build
21-
*
21+
* Tests: Use UnitTests suffix for unit tests classes.
22+
* Tests: Cut some existing tests to seperate unit tests and integration tests.
23+
* Tests: Create 4 test plans for the macOS target: AllTests, AllTestsWithSanitizers, UnitTests and UnitTestsWithSanitizers.
24+
* GH Actions: Run unit tests on every PR and develop branch update.
25+
* GH Actions: Run integration tests nightly on develop using last Synapse release.
2226

2327
Others
2428
*

README.rst

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -467,7 +467,9 @@ Then, open ``MatrixSDK.xcworkspace``.
467467

468468
Tests
469469
=====
470-
The tests in the SDK Xcode project are both unit and integration tests.
470+
The tests in the SDK Xcode project are both unit and integration tests.
471+
472+
Unit tests class use the suffix "UnitTests" to differentiate them. A unit test is a test that does not make any HTTP requests or uses mocked HTTP requests.
471473

472474
Out of the box, the tests use one of the homeservers (located at
473475
http://localhost:8080) of the "Demo Federation of Homeservers"
@@ -491,6 +493,22 @@ Every time you want to launch these test homeservers, type::
491493
You can now run tests from the Xcode Test navigator tab or select the
492494
MatrixSDKTests scheme and click on the "Test" action.
493495

496+
Test Plans
497+
----------
498+
We have test plans in MatrixSDKTests/TestPlans for the macOS target to run tests separately or with different configurations.
499+
500+
AllTests
501+
Default test plan to run all tests.
502+
503+
AllTestsWithSanitizers
504+
Run all tests with 2 configurations "ASan + UBSan" and "TSan + UBSan". "UBSan" for Unexpected Behavior Sanitizer. "ASan" for Address Sanitizier. "Tsan" for Thread Sanitizer. This setup was adviced at WWDC2019 (https://developer.apple.com/videos/play/wwdc2019/413?time=2270). This test plan requires 2 builds that are slow to run.
505+
506+
UnitTests
507+
Test plan for all unit tests.
508+
509+
UnitTestsWithSanitizers
510+
All unit tests with 2 configurations "ASan + UBSan" and "TSan + UBSan" described above.
511+
494512
Known issues
495513
============
496514

0 commit comments

Comments
 (0)