Testing, verification and test automation

[monperrus]

Wikipedia references:

• https://en.wikipedia.org/wiki/Software_testing
• https://en.wikipedia.org/wiki/Unit_testing
• https://en.wikipedia.org/wiki/Regression_testing
• https://en.wikipedia.org/wiki/Code_coverage

"Automated testing is the act of conducting specific tests via automation (e.g. a set of regression tests) as opposed to conducting them manually, while test automation refers to automating the process of tracking and managing the different tests." source

[bbaudry]

Interesting tool.
Detailed failure reports and hassle free assertions
Scott test reporter
https://github.com/dodie/scott

[monperrus]

From @AG00:

There is a relationship between desired properties (requirements), tests (verification) and test results. Those may be present in a hierarchy of components/subsystems/libraries. In addition, there is a relationship between planning activities on the system (product) being developed and its desired properties. Further, with time there will be more than one system/product configuration to consider and more than one version in use with different installations/deployments/customers. These relationships quickly becomes complex to understand and keep track of. As changes are being made (code or documents) and automatic tests are run, it would be good to have the information model changes generated rather than manually written. The information model can also be used to convince a customer (or the devops team itself) that a complex/high-level system property is achieved.

[bbaudry]

Testcontainers to test different environments on the developer's machine
https://www.testcontainers.org/

[bbaudry]

A post about the challenges to get global metrics for code coverage
https://massol.myxwiki.org/xwiki/bin/view/Blog/GlobalLocalCoverage

[bbaudry]

Security-based testing
https://www.inspec.io/

[bbaudry]

DeFlaker: Automatically Detecting Flaky Tests
https://www.jonbell.net/icse18-deflaker.pdf

[bbaudry]

Property-based testing in Java
https://github.com/quicktheories/QuickTheories

[monperrus]

Cross Browser Testing, Selenium Testing, and Mobile Testing
https://saucelabs.com/

[monperrus]

Perfecto - Cloud-based Devops Testing
https://www.perfecto.io/

[monperrus]

Capturing test history
https://stackoverflow.com/questions/37657130/how-to-capture-the-junit-test-result-of-project-in-database

[monperrus]

Automated Tool for Prioritizing JUnit Test Suites
https://github.com/kanonizo/kanonizo

[bbaudry]

mutation testing
https://github.com/hcoles/pitest

[bbaudry]

automatic unit test amplification
https://github.com/STAMP-project/dspot
https://arxiv.org/pdf/1811.08330.pdf