By executing tests in this normalised fashion it is easier to compare
results between different instances or different patch levels.
Roughly speaking there are two kinds of tests:
- VM tests: which summarise general performance of the instance,
without taking DD into account
- DD tests: which simulates many logins and interactions with DD,
while recording the session as a user would pereceive it from a
browser
By using these we should be able to consistently compare and improve
performance.
The original dd-stress-test.tpl.jmx tests file was prepared by
Teradisk with hardcoded instance, threadcount and duration values.
Testing should now be performed with `vm-test.sh` and `dd-test.sh`
respectively, and the template file should stay generic.
The first example of these changes relates to the latest Nextcloud
upgrades to major version 24.
Operators are now expected to read the latest version this file before
updating their instances.
The API spec file can be generated with:
python -m admin.views.test.test_ApiViews --generate-spec
From the admin development environment.
A simple testing ground that serves the Swagger UI can also be started with:
python -m admin.views.test.test_ApiViews
This enables more advanced customisation by allowing for
administrators to fully replace the footer of the login theme.
We try to take into account maintainability, at the same time mention
that it is the administrators' responsibility to keep their
customisations compatible with newer versions of DD.
Evilham