87 lines
3.8 KiB
Markdown
87 lines
3.8 KiB
Markdown
|
# Longevity Library
|
||
|
|
|
||
|
|
This library serves as a test runner for longevity suites, which exercise test cases repeatedly in
|
||
|
|
order to exercise or stress the device under test. Annotate a collection of JUnit test classes with
|
||
|
|
a subclass of LongevitySuite, and voila...you now have longevity tests!
|
||
|
|
|
||
|
|
## Examples
|
||
|
|
|
||
|
|
There is both host-side (core) and device-side (platform) for longevity tests with only
|
||
|
|
minor differences. All of the examples below use the sample suites bundled as part of the
|
||
|
|
`LongevityHostLibSamples` and `LongevityPlatformLibSamples` modules under the `samples/` directory.
|
||
|
|
Follow the samples directory to see how longevity suites are constructed.
|
||
|
|
|
||
|
|
### Host
|
||
|
|
|
||
|
|
**Template command with stubbed out options.**
|
||
|
|
|
||
|
|
`java <options> -cp <jar> org.junit.runner.JUnitCore <suite>`
|
||
|
|
|
||
|
|
**Run simple test suite 50 times, and quit when an error is encountered.**
|
||
|
|
|
||
|
|
`java -Diterations=5 -Dquitter=true -cp out/host/linux-x86/framework/LongevityHostSamples.jar
|
||
|
|
org.junit.runner.JUnitCore android.host.test.longevity.samples.SimpleSuite`
|
||
|
|
|
||
|
|
**Run simple test suite 10 times, shuffle all tests, and quit after 30 minutes.**
|
||
|
|
|
||
|
|
`java -Diterations=10 -Dsuite-timeout_msec=1800000 -Dshuffle=true -cp
|
||
|
|
out/host/linux-x86/framework/LongevityHostSamples.jar
|
||
|
|
org.junit.runner.JUnitCore android.host.test.longevity.samples.SimpleSuite`
|
||
|
|
|
||
|
|
### Device
|
||
|
|
|
||
|
|
**Template command with stubbed out options.**
|
||
|
|
|
||
|
|
`adb shell am instrument -w -r -e <option> <value> -e class <suite>
|
||
|
|
android.platform.test.longevity.samples/androidx.runner.AndroidJUnitRunner`
|
||
|
|
|
||
|
|
**Run simple test suite 50 times, and quit when an error is encountered.**
|
||
|
|
|
||
|
|
`adb shell am instrument -w -r -e iterations 50 -e quitter true
|
||
|
|
-e class android.platform.test.longevity.samples.SimpleSuite
|
||
|
|
android.platform.test.longevity.samples/androidx.test.runner.AndroidJUnitRunner`
|
||
|
|
|
||
|
|
**Run simple test suite 10 times, shuffle all tests, and quit after 30 minutes.**
|
||
|
|
|
||
|
|
`adb shell am instrument -w -r -e iterations 10 -e shuffle true -e suite-timeout_msec 1800000
|
||
|
|
-e class android.platform.test.longevity.samples.SimpleSuite
|
||
|
|
android.platform.test.longevity.samples/androidx.test.runner.AndroidJUnitRunner`
|
||
|
|
|
||
|
|
**Run simple test suite 100 times, and quit when battery drops below 5%.**
|
||
|
|
|
||
|
|
`adb shell am instrument -w -r -e iterations 100 -e min-battery 0.05
|
||
|
|
-e class android.platform.test.longevity.samples.SimpleSuite
|
||
|
|
android.platform.test.longevity.samples/androidx.test.runner.AndroidJUnitRunner`
|
||
|
|
|
||
|
|
**Run a suite using the sample profile under assets/**
|
||
|
|
|
||
|
|
`adb shell am instrument -w -r -e profile sample_profile
|
||
|
|
-e class android.platform.test.longevity.samples.SimpleProfile
|
||
|
|
android.platform.test.longevity.samples/androidx.test.runner.AndroidJUnitRunner`
|
||
|
|
|
||
|
|
## Options
|
||
|
|
|
||
|
|
* `iterations <int>` - the number of times to repeat the suite.
|
||
|
|
* `min-battery <double>` - quit if battery falls below this threshold.
|
||
|
|
* `shuffle <bool>` - shuffles all test cases in the repeated suite.
|
||
|
|
* `suite-timeout_msec <long>` - an overall timeout for the suite.
|
||
|
|
* `timeout_msec <long>` - a timeout for individual test methods.
|
||
|
|
* `quitter <bool>` - quit the suite if any test errors are encountered.
|
||
|
|
* `profile <string>` - use a profile under assets/ or at your own path.
|
||
|
|
* `rename-iterations <bool>` - rename each iteration by appending the iteration number to the
|
||
|
|
class name.
|
||
|
|
|
||
|
|
## Tests
|
||
|
|
|
||
|
|
Host-side tests for the library can be built with the `LongevityHostLibTests` module under the
|
||
|
|
`tests/` directory. Run them using `java out/host/linux-x86/framework/LongevityHostLibTests.jar
|
||
|
|
org.junit.runner.JUnitCore <test class>`.
|
||
|
|
|
||
|
|
Device-side tests for the library can be built with the `LongevityLibTests` module under the
|
||
|
|
`tests/` directory. Run them using `adb shell am instrument -w -r
|
||
|
|
android.platform.test.longevity.tests/androidx.test.runner.AndroidJUnitRunner`.
|
||
|
|
|
||
|
|
## Issues
|
||
|
|
|
||
|
|
If any issues are encountered, please send patches to recent contributors.
|