Skip to content

Commit 1b4c3c9

Browse files
committed
Also archive any files generated by the auto-retry script - this time also for the weekly test
1 parent cd2f9a3 commit 1b4c3c9

File tree

2 files changed

+34
-2
lines changed

2 files changed

+34
-2
lines changed

apps/README.md

Lines changed: 33 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,9 +6,41 @@ For running our testing platform, we need to perform complex jobs in Jenkins. Th
66

77
We have these two apps:
88

9-
* **Jenkins Job Builder** is a "seed job" which (re)creates all the jobs in our Jenkins.
9+
* **Jenkins Job Builder** is a "seed job" which (re)creates all the jobs in our Jenkins.
1010
* **Operator Test Runner** is an app which creates/terminates K8s clusters and runs operator integration tests in them.
1111

12+
## Configurable Test Scripts
13+
14+
The **Operator Test Runner** supports two test execution strategies:
15+
16+
1. **`run-tests`** (default) - Traditional test runner that executes tests once
17+
2. **`auto-retry-tests.py`** - Intelligent retry test runner that:
18+
- Runs the full test suite initially
19+
- Identifies failed tests automatically
20+
- Retries failed tests with configurable parallel and serial strategies
21+
- Tracks test runtime history for better estimates
22+
- Provides comprehensive reporting
23+
- Optionally keeps failed namespaces for debugging
24+
25+
### Configuration
26+
27+
Test script selection is configured per-operator in `catalog/operator-tests.yaml`:
28+
29+
```yaml
30+
- id: hdfs-operator
31+
display_name: HDFS Operator
32+
git_repo: hdfs-operator
33+
# Test script: "run-tests" (default) or "auto-retry-tests.py"
34+
test_script: auto-retry-tests.py
35+
# Auto-retry configuration (only used if test_script is auto-retry-tests.py)
36+
auto_retry:
37+
attempts_parallel: 2 # Number of parallel retry attempts (default: 0)
38+
attempts_serial: 3 # Number of serial retry attempts (default: 3)
39+
keep_failed_namespaces: false # Keep namespaces for debugging (default: false)
40+
```
41+
42+
If `test_script` is not specified, the default `run-tests` is used, maintaining backward compatibility with all existing operators.
43+
1244
## Project Structure
1345

1446
The code is documented inline, here's the project structure:

apps/jjb/operator_weekly_tests.j2

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,7 @@
8787
oci.stackable.tech/operator-test-runner:latest
8888
publishers:
8989
- archive:
90-
artifacts: 'target/*'
90+
artifacts: 'target/**'
9191
allow-empty: true
9292
- slack:
9393
room: '{{ slack_channel }}'

0 commit comments

Comments
 (0)