Fast Feedback Prioritize speed by running the most relevant tests first—fail fast, fix fast.
Progressive Testing Start narrow, expand wide. Build confidence through incremental coverage.
Resource Efficiency Every test should earn its keep. No duplication, no waste.
Clear Ownership Every test suite needs an owner. Undefined responsibility leads to decay.
Test Stability If a test can’t reliably block a merge, deployment, or release, it shouldn’t exist. Fix it or delete it.
Test Suite Placement GuidelinesPlease see testing levels for detailed information on the test pyramid and pipeline tiers for understanding merge request pipeline tiers.
Test Type Purpose When to Run Blocking Unit Tests Validate individual components in isolation All MR pipelines (predictive in Tier 1, full suite in Tier 2+) Yes Integration Tests Verify interactions across components Tier 2+ MRs, stable branches, deployments Yes in Tier 2+ System/Feature Tests Validate a single feature functionality via UI Tier 2+ MRs, stable branches Yes in Tier 2+ End-to-end (E2E) Tests Validate full critical user journey • Smoke: Deploy pipelines, feature flag togglesTest Type Selection Start at the lowest level possible: Unit → Integration → System → E2E.
Coverage Assessment Scan existing tests before writing new ones. Don’t test the same thing twice.
Suite Placement Match your test to the correct suite and stage. Follow established patterns.
Default to Blocking New tests block by default. Non-blocking tests are the exception, not the rule.
Modifying Test Execution in PipelineShift Left Move tests earlier in the pipeline whenever possible. Faster feedback saves time.
Preserve Blocking Status Once a test blocks at the right stage, it stays blocking. Demotion requires strong justification.
Document Impact Every change to test execution patterns needs an impact assessment. No silent modifications.
Maintenance and MonitoringTeams should establish regular practices to maintain test suite health:
Flaky and quarantined tests Review regularly, fix or remove immediately. See unhealthy tests for details.
Test suite health Periodically assess test suite performance and identify redundant coverage.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4