Test Runs Best Practices
2 min read
Practical guidance for getting standalone test runs right. For the workflow itself, start with Test Runs Overview.
Plan The Run
Section titled “Plan The Run”- Use a clear title that explains the goal, not just the date.
- Keep the description focused on what is being validated.
- Choose only the test cases the scope needs — a run padded with irrelevant cases makes its pass rate meaningless.
- Use requirements and test suites when they make the selection easier to maintain than a hand-picked list.
Record Useful Results
Section titled “Record Useful Results”- Keep statuses accurate as testing progresses, rather than filling them in at the end.
- Add notes at the step where the issue happened, not on the test case as a whole.
- Attach evidence for failed and blocked work.
- Distinguish Failed from Blocked honestly. A blocked test tells you nothing about whether the feature works, and treating it as a failure hides that.
- Review skipped and not-executed test cases before treating the session as complete.
Complete Runs When Testing Is Done
Section titled “Complete Runs When Testing Is Done”Completing a run locks it, and its defect figures are locked when you complete the run. The numbers stay the same when defects change afterwards, so you can quote a finished run later.
Resume rather than delete when a run needs one more result. See Complete and Resume.
Automate The Repeatable Parts
Section titled “Automate The Repeatable Parts”A suite that runs the same way every time is a candidate for an automated run.
When you do automate:
- Add the test cases to the run before the build. Cases the report never mentions stay Not Executed, which shows you what your automation doesn’t cover. A run that only contains what the pipeline happened to run can’t show that.
- Put the test case code in the test’s name. It survives renaming in a way title matching does not.
- Check Automation Health periodically. Tests your pipeline runs that don’t match any test case aren’t linked to anything in Hawzu.
Use The Right Workflow
Section titled “Use The Right Workflow”Use Test Runs for independent testing outside a release.
Use Release Executions when the work belongs to a release milestone and should contribute to release progress and readiness. Choosing a test run for release-bound work means the release dashboard will not know the testing happened.