Stay organized with collections
Save and categorize content based on your preferences.
Possible outcomes for a test.
Enums
unset
Do not use. For proto versioning only.
success
The test matrix run was successful, for instance: - All the test cases passed. - Robo did not detect a crash of the application under test.
failure
A run failed, for instance: - One or more test case failed. - A test timed out. - The application under test crashed.
inconclusive
Something unexpected happened. The run should still be considered unsuccessful but this is likely a transient problem and re-running the test might be successful.
skipped
All tests were skipped, for instance: - All device configurations were incompatible.
flaky
A group of steps that were run with the same configuration had both failure and success outcomes.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-07-24 UTC."],[],[],null,["# OutcomeSummary\n\nPossible outcomes for a test.\n\n| Enums ||\n|----------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| `unset` | Do not use. For proto versioning only. |\n| `success` | The test matrix run was successful, for instance: - All the test cases passed. - Robo did not detect a crash of the application under test. |\n| `failure` | A run failed, for instance: - One or more test case failed. - A test timed out. - The application under test crashed. |\n| `inconclusive` | Something unexpected happened. The run should still be considered unsuccessful but this is likely a transient problem and re-running the test might be successful. |\n| `skipped` | All tests were skipped, for instance: - All device configurations were incompatible. |\n| `flaky` | A group of steps that were run with the same configuration had both failure and success outcomes. |"]]
