Test Step Status Calculation

The test step status provides insights into its current combined state of the test case’s execution.

AgileTest provides some native Test Step Statuses (cannot be modified no deleted):

• To Do: The Test Step is in pending execution state (this is a non-final status)

• Pass: The Test Step passed successfully

• Fail: The Test Step failed

1. Manage Test Step Status

Jira Admin can modify, create and edit additional Test Steps Statuses in Jira Admin: Manage Test Step Statuses.

When creating/editing a Test Step Status, it is necessary to identify the Map Status (Steps Running Status) to which the Test Step Status should be mapped.

The "final" attribute in a Test Step's status is essential. Final statuses are given priority over non-final , ensuring that AgileTest consistently focuses on final outcomes (e.g., PASS, FAIL) during the calculation of a Test Step's status. If a Test Step is in a final status and a new Test Execution is initiated, this new execution will not affect the Test Step's overall status.

The rank of the final statuses: Pass < TO DO < FAIL

This approach is beneficial for focusing exclusively on the most recent definitive result and excluding intermediate Test Executions in statuses like TO DO.

2. Calculation of The Given Test Step Status

A Test Execution's status is usually auto-calculated based on individual test step statuses, but a specific status can be enforced for a Test Execution, potentially setting all steps to that status (e.g., marking a Test Execution as "PASS” sets all steps to "PASS").

The calculation follows these steps:

1. Map each test step status to its corresponding test status.

2. Compare all mapped test statuses.

   1. If both status is PASS then the overall Test Execution will be that status

   2. A FAIL status in any step, sets the Test Execution status to FAIL

   3. If all steps are PASS but one step is not yet completed, the the overall status is TO DO

   4. The most recently created status is presumably the highest-ranked status (except mapping with PASS and TO DO)

   5. The highest-ranked status among these becomes the Test Execution status (except FAIL since FAIL ultimately determines the overall execution status )

The order of steps does not impact the overall status of the Test Execution.

2.1. Consequences:

• Only PASS and TO DO status can force test step status.

• Only to do step can be forced by FAIL run.

• FAIL step will take over test run status.

• If all step is the same status then the overall Test Execution status will be that status.

2.2. Example

The table below presents examples based on the above Test Step Statuses Calculation.