|
Difference Between Exit Criteria and Entry Criteria |
Exit Criteria
Exit criteria define when to stop testing such as at the end of a test level or when a set of tests have achieved specific goal. Exit criteria are the criteria or requirements that must be met before completion of a specific task or process. It is predefined set of conditions that must exist before a unit of project work can be deemed completed. It is used a process control mechanism to verify that a process or subprocess has been completed and that its product are of acceptable quality.
Two approaches for Exit Criteria:
- Pessimistic Approach
- Optimistic Approach
Pessimistic Approach
In pessimistic approach we stop testing when any of the allocated resources (budget, time, test cases) are exhausted.
Optimistic Approach
In optimistic approach we stop testing when either reliability meets the requirements or benefit from continuing testing can't justify the cost of testing.
Entry Criteria
Entry criteria define when to start testing such as at the beginning of a test level or when a set of tests is ready for execution. Entry criteria are the requirements which must be met before initiating a specific task or process. It is predefined set of conditions that must be met before initiating a specific project. It is used as a process control mechanism to determine the cost effectiveness of initiating a process or sub-process. Typical exit criteria may cover the following:
- Thoroughness measures, such as coverage of code, functionality or risk
- Estimates of defect or reliability measures
- Cost
- Residual risks, such as defect not fixed or lack of test coverage in certain areas
- Schedules such as those based on time to market
- Availability of proper and adequate test data
- Presence of proper testable data
- Testers are trained and necessary resources are available
- Documentation plan and Test design is ready
+-----------------------------------+-----------------------------------+
| **Exit Criteria** | **Entry Criteria** |
+-----------------------------------+-----------------------------------+
| Exit criteria define when to stop | Entry criteria define when to |
| testing such as at the end of a | start testing such as at the |
| test level or when a set of tests | beginning of a test level or when |
| have achieved specific goal. | a set of tests is ready for |
| | execution. |
+-----------------------------------+-----------------------------------+
| Exit criteria are the criteria or | Entry criteria are the |
| requirements that must be met | requirements which must be met |
| before completion of a specific | before initiating a specific task |
| task or process. | or process. |
+-----------------------------------+-----------------------------------+
| Exit criteria should be met | Entry criteria should be met |
| before a process of unit of task | before initiating specific task |
| is deemed to be completed. | or project. |
+-----------------------------------+-----------------------------------+
| It should be used as preventive | It should be used as preventive |
| tool during the completion of | tool in the process. |
| process. | |
+-----------------------------------+-----------------------------------+
| It should analyze and prevent | It should prevent entry of input |
| delivery of output which doesn't | that is trivial and adds no value |
| yield any success to process. | to the process. |
+-----------------------------------+-----------------------------------+
| Sample Criteria: | Sample Criteria: |
| | |
| → All 100% components test | → Periodic Unit test progress |
| executed with at least 90% pass | report showing 70% completion |
| ratio. | ration |
| | |
| → No extreme and critical | → Stable build with basic |
| outstanding defects in features. | features working. |
| | |
| | → Component test cases can be |
| | ready for execution. |
+-----------------------------------+-----------------------------------+
Exit criteria comes into picture, when:
i. Maximum test cases are executed with certain pass percentage.
ii. Bug rate falls below certain level.
iii. When achieved the deadlines or budget limit.
Evaluating exit criteria has the following major tasks:
iv. To check the test logs against the exit criteria specified in test planning.
v. To assess if more test are needed or if the exit criteria specified should be changed.
vi. To write a test summary report for stakeholders.
Factors for determining entry/exit criteria:
- Acquisition and Supply
- Test items
- Defects/Bugs
- Test Cases
- Coverage
- Quality
- Money/Budget
- Risks
No comments: