Test levels & lifecycle

The test levels and the software development lifecycle: component, integration, system and acceptance testing, regression, maintenance and change-related testing.

Translations

English

Terms in this topic (52 in English)

Acceptance Testing
Formal testing with respect to user needs, requirements, and business processes conducted to determine whether or not a system satisfies the acceptance …
Alpha Testing
Simulated or actual operational testing by potential users/customers or an independent test team at the developers' site, but outside the development …
Back-to-Back-Testing
Testing to compare two or more variants of a test item or a simulation model of the same test item by executing the same test cases on all variants and …
Bebugging
The process of intentionally adding defects to those already in the component or system for the purpose of monitoring the rate of detection and removal, and …
Beta Testing
Operational testing by potential and/or existing users/customers at an external site not otherwise involved with the developers, to determine whether or not a …
Capture/Playback
A test automation approach, where inputs to the test object are recorded during manual testing in order to generate automated test scripts that could be …
Capture/Playback Tool
A type of test execution tool where inputs are recorded during manual testing in order to generate automated test scripts that can be executed later (i.e. …
Change-Related Testing
A type of testing initiated by modification to a component or system.
Component Integration Testing
Testing performed to expose defects in the interfaces and interactions between integrated components.
Component Testing
The testing of individual software components.
Confidence Test
A test suite that covers the main functionality of a component or system to determine whether it works properly before planned testing begins.
Contractual Acceptance Testing
Acceptance testing conducted to verify whether a system satisfies its contractual requirements.
Defect Detection Percentage
The number of defects found by a test level, divided by the number found by that test level and any other means afterwards.
Escaped Defect
A defect that was not detected in a previous test level which is supposed to find such type of defects.
Extreme Programming
A software engineering methodology used within Agile software development whereby core practices are programming in pairs, doing extensive code review, unit …
False-Fail Result
A test result in which a defect is reported although no such defect actually exists in the test object.
False-Negative Result
A test result which fails to identify the presence of a defect that is actually present in the test object.
Impact Analysis
The assessment of change to the layers of development documentation, test documentation and components, in order to implement a given change to specified …
Integration Testing
Testing performed to expose defects in the interfaces and in the interactions between integrated components or systems.
Interface Testing
A type of integration testing performed to determine whether components or systems pass data and control correctly to one another.
Lead Tester
On large projects, the person who reports to the test manager and is responsible for project management of a particular test level or a particular set of …
Level of Intrusion
The level to which a test object is modified by adjusting it for testability.
Level Test Plan
A test plan that typically addresses one test level.
Maintenance Testing
Testing the changes to an operational system or the impact of a changed environment to an operational system.
Method Table
A table containing different test approaches, testing techniques and test types that are required depending on the Automotive Safety Integrity Level (ASIL) and …
Neighborhood Integration Testing
A form of integration testing where all of the nodes that connect to a given node are the basis for the integration testing.
Operational Acceptance Testing
Operational testing in the acceptance test phase, typically performed in a (simulated) operational environment by operations and/or systems administration staff …
Pairwise Integration Testing
A form of integration testing that targets pairs of components that work together, as shown in a call graph.
Pass/Fail Criteria
Decision rules used to determine whether a test item has passed or failed.
Performance Testing Tool
A test tool that generates load for a designated test item and that measures and records its performance during test execution.
Product Risk
A risk directly related to the test object.
Reactive Testing
Testing that dynamically responds to the behavior of the test object and to test results being obtained.
Regression Testing
Testing of a previously tested program following modification to ensure that defects have not been introduced or uncovered in unchanged areas of the software, …
Regression-Averse Test Strategy
A test strategy whereby the test team applies various techniques to manage the risk of regression such as functional and/or non-functional regression test …
Regulatory Acceptance Testing
Acceptance testing conducted to verify whether a system conforms to relevant laws, policies and regulations.
System Integration Testing
Testing the integration of systems and packages; testing interfaces to external organizations (e.g., Electronic Data Interchange, Internet).
System Testing
Testing an integrated system to verify that it meets specified requirements.
System Under Test
See test object.
Test Case Specification
A document specifying a set of test cases (objective, inputs, test actions, expected results, and execution preconditions) for a test item.
Test Cycle
An instance of the test process against a single identifiable version of the test object.
Test Design Specification
A document specifying the test conditions (coverage items) for a test item, the detailed test approach and identifying the associated high-level test cases.
Test Execution Tool
A test tool that executes tests against a designated test item and evaluates the outcomes against expected results and postconditions.
Test Hook
A customized software interface that enables automated testing of a test object.
Test Item
The individual element to be tested. There usually is one test object and many test items.
Test Level
A group of test activities that are organized and managed together. A test level is linked to the responsibilities in a project. Examples of test levels are …
Test Manager
The person responsible for project management of testing activities and resources, and evaluation of a test object. The individual who directs, controls, …
Test Object
The component or system to be tested.
Test Phase
A distinct set of test activities collected into a manageable phase of a project, e.g., the execution activities of a test level.
Test Run
The execution of a test suite on a specific version of the test object.
Test Type
A group of test activities aimed at testing a component or system focused on a specific test objective, i.e. functional test, usability test, regression test …
Unit Test Framework
A tool that provides an environment for unit or component testing in which a component can be tested in isolation or with suitable stubs and drivers. It also …
User Acceptance Testing
Acceptance testing carried out by future users in a (simulated) operational environment focusing on user requirements and needs.