Testing fundamentals

The core ideas of software testing: principles, the test process, verification and validation, defects, and what makes testing independent and effective.

Translations

English

Terms in this topic (92 in English)

Abstract Test Case
A test case without concrete (implementation level) values for input data and expected results. Logical operators are used: instances of the actual values are …
Acceptance Criteria
The exit criteria that a component or system must satisfy in order to be accepted by a user, customer, or other authorized entity.
Account Harvesting
The process of obtaining user account information based on trial and error with the intention of using that information in a security attack.
Analytical Test Strategy
A test strategy whereby the test team analyzes the test basis to identify the test conditions to cover.
Anomaly
Any condition that deviates from expectation based on requirements specifications, design documents, user documents, standards, etc., or from someone's …
Automation Code Defect Density
Defect density of a component of the test automation code.
Bug
A flaw in a component or system that can cause the component or system to fail to perform its required function, e.g., an incorrect statement or data …
Bug Report
A document reporting on any flaw in a component or system that can cause the component or system to fail to perform its required function.
Bug Taxonomy
A system of (hierarchical) categories designed to be a useful aid for reproducibly classifying defects.
Build Verification Test
A set of automated tests which validates the integrity of each new build and verifies its key/core functionality, stability and testability.
Causal Analysis
An analysis technique aimed at identifying the root causes of defects. By directing corrective measures at root causes, it is hoped that the likelihood of …
Cause-Effect Diagram
A graphical representation used to organize and display the interrelationships of various possible root causes of a problem. Possible causes of a real or …
Complete Testing
A test approach in which the test suite comprises all combinations of input values and preconditions.
Completion Criteria
The set of generic and specific conditions, agreed upon with the stakeholders for permitting a process to be officially completed. The purpose of exit criteria …
Concrete Test Case
A test case with concrete (implementation level) values for input data and expected results. Logical operators from high-level test cases are replaced by …
Condition Determination Coverage
The percentage of all single condition outcomes that independently affect a decision outcome that have been exercised by a test case suite. 100% modified …
Cost of Quality
The total costs incurred on quality activities and issues and often split into prevention costs, appraisal costs, internal failure costs and external failure …
Critical Testing Processes
A content-based model for test process improvement built around twelve critical processes. These include highly visible processes, by which peers and management …
Debugger
A tool used by programmers to reproduce failures, investigate the state of programs and find the corresponding defect. Debuggers enable programmers to execute …
Debugging
The process of finding, analyzing and removing the causes of failures in software.
Defect Density
The number of defects identified in a component or system divided by the size of the component or system (expressed in standard measurement terms, e.g., …
Defect Detection Percentage
The number of defects found by a test level, divided by the number found by that test level and any other means afterwards.
Defect Management
The process of recognizing, investigating, taking action and disposing of defects. It involves recording defects, classifying them and identifying the impact.
Defect Management Committee
A cross-functional team of stakeholders who manage reported defects from initial detection to ultimate resolution (defect removal, defect deferral, or report …
Defect-Based Technique
A procedure to derive and/or select test cases targeted at one or more defect types, with tests being developed from what is known about the specific defect …
Equivalence Partitioning
A black-box test design technique in which test cases are designed to execute representatives from equivalence partitions. In principle, test cases are …
Error
A human action that produces an incorrect result.
Error Guessing
A test design technique where the experience of the tester is used to anticipate what defects might be present in the component or system under test as a …
Error Tolerance
The degree to which a component or system can continue normal operation despite the presence of erroneous inputs.
Escaped Defect
A defect that was not detected in a previous test level which is supposed to find such type of defects.
Failure
Deviation of the component or system from its expected delivery, service or result.
Failure Mode
The physical or functional manifestation of a failure.
Failure Mode and Effect Analysis
A systematic approach to risk identification and analysis of identifying possible modes of failure and attempting to prevent their occurrence.
Failure Rate
The ratio of the number of failures of a given category to a given unit of measure, e.g., failures per unit of time, failures per number of transactions, …
False-Fail Result
A test result in which a defect is reported although no such defect actually exists in the test object.
False-Negative Result
A test result which fails to identify the presence of a defect that is actually present in the test object.
Fault Injection
The process of intentionally adding defects to a system for the purpose of finding out whether the system can detect, and possibly recover from, a defect. Fault …
Heuristic Evaluation
A usability review technique that targets usability problems in the user interface or user interface design. With this technique, the reviewers examine the …
Independence of Testing
Separation of responsibilities, which encourages the accomplishment of objective testing.
Maturity
(1) The capability of an organization with respect to the effectiveness and efficiency of its processes and work practices. (2) The capability of the software …
Mean Time to Repair
The average time a component or system will take to recover from a failure.
Memory Leak
A memory access failure due to a defect in a program's dynamic store allocation logic that causes it to fail to release memory after it has finished using it, …
Offline MBT
Model-based test approach whereby test cases are generated into a repository for future execution.
On-the-Fly MBT
Model-based test approach whereby test cases are generated and executed simultaneously.
Organizational Test Policy
A high-level document describing the principles, approach and major objectives of the organization regarding testing.
Priority
The level of (business) importance assigned to an item, e.g., defect.
Process-Compliant Test Strategy
A test strategy whereby the test team follows a set of predefined processes, whereby the processes address such items as documentation, the proper …
Quality Assurance
Part of quality management focused on providing confidence that quality requirements will be fulfilled.
Quality Control
A set of activities designed to evaluate the quality of a component or system.
Quality Management
Coordinated activities to direct and control an organization with regard to quality that include establishing a quality policy and quality objectives, quality …
Recorder
The person who records each defect mentioned and any suggestions for process improvement during a review meeting, on a logging form. The scribe should ensure …
Recoverability
The capability of the software product to re-establish a specified level of performance and recover the data directly affected in case of failure.
Remote Test Lab
A facility that provides remote access to a test environment.
Review Plan
A document describing the approach, resources and schedule of intended review activities. It identifies, amongst others: documents and code to be reviewed, …
Risk Identification
The process of identifying risks using techniques such as brainstorming, checklists and failure history.
Risk-Based Testing
An approach to testing to reduce the level of product risks and inform stakeholders of their status, starting in the initial stages of a project. It involves …
Root Cause
A source of a defect such that if it is removed, the occurrence of the defect type is decreased or removed.
Security Policy
A high-level document describing the principles, approach and major objectives of the organization regarding security.
Severity
The degree of impact that a defect has on the development or operation of a component or system.
Test Analysis
The process of analyzing the test basis and defining test objectives.
Test Approach
The implementation of the test strategy for a specific project. It typically includes the decisions made that follow based on the (test) project's goal and the …
Test Basis
All documents from which the requirements of a component or system can be inferred. The documentation on which the test cases are based. If a document can be …
Test Bed
An environment containing hardware, instrumentation, simulators, software tools, and other support elements needed to conduct a test.
Test Case
A set of input values, execution preconditions, expected results and execution postconditions, developed for a particular objective or test condition, such as …
Test Case Explosion
The disproportionate growth of the number of test cases with growing size of the test basis, when using a certain test design technique. Test case explosion …
Test Case Specification
A document specifying a set of test cases (objective, inputs, test actions, expected results, and execution preconditions) for a test item.
Test Closure
During the test closure phase of a test process data is collected from completed activities to consolidate experience, testware, facts and numbers. The test …
Test Condition
An item or event of a component or system that could be verified by one or more test cases, e.g., a function, transaction, feature, quality attribute, or …
Test Cycle
An instance of the test process against a single identifiable version of the test object.
Test Design Specification
A document specifying the test conditions (coverage items) for a test item, the detailed test approach and identifying the associated high-level test cases.
Test Harness
A test environment comprised of stubs and drivers needed to execute a test.
Test Improvement Plan
A plan for achieving organizational test process improvement objectives based on a thorough understanding of the current strengths and weaknesses of the …
Test Management Tool
A tool that provides support to the test management and control part of a test process. It often has several capabilities, such as testware management, …
Test Maturity Model Integration
A five-level staged framework for test process improvement, related to the Capability Maturity Model Integration (CMMI), that describes the key elements of an …
Test Objective
A reason or purpose for designing and executing a test.
Test Plan
A document describing the scope, approach, resources and schedule of intended test activities. It identifies amongst others test items, the features to be …
Test Process
The fundamental test process comprises test planning and control, test analysis and design, test implementation and execution, evaluating exit criteria and …
Test Process Group
A collection of (test) specialists who facilitate the definition, maintenance, and improvement of the test processes used by an organization.
Test Process Improvement
A program of activities undertaken to improve the performance and maturity of the organization's test processes.
Test Process Improvement Manifesto
A statement that echoes the Agile manifesto, and defines values for improving the testing process. The values are: flexibility over detailed processes, best …
Test Process Improver
A person implementing improvements in the test process based on a test improvement plan.
Test Schedule
A list of activities, tasks or events of the test process, identifying their intended start and finish dates and/or times, and interdependencies.
Test Specification
A document that consists of a test design specification, test case specification and/or test procedure specification.
Test Summary Report
A document summarizing testing activities and results. It also contains an evaluation of the corresponding test items against exit criteria.
Test Type
A group of test activities aimed at testing a component or system focused on a specific test objective, i.e. functional test, usability test, regression test …
Testware
Artifacts produced during the test process required to plan, design, and execute tests, such as documentation, scripts, inputs, expected results, set-up and …
TPI Next
A continuous business-driven framework for test process improvement that describes the key elements of an effective and efficient test process.
Unit Test Framework
A tool that provides an environment for unit or component testing in which a component can be tested in isolation or with suitable stubs and drivers. It also …
User Error Protection
The degree to which a component or system protects users against making errors.
Validation
Confirmation by examination and through provision of objective evidence that the requirements for a specific intended use or application have been fulfilled.
Verification
Confirmation by examination and through provision of objective evidence that specified requirements have been fulfilled.
XiL Test Environment
A generalized term for dynamic testing in different virtual test environments.