[{"data":1,"prerenderedAt":52},["ShallowReactive",2],{"wiki-test-management-test-run-en":3},{"meta":4,"html":8,"headings":9,"words":51},{"title":5,"description":6,"published":7,"updated":7},"Test run","A test run: which test cases it includes, the version and environment under test, result statuses, retesting and regression, and the summary of a run.","2026-11-03","\u003Cp>A \u003Cstrong>test run\u003C/strong> is a single execution of a selected set of \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"test-case\">test cases\u003C/span> on a specific version of the product in a specific environment. A run records what was tested, where, when and by whom, and contains one result for every test case included in it. Runs are the unit in which a \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"test-management-system\">test management system\u003C/span> records the execution of tests, both manual and automated.\u003C/p>\n\u003Cp>The term comes from practice rather than from a standard. The ISTQB glossary uses it in the definition of a \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"test-suite\">test suite\u003C/span>: a set of test scripts or test procedures to be executed in a specific test run. The ISO/IEC/IEEE 29119-3 standard (test documentation, current edition 2021) does not define a test run document. It describes the records that a run produces: actual results and test results, the test execution log, test incident reports, and on top of them the test status report and the test completion report.\u003C/p>\n\u003Ch2 id=\"what-a-test-run-is-for\" class=\"wiki-heading\">What a test run is for\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"what-a-test-run-is-for\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Cp>A test case describes a check. It does not say whether the check was performed on the current build or what the outcome was. The same test case is executed many times: on every release candidate, on several browsers, after every fix. Each execution happens in a context: a version of the product, an environment, a date, an executor.\u003C/p>\n\u003Cp>A test run fixes this context once for a whole set of executions. Its results answer the questions that a test case cannot answer:\u003C/p>\n\u003Cul>\n\u003Cli>which test cases were executed on build 2.4.1 and which were not;\u003C/li>\n\u003Cli>how many of them passed, failed or could not be executed;\u003C/li>\n\u003Cli>whether the failures are new or were already present on the previous build;\u003C/li>\n\u003Cli>whether the \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"exit-criteria\">exit criteria\u003C/span> of the test level are met.\u003C/li>\n\u003C/ul>\n\u003Cp>The basic concepts of a test management system (test case, suite, run, result) are introduced in the article \u003Ca href=\"/en/wiki/test-management/what-is-a-test-management-system\" class=\"wiki-link wiki-link--article\">What is a test management system\u003C/a>.\u003C/p>\n\u003Ch2 id=\"composition-of-a-test-run\" class=\"wiki-heading\">Composition of a test run\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"composition-of-a-test-run\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Ch3 id=\"selection-of-test-cases\" class=\"wiki-heading\">Selection of test cases\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"selection-of-test-cases\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h3>\n\u003Cp>A run includes the test cases that are needed for its goal. The usual ways to select them:\u003C/p>\n\u003Cul>\n\u003Cli>a whole test suite or several suites, for example all tests of the checkout feature;\u003C/li>\n\u003Cli>a filter on attributes: all active test cases of priority "High" for the component "Payment";\u003C/li>\n\u003Cli>a regression subset, a fixed list of test cases executed on every release;\u003C/li>\n\u003Cli>the test cases affected by a change, selected through links to the changed requirements;\u003C/li>\n\u003Cli>the test cases that failed in a previous run, for retesting.\u003C/li>\n\u003C/ul>\n\u003Cp>When a run is created, its list of test cases is fixed. Test cases added to the suite later do not appear in an existing run. This keeps the run comparable to its plan: the number of planned executions does not change during execution.\u003C/p>\n\u003Ch3 id=\"version-under-test\" class=\"wiki-heading\">Version under test\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"version-under-test\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h3>\n\u003Cp>A run refers to a specific version of the product: a build number, a release, a commit. Without it the results cannot be interpreted. A failed result on build 2.4.0 and a passed result on build 2.4.1 describe a fix. The same results without versions describe nothing.\u003C/p>\n\u003Ch3 id=\"test-environment\" class=\"wiki-heading\">Test environment\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"test-environment\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h3>\n\u003Cp>A \u003Cstrong>test environment\u003C/strong> is, in the wording of the ISTQB glossary, an environment containing hardware, instrumentation, simulators, software tools and other support elements needed to conduct a test. For a run it is recorded as a set of parameters: operating system, browser and its version, device, server stand, configuration of the product, versions of external services.\u003C/p>\n\u003Cp>When the same set of test cases has to be executed in several environments, two approaches are used. The first is a separate run for each environment. The second is one run with a configuration matrix, in which every test case gets one result per configuration:\u003C/p>\n\u003Cdiv class=\"wiki-code wiki-code--plain\">\u003Cpre>\u003Ccode>Run "Release 2.4.1, regression"\n |\n +-- TC-12 "Pay with a saved card"\n |     +-- Windows 11, Chrome 141   -> passed\n |     +-- macOS 15, Safari 26      -> failed\n |     +-- Android 16, app          -> passed\n |\n +-- TC-13 "Pay with an expired card"\n       +-- Windows 11, Chrome 141   -> passed\n       +-- macOS 15, Safari 26      -> passed\n       +-- Android 16, app          -> blocked\u003C/code>\u003C/pre>\u003C/div>\n\u003Cp>In both cases a result belongs to exactly one environment. A result "passed" without an environment does not say where the behavior was checked.\u003C/p>\n\u003Ch3 id=\"assignees-and-schedule\" class=\"wiki-heading\">Assignees and schedule\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"assignees-and-schedule\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h3>\n\u003Cp>A run of manual tests is distributed between testers: each test case or group of test cases has an assignee. A run has a planned start and end, often tied to a milestone or a release date. Automated runs are started by a CI system and have no assignees, only a source: the \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"ci-pipeline\">pipeline\u003C/span> and the job that produced the results.\u003C/p>\n\u003Ch2 id=\"result-statuses\" class=\"wiki-heading\">Result statuses\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"result-statuses\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Cp>The status of a result says what happened with one test case in one run. In ISO/IEC/IEEE 29119 the test result is reduced to two values: whether the test case passed or failed. Test management systems use a wider set, because not every planned test case reaches a verdict. Standards do not fix this set. A typical one:\u003C/p>\n\u003Cdiv class=\"wiki-table wiki-table--cols-2\">\u003Ctable>\n\u003Cthead>\n\u003Ctr>\n\u003Cth>Status\u003C/th>\n\u003Cth>Meaning\u003C/th>\n\u003C/tr>\n\u003C/thead>\n\u003Ctbody>\n\u003Ctr>\n\u003Ctd>Untested\u003C/td>\n\u003Ctd>The test case is in the run but has not been executed yet\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Passed\u003C/td>\n\u003Ctd>The actual result matches the expected result\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Failed\u003C/td>\n\u003Ctd>The actual result differs from the expected result\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Blocked\u003C/td>\n\u003Ctd>The test case cannot be executed because its preconditions are not met, for example because of another defect or an unavailable environment\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Skipped\u003C/td>\n\u003Ctd>The test case was deliberately not executed in this run\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Retest\u003C/td>\n\u003Ctd>The test case has to be executed again, for example after a fix\u003C/td>\n\u003C/tr>\n\u003C/tbody>\n\u003C/table>\u003C/div>\n\u003Cp>"Failed" and "blocked" are different statuses for a reason. A failed test case has checked the behavior and found a deviation. A blocked test case has not checked anything. The ISTQB glossary describes a blocked test case as a test case that cannot be executed because the \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"precondition\">preconditions\u003C/span> for its execution are not fulfilled. If blocked results are counted as failed, the report shows \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"defect\">defects\u003C/span> where there is a lack of information.\u003C/p>\n\u003Cp>The results of automated tests come with their own statuses. In the \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"junit-xml\">JUnit XML\u003C/span> format a test case without a result element is passed, \u003Ccode>failure\u003C/code> means a failed check, \u003Ccode>error\u003C/code> an unexpected problem during execution, \u003Ccode>skipped\u003C/code> a test that was not executed. When results are imported, these statuses are mapped to the statuses of the system:\u003C/p>\n\u003Cdiv class=\"wiki-table wiki-table--cols-2\">\u003Ctable>\n\u003Cthead>\n\u003Ctr>\n\u003Cth>JUnit XML\u003C/th>\n\u003Cth>Status in the run\u003C/th>\n\u003C/tr>\n\u003C/thead>\n\u003Ctbody>\n\u003Ctr>\n\u003Ctd>no result element\u003C/td>\n\u003Ctd>Passed\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>\u003Ccode>failure\u003C/code>\u003C/td>\n\u003Ctd>Failed\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>\u003Ccode>error\u003C/code>\u003C/td>\n\u003Ctd>Failed or blocked, depending on the rules of the team\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>\u003Ccode>skipped\u003C/code>\u003C/td>\n\u003Ctd>Skipped\u003C/td>\n\u003C/tr>\n\u003C/tbody>\n\u003C/table>\u003C/div>\n\u003Ch2 id=\"executing-a-run\" class=\"wiki-heading\">Executing a run\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"executing-a-run\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Cp>During execution the tester performs the steps of each test case and records the result. A result contains more than the status:\u003C/p>\n\u003Cul>\n\u003Cli>the \u003Cstrong>actual result\u003C/strong>: what was observed, in particular when it differs from the \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"expected-result\">expected result\u003C/span>;\u003C/li>\n\u003Cli>\u003Cstrong>attachments\u003C/strong>: screenshots, screen recordings, logs, files that show the observed behavior;\u003C/li>\n\u003Cli>the time spent and the executor;\u003C/li>\n\u003Cli>for a failed result, a link to a defect.\u003C/li>\n\u003C/ul>\n\u003Cp>An anomaly, a difference between the actual and the expected result, is analyzed before a \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"defect-report\">defect report\u003C/span> is created. The ISTQB Foundation Level syllabus (version 4.0.1) notes that a reported anomaly can turn out to be a real defect, a false positive or a change request. A false positive is often caused by an error in the test case itself or by a problem in the environment. The structure of a defect report is described in the article \u003Ca href=\"/en/wiki/test-management/defect-report\" class=\"wiki-link wiki-link--article\">Defect report\u003C/a>.\u003C/p>\n\u003Cp>A run is closed when all planned test cases have a final status or when the team decides to stop execution. After closing, the results of a run are not changed: they record the state of the product at a moment in time. A new execution is done in a new run.\u003C/p>\n\u003Ch2 id=\"retesting-and-regression-testing\" class=\"wiki-heading\">Retesting and regression testing\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"retesting-and-regression-testing\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Cp>After defects are fixed, two kinds of testing follow. The ISTQB syllabus separates them.\u003C/p>\n\u003Cp>\u003Cstrong>Confirmation testing\u003C/strong>, also called retesting, confirms that an original defect has been fixed. It executes again the test cases that failed because of the defect, on the build with the fix. Depending on the risk, new test cases can be added to check the fix.\u003C/p>\n\u003Cp>\u003Cstrong>Regression testing\u003C/strong> confirms that a change, including a fix, has not caused adverse consequences in other parts of the product. It executes test cases that passed before and that may be affected by the change. Its scope is determined with the help of \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"impact-analysis\">impact analysis\u003C/span>: the identification of the work products affected by a change. The links between requirements, test cases and code used for impact analysis are described in the article \u003Ca href=\"/en/wiki/test-management/requirements-traceability\" class=\"wiki-link wiki-link--article\">Requirements traceability and coverage\u003C/a>.\u003C/p>\n\u003Cp>In a test management system both kinds of testing are new runs on a new build:\u003C/p>\n\u003Cdiv class=\"wiki-code wiki-code--plain\">\u003Cpre>\u003Ccode>Run A: "Release 2.4.0"            TC-12 failed  -> BUG-310\n                                   TC-40 passed\n                                   TC-41 passed\nFix of BUG-310 in build 2.4.1\nRun B: "Retest BUG-310, 2.4.1"    TC-12 passed  (confirmation testing)\nRun C: "Regression, 2.4.1"        TC-40 passed  (regression testing)\n                                   TC-41 failed  -> BUG-325\u003C/code>\u003C/pre>\u003C/div>\n\u003Cp>Regression test suites are executed many times and change slowly. They are the first candidates for automation. Automated regression runs in CI are described in the article \u003Ca href=\"/en/wiki/test-automation/automated-tests-in-ci\" class=\"wiki-link wiki-link--article\">Automated tests in CI\u003C/a>.\u003C/p>\n\u003Ch2 id=\"summary-of-a-test-run\" class=\"wiki-heading\">Summary of a test run\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"summary-of-a-test-run\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Cp>The summary of a run is computed from its results. It shows the number of results in each status, the share of executed test cases and the share of passed ones. For a run with 200 planned test cases:\u003C/p>\n\u003Cdiv class=\"wiki-table wiki-table--cols-2\">\u003Ctable>\n\u003Cthead>\n\u003Ctr>\n\u003Cth>Status\u003C/th>\n\u003Cth>Number\u003C/th>\n\u003C/tr>\n\u003C/thead>\n\u003Ctbody>\n\u003Ctr>\n\u003Ctd>Passed\u003C/td>\n\u003Ctd>162\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Failed\u003C/td>\n\u003Ctd>14\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Blocked\u003C/td>\n\u003Ctd>9\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Skipped\u003C/td>\n\u003Ctd>5\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Untested\u003C/td>\n\u003Ctd>10\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Total\u003C/td>\n\u003Ctd>200\u003C/td>\n\u003C/tr>\n\u003C/tbody>\n\u003C/table>\u003C/div>\n\u003Cp>From these numbers: 176 test cases reached a verdict, 162 passed and 14 failed. Blocked, skipped and untested test cases were not executed. 176 of 200 is 88 percent of the run. 162 of the 176 test cases with a verdict passed, which is 92 percent. The same run can be described as "81 percent passed" (162 of 200) or "92 percent passed" (162 of 176), depending on the denominator. A report states which denominator it uses. How metrics like these are computed and where they mislead is described in the article \u003Ca href=\"/en/wiki/test-management/test-metrics\" class=\"wiki-link wiki-link--article\">Test metrics\u003C/a>.\u003C/p>\n\u003Cp>The ISTQB syllabus distinguishes two kinds of reports based on results. A \u003Cstrong>test progress report\u003C/strong> is produced regularly during testing: progress against the schedule, impediments, metrics, new risks and the testing planned for the next period. A \u003Cstrong>test completion report\u003C/strong> is produced at a milestone: a summary of the testing performed, an evaluation against the exit criteria of the \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"test-plan\">test plan\u003C/span>, deviations from the plan, unfixed defects and residual risks, lessons learned. In a test management system both are assembled from the results of one or more runs.\u003C/p>\n\u003Cp>The summary of a run is compared with the exit criteria of the test plan. A criterion such as "all test cases of priority High are executed, no open defects of \u003Cspan class=\"wiki-term\" tabindex=\"0\" data-wiki-term=\"severity\">severity\u003C/span> Critical" is checked directly against the results and the linked defects. Exit criteria are described in the article \u003Ca href=\"/en/wiki/test-management/test-plan-and-test-strategy\" class=\"wiki-link wiki-link--article\">Test plan and test strategy\u003C/a>.\u003C/p>\n\u003Ch2 id=\"test-run-test-suite-and-test-plan\" class=\"wiki-heading\">Test run, test suite and test plan\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"test-run-test-suite-and-test-plan\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Cp>The three entities are related and are often confused.\u003C/p>\n\u003Cdiv class=\"wiki-table wiki-table--cols-4\">\u003Ctable>\n\u003Cthead>\n\u003Ctr>\n\u003Cth>\u003C/th>\n\u003Cth>Test suite\u003C/th>\n\u003Cth>Test run\u003C/th>\n\u003Cth>Test plan\u003C/th>\n\u003C/tr>\n\u003C/thead>\n\u003Ctbody>\n\u003Ctr>\n\u003Ctd>What it is\u003C/td>\n\u003Ctd>Group of test cases\u003C/td>\n\u003Ctd>Execution of selected test cases\u003C/td>\n\u003Ctd>Description of the scope, approach and schedule of testing\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Contains\u003C/td>\n\u003Ctd>Test cases\u003C/td>\n\u003Ctd>Results of test cases\u003C/td>\n\u003Ctd>Goals, criteria, references to runs\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Changes over time\u003C/td>\n\u003Ctd>Test cases are added and removed\u003C/td>\n\u003Ctd>The list is fixed at creation, results are added during execution\u003C/td>\n\u003Ctd>Is revised when the scope or the schedule changes\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Bound to a version of the product\u003C/td>\n\u003Ctd>No\u003C/td>\n\u003Ctd>Yes\u003C/td>\n\u003Ctd>To a release or a project\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Lifetime\u003C/td>\n\u003Ctd>As long as the feature exists\u003C/td>\n\u003Ctd>Until it is closed; then it is kept as history\u003C/td>\n\u003Ctd>Until the end of the release or the project\u003C/td>\n\u003C/tr>\n\u003C/tbody>\n\u003C/table>\u003C/div>\n\u003Cp>A suite answers the question "what can be tested", a run "what was tested on this build and with what outcome", a plan "what has to be tested, how and by when". A plan typically groups several runs: on different environments, for different test levels, or successive runs of one release.\u003C/p>\n\u003Ch2 id=\"terms\" class=\"wiki-heading\">Terms\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"terms\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Cdiv class=\"wiki-table wiki-table--cols-2\">\u003Ctable>\n\u003Cthead>\n\u003Ctr>\n\u003Cth>Term\u003C/th>\n\u003Cth>Meaning\u003C/th>\n\u003C/tr>\n\u003C/thead>\n\u003Ctbody>\n\u003Ctr>\n\u003Ctd>Test run\u003C/td>\n\u003Ctd>Execution of a selected set of test cases on a specific version of the product in a specific environment\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Test result\u003C/td>\n\u003Ctd>Record of one execution of one test case within a test run\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Test environment\u003C/td>\n\u003Ctd>Environment containing hardware, instrumentation, simulators, software tools and other support elements needed to conduct a test\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Actual result\u003C/td>\n\u003Ctd>Behavior observed when a test case is executed\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Blocked test case\u003C/td>\n\u003Ctd>Test case that cannot be executed because the preconditions for its execution are not fulfilled\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Confirmation testing\u003C/td>\n\u003Ctd>Testing that confirms that an original defect has been fixed; also called retesting\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Regression testing\u003C/td>\n\u003Ctd>Testing that confirms that a change has not caused adverse consequences in other parts of the product\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Impact analysis\u003C/td>\n\u003Ctd>Identification of the work products affected by a change\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Test progress report\u003C/td>\n\u003Ctd>Report produced regularly during testing: progress, impediments, metrics, risks\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>Test completion report\u003C/td>\n\u003Ctd>Report produced at a milestone: summary of testing, evaluation against exit criteria, residual risks\u003C/td>\n\u003C/tr>\n\u003C/tbody>\n\u003C/table>\u003C/div>\n\u003Ch2 id=\"sources\" class=\"wiki-heading\">Sources\u003Cbutton type=\"button\" class=\"wiki-heading__anchor\" data-wiki-anchor=\"sources\" aria-label=\"Copy link to section\" data-copied-label=\"Link to section copied\">\u003Csvg class=\"wiki-heading__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M117.18,188.74a12,12,0,0,1,0,17l-5.12,5.12A58.26,58.26,0,0,1,70.6,228h0A58.62,58.62,0,0,1,29.14,127.92L63.89,93.17a58.64,58.64,0,0,1,98.56,28.11,12,12,0,1,1-23.37,5.44,34.65,34.65,0,0,0-58.22-16.58L46.11,144.89A34.62,34.62,0,0,0,70.57,204h0a34.41,34.41,0,0,0,24.49-10.14l5.11-5.12A12,12,0,0,1,117.18,188.74ZM226.83,45.17a58.65,58.65,0,0,0-82.93,0l-5.11,5.11a12,12,0,0,0,17,17l5.12-5.12a34.63,34.63,0,1,1,49,49L175.1,145.86A34.39,34.39,0,0,1,150.61,156h0a34.63,34.63,0,0,1-33.69-26.72,12,12,0,0,0-23.38,5.44A58.64,58.64,0,0,0,150.56,180h.05a58.28,58.28,0,0,0,41.47-17.17l34.75-34.75a58.62,58.62,0,0,0,0-82.91Z\"/>\u003C/svg>\u003Csvg class=\"wiki-heading__icon wiki-heading__icon--done\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M232.49,80.49l-128,128a12,12,0,0,1-17,0l-56-56a12,12,0,1,1,17-17L96,183,215.51,63.51a12,12,0,0,1,17,17Z\"/>\u003C/svg>\u003C/button>\u003C/h2>\n\u003Cul>\n\u003Cli>\u003Ca href=\"https://www.istqb.org/wp-content/uploads/2024/11/ISTQB_CTFL_Syllabus_v4.0.1.pdf\" target=\"_blank\" rel=\"noopener\" class=\"wiki-link wiki-link--external\">ISTQB Certified Tester Foundation Level Syllabus v4.0.1, ISTQB, 2024\u003Csvg class=\"wiki-link__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M228,104a12,12,0,0,1-24,0V69l-59.51,59.51a12,12,0,0,1-17-17L187,52H152a12,12,0,0,1,0-24h64a12,12,0,0,1,12,12Zm-44,24a12,12,0,0,0-12,12v64H52V84h64a12,12,0,0,0,0-24H48A20,20,0,0,0,28,80V208a20,20,0,0,0,20,20H176a20,20,0,0,0,20-20V140A12,12,0,0,0,184,128Z\"/>\u003C/svg>\u003Cspan class=\"wiki-visually-hidden\">(opens in a new tab)\u003C/span>\u003C/a>\u003C/li>\n\u003Cli>\u003Ca href=\"https://glossary.istqb.org/\" target=\"_blank\" rel=\"noopener\" class=\"wiki-link wiki-link--external\">ISTQB Glossary\u003Csvg class=\"wiki-link__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M228,104a12,12,0,0,1-24,0V69l-59.51,59.51a12,12,0,0,1-17-17L187,52H152a12,12,0,0,1,0-24h64a12,12,0,0,1,12,12Zm-44,24a12,12,0,0,0-12,12v64H52V84h64a12,12,0,0,0,0-24H48A20,20,0,0,0,28,80V208a20,20,0,0,0,20,20H176a20,20,0,0,0,20-20V140A12,12,0,0,0,184,128Z\"/>\u003C/svg>\u003Cspan class=\"wiki-visually-hidden\">(opens in a new tab)\u003C/span>\u003C/a>\u003C/li>\n\u003Cli>\u003Ca href=\"https://www.iso.org/standard/79429.html\" target=\"_blank\" rel=\"noopener\" class=\"wiki-link wiki-link--external\">ISO/IEC/IEEE 29119-3:2021, Software testing, Part 3: Test documentation\u003Csvg class=\"wiki-link__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M228,104a12,12,0,0,1-24,0V69l-59.51,59.51a12,12,0,0,1-17-17L187,52H152a12,12,0,0,1,0-24h64a12,12,0,0,1,12,12Zm-44,24a12,12,0,0,0-12,12v64H52V84h64a12,12,0,0,0,0-24H48A20,20,0,0,0,28,80V208a20,20,0,0,0,20,20H176a20,20,0,0,0,20-20V140A12,12,0,0,0,184,128Z\"/>\u003C/svg>\u003Cspan class=\"wiki-visually-hidden\">(opens in a new tab)\u003C/span>\u003C/a>\u003C/li>\n\u003Cli>\u003Ca href=\"https://github.com/testmoapp/junitxml\" target=\"_blank\" rel=\"noopener\" class=\"wiki-link wiki-link--external\">Common JUnit XML format and examples, Testmo\u003Csvg class=\"wiki-link__icon\" viewBox=\"0 0 256 256\" width=\"16\" height=\"16\" fill=\"currentColor\" aria-hidden=\"true\" focusable=\"false\">\u003Cpath d=\"M228,104a12,12,0,0,1-24,0V69l-59.51,59.51a12,12,0,0,1-17-17L187,52H152a12,12,0,0,1,0-24h64a12,12,0,0,1,12,12Zm-44,24a12,12,0,0,0-12,12v64H52V84h64a12,12,0,0,0,0-24H48A20,20,0,0,0,28,80V208a20,20,0,0,0,20,20H176a20,20,0,0,0,20-20V140A12,12,0,0,0,184,128Z\"/>\u003C/svg>\u003Cspan class=\"wiki-visually-hidden\">(opens in a new tab)\u003C/span>\u003C/a>\u003C/li>\n\u003C/ul>\n",[10,14,17,21,24,27,30,33,36,39,42,45,48],{"id":11,"level":12,"text":13},"what-a-test-run-is-for",2,"What a test run is for",{"id":15,"level":12,"text":16},"composition-of-a-test-run","Composition of a test run",{"id":18,"level":19,"text":20},"selection-of-test-cases",3,"Selection of test cases",{"id":22,"level":19,"text":23},"version-under-test","Version under test",{"id":25,"level":19,"text":26},"test-environment","Test environment",{"id":28,"level":19,"text":29},"assignees-and-schedule","Assignees and schedule",{"id":31,"level":12,"text":32},"result-statuses","Result statuses",{"id":34,"level":12,"text":35},"executing-a-run","Executing a run",{"id":37,"level":12,"text":38},"retesting-and-regression-testing","Retesting and regression testing",{"id":40,"level":12,"text":41},"summary-of-a-test-run","Summary of a test run",{"id":43,"level":12,"text":44},"test-run-test-suite-and-test-plan","Test run, test suite and test plan",{"id":46,"level":12,"text":47},"terms","Terms",{"id":49,"level":12,"text":50},"sources","Sources",2028,1793718938720]