The test results graphs that show up on the Test Results Wiki Page are created using the R programming language, immediately following the conclusion of a scheduled test.  The CHO graphs are generated using our QA Jenkins while the CHO test is running.  This article will be mainly focusing on the graphs generated using R.

Individual Test Results

Trend Graphs - FUNC, HA, USECASE

...

Each test result (besides SCPF and PLATdockertest) is illustrated as a trend graph, displaying the results of the last 20 builds of the specific test.

The number of tests test cases executed is equal to the sum of test cases passed and failed test cases failed.  Therefore, tests may contain skipped test cases if the executed test cases (sum of passed and failed cases) do not equal the number of planned test cases.

Trend Graphs - SCPF

...

Similar to the trend graphs of individual tests, these graphs display the results of all all  tests that are fully passing, contain errors, vs. tests that contain at least one error and the number of tests run per for the corresponding build number.

Overall Pie Chart

...

For each test category, the overall pie charts display percentage of passed test cases vs. percentage of failed test cases, and number of executed test cases vs. number of skipped test cases.

Build Statistics

The build statistics graph displays a summary of all test suites as stacked bar graphs, with the stacks containing the percent of passed, failed, and skipped test cases for each test category.  

...