Analyze results of testing

PRO

For the analysis of test runs in PFLB Platform are available:

• The comparison dashboard. Comparison of two test runs using tables and graphs in the Grafana dashboard. For more information, see Compare tests.

• Trend report. A report is created based on the results of two or more test runs and allows you to analyze the trend of changes in the parameters of the testing system. The results are displayed in tables and graphs. For more information, see Create trend reports.

For more information on how to view all test runs, see View the performed tests.

See also

• Visualizing tests in Grafana

View the performed tests

FREE STANDARD PRO

To view the performed tests, open the Test runs page:

You can filter a list of the test runs by Test name, Test run status, Label, or User.

To filter the list of the test runs, follow these steps:

1. Click on one of the drop-down lists, for example, Test run status:

   

2. Select the values from the drop-down list.

Test run statuses

The status is displayed for each test run:

• Initialized. To run the test, statistics are collected, a profile and load script are created, resources are allocated.

• Pending. The current test is queued. If there are no available resources, the test will run after some time.

• Running. The test is running. Load generators are sending requests.

• Finished. The test was successfully completed.

• Failed. The test failed or aborted due to problems on load generators or script errors. The interrupted test runs with the status In Progress are counted in the test quota. For more information, see View subscription.

• Canceled. The user canceled the test. The test runs with the status In Progress aborted by the user are counted in the test quota.

SLA fulfillment statuses

The SLA fulfillment status is displayed for each test run:

• SLA not set.

• SLA fulfilled. The test results match SLA.

• SLA failed. The test results don’t match SLA.

Compare test runs

PRO

PFLB Platform allows you to compare the results of two test runs in one Grafana dashboard.

To compare test runs, follow these steps:

1. Open the Test runs page.

2. Select the checkboxes for the two test runs.

3. Click Compare test runs. The Grafana dashboard opens:

   

For more information about the metrics of the comparison dashboard, see Metrics.

Create trend reports

PRO

Trend report is a report that’s created based on the results of two or more load test runs and allows you to analyze the trend of changes in the parameters of the testing system. The results are displayed in tables and graphs.

All trend reports are available in the Trending page:

To create trend reports, follow these steps:

1. Use one of the following methods:

   • On the Test runs page, open the test run and click + Trend.

   • Open the Trending page and click + Add new trend report.

2. Select tests for report using one of the following methods:

   • Choose the specific test and test runs:

     

   • Set test selection criteria:

     1. Select the test.

     2. Enter the number and period for which the tests were run: recent weeks, recent months, or enter the number of recent runs: recent runs.

     3. Select the test run labels if needed.

     4. Select the test run status:

     

3. Click Next. The SLA report items pane opens:

   

4. Click Add chart and select SLA. You can display several SLAs on one chart. The chart is normalized automatically.

5. Click Add table and select SLA. You can display several SLAs in one table.

   Note

   You can add an unlimited number of graphs and tables to the trend report.

6. For the table, configure the values:

   1. Select one of the values in the list:

      • Absolute value. Select to show absolute SLA values.

      • Test-to-test difference. Select to compare SLA values with the previous test run. You can see the difference in absolute values or in percentages.

      • Baseline difference. Select to compare SLA values with the baseline test run. You can see the difference in absolute values or in percentages.

   2. Select the required checkboxes for the Test-to-test difference and Baseline difference value settings.

7. Click Copy embed code if needed. The HTML code of the report copies. For more information, see Embed a trend report.

8. Click Save.

Example of the table in the trend report:

Example of the chart in the trend report:

To edit the trend report, click .

To delete the trend report, click .

Embed a trend report

1. Open the trend report you want to embed.

2. Click Copy embed code for the required chart or table. The button is available when the trend report changes are saved. The HTML code is copied:

   <div id="The ID of the chart or table">
   <script src="The link to the JS script"></script>
   <script>
   pflb &&
   typeof pflb.getSlaReportChart === "function" &&
   pflb.getSlaReportChart("PFLB Platform URL", "SLA report profile id", "The ID of the chart or table", "GUI language", "API token")
   </script>
   </div>
   

3. Paste the code into your website HTML, for example a Confluence page.

Example of a chart’s embedded code

<div id="chart-d4fb16c8-af76-4ac7-889a-0d1d30894e5d">
<script src="https://mycompany.pflb.us/trending.js"></script>
<script>
pflb &&
typeof pflb.getSlaReportChart === "function" &&
pflb.getSlaReportChart("https://mycompany.pflb.us", "1", "d4fb16c8-af76-4ac7-889a-0d1d30894e5d", "en", "API token")
</script>
</div>

Example of a table’s embedded code

<div id="table-d4fb16c8-af76-4ac7-889a-0d1d30894e5d">
<script src="https://mycompany.pflb.us/trending.js"></script>
<script>
pflb &&
typeof pflb.getSlaReportTable === "function" &&
pflb.getSlaReportTable("https://mycompany.pflb.us", "1", "d4fb16c8-af76-4ac7-889a-0d1d30894e5d", "en", "API token")
</script>
</div>

PFLB platform speaks for itself

Run a test to see how the platform works in real life. It takes only 15 minutes for a trial test. It easy and you’re gonna love it.

Try for free