Percentile and Standard Deviation in Collection Charts

Document created by Chris Sommerstad Employee on Jul 22, 2017
Version 1Show Document
  • View in full screen mode

Results Created (Coming soon)

 

Note: We use a more precise calculation for percentiles, that is not require a normal distribution. Works for any distribution.

Collection Completion Time Percentile

This chart shows the requested percentile of collection completion time for each period with a separate series for each collection.

Collection Completion Time Standard Deviation

This chart shows the standard deviation of collection completion time for each period with a separate series for each collection.

Top N Collections by Percentile

This chart presents the top n collections by the selected percentile. As in prior releases, five is the default number shown for n.

Top N Collections by Standard Deviation

This chart presents the top n collections by the standard deviation. As in prior releases, five is the default number shown for n.

Standard Deviation and Percentile Columns in the Collection Analysis Widget

The Collection Analysis widget displays both Standard Deviation and Percentile columns. To view these columns, it may be necessary to scroll to the right (depending on your dashboard layout and screen resolution).

CloudTest supports any percentile data for the Percentile column. It is possible to view other percentile data when exporting CSV and Excel spreadsheets.

Standard Deviation/Percentile Columns in Exported Collection Aggregate Data

The Standard Deviation and Percentile columns are also viewable in data exported from a given test result to both the CSV and XML Spreadsheet format.

  1. Select the result in either the Compositions or Results list in Central.
  2. Right click and then choose Export.
  3. In the Export dialog box, Export format drop-down, select either CSV or Excel Spreadsheet.

  1. In the Data Source drop-down, select Collection Aggregate.

  1. When the download prompt appears, select a download folder or choose to open the file in an application. The new columns appear in the exported file as (shown right).

Results Created with SOASTA 57 or Below

 

Note: Percentiles are calculated with an algorithm that determines the percentile based on an assumption of a normal distribution of data. Data that is "non-normal," or a small sample size, will not accurately calculate percentiles.


For percentile charts, use the slider to select from among the possible percentile values or enter a Z-value to use. Selecting a new percentile will result in a reset to the default Z-value and vice versa. For Top N charts that show the percentile in use in the title bar, this value will change with the selection.

To display settings for percentile or any other charts, click the Toggle Edit Mode button on the dashboard toolbar while a given chart is selected (or select the chart while in Edit Mode). Once the Edit Panel is visible, select the chart by name or select its Settings node.

 

Standard deviation charts include the same chart settings as other collection-based charts, with the option to include Stopped Collections or Failed Collections (shown above as selected), which are not included by default.

Attachments

    Outcomes