Performance Intelligence Dashboards

Document created by Chris Sommerstad Employee on Jul 22, 2017
Version 1Show Document
  • View in full screen mode

CloudTest provides System “performance intelligence” dashboards--such as Combined Charts, Correlated Charts, Waterfall Dashboard, and many others. These appear i the New or Existing Dashboard box, System Dashboard list when creating a dashboard, and are located in Central > Library in:

 /System Objects/Dashboards/Performance Intelligence

These dashboards increase performance intelligence by helping you identify common testing issues—such as the “classic bottleneck.”

Within a classic bottleneck, as Virtual Users go up the message Send Rate to the target web site also goes up. Eventually, this flattens out, as response times back up and more queues (on the test site) are filled. This leads to increased errors (connection timeouts and resets) because the queue is too full and things are falling off of it. On a chart, this looks rather like a hose that is kinked.

Combined Charts Dashboard

Five combined charts are presented in this dashboard, which bring together four critical metrics to demonstrate how user load and the overall data exchange between client and server bottlenecks at a given level.

Your customers (Virtual Users), their messages (Send Rate), and data by volume (Bytes Sent and Received) as messages/responses, can expose scaling issues when compared to one another and contrasted with Error Count.

Send Rate vs. Virtual Users

At the top of the dashboard, Send Rate vs. Virtual Users compares the rate at which users and messages in a test increase or decrease. Mouse over to get statistics along the timeline for either metric. Use the Legend to toggle each chart series on or off.

Virtual Users vs. Error Count

As the number of users spikes and then plateaus on the Virtual Users vs. Error Count chart below, the error count reaches an unacceptable level.

Virtual Users vs. Bytes Sent and Received

User data and the corresponding server responses are charted in the Virtual Users vs. Bytes Sent and Received chart below.

Error Count vs. Send Rate

While the Send Rate in the Error Count vs. Send Rate chart below gradually rises, the Error Count increases over time at a greater rate.

Correlated Charts Dashboard

Correlated charts share a common time x-axis that permits the dragged target to be plotted over the drop target.

The Correlated Charts dashboard presents three such charts using the same four metrics as in the Combined Charts dashboard: Send Rate over Virtual Users, Bytes Sent and Received over Virtual Users, and Error Count over Virtual Users.

Send Rate over Virtual Users

This chart shows the distribution of send rate rising as virtual users also increase.

Bytes Sent and Received over Virtual Users

This chart shows the distribution of bytes sent as virtual users also increase.

Error Count over Virtual Users

This chart shows the distribution of the error count as virtual users increase.

Monitoring Combined Charts Dashboard

This dashboard brings together classic resource monitoring (CPU, IO Kbytes Read/Written, etc.) of hosts and target servers with load-related metrics such as Virtual Users and Send Rate to demonstrate the relationship of front- and back-end metrics.

Monitoring Correlated Charts Dashboard

This dashboard brings together classic resource monitoring (CPU, IO Kbytes Read/Written) of hosts and target servers correlated with Virtual Users.

Event and Status Logs Dashboard

This dashboard provides easy access to crucial composition-status and event information with the ability scroll the entire Event Log into view, which improves readability for longer logs.

Waterfall Dashboard

This dashboard brings together the paired Waterfall chart and Clip Element Hierarchy analysis into a single system Waterfall Dashboard. Bboth widgets must be present if they are to be used in a custom dashboard. Select an item in the Clip Element Hierarchy list to display the load times for various paged clip elements on the right. This dashboard displays the load time based on the selected clip element those pages for the given columns: Domain, URL, Timeline, Sent, and Received.

Attachments

    Outcomes