Integrating CloudTest Performance Tests in Visual Studio Team Services

Document created by B-F-F08DRX Employee on Jul 19, 2017
Version 1Show Document
  • View in full screen mode

In response to customer demand, Microsoft and SOASTA partnered to provide load and performance testing integration into Visual Studio Team Services (formerly Visual Studio Online). Now you can execute performance tests as part of every build and use those same tests in production performance testing at scale in Microsoft Azure cloud and beyond.


Load and performance testing is often done just in time for a major event. Retailers, financial, media, and other companies use SOASTA CloudTest to ensure that their sites will perform when customers need them. These include the holiday shopping season with Black Friday and Cyber Monday, or when their commercial airs during a major sporting event like World Cup or the Super Bowl. For other customers, it’s during the news-heavy elections season. Or every Friday when people want to check that their payroll transactions are correct and deposited at their bank. Whenever your customers demand, your site needs to be ready.



CloudTest integration is now available in the Visual Studio Team Services marketplace.



CloudTest in Visual Studio Team Services marketplace

Now you can execute performance and load tests in CloudTest from build to production with integration with your projects hosts in Visual Studio Team Services. CloudTest provides almost unlimited load generation from Microsoft Azure cloud as well as the other 20+ CloudTest partners. Tests can be run from development at low levels to major load in production to validate that customer scale load will not affect performance.


How to get started using CloudTest from Visual Studio Team Services

Browse to SOASTA CloudTest in the VSTS Marketplace.



Click Install to add CloudTest to your VSTS environment:


Select an account where you want to install the extension:

And confirm to start the installation:

If all goes well, you’ll see the “You are good to go!” dialog.


If you have a CloudTest instance already, just choose Close now. If you need to set up CloudTest, you can click “Get started” to go to and set up your free CloudTest instance.


Open your Team Services project and go to the BUILD tab:



Press “+ Add build step”, choose “Test” and find CloudTest and press “Add”, then “Close”:



This will add a new step for CloudTest to your build steps:



You need to set up a connection to your CloudTest instance by clicking the Manage link:



Click “+ New Service Endpoint”, choose a Generic Connection, and enter your CloudTest credentials:



The Server URL should match the URL you use for CloudTest. You should see a new endpoint created:



Go back to your VSTS project and refresh the connection list and choose your new endpoint, and enter a test composition name, and enable Continue on error and Always run:



Press Save to save your settings and enter a Name for this test, and a comment if you like:


This is all you need to run a CloudTest test composition from Visual Studio Team Services.


If you’d like to learn about setting up CloudTest to run on an Azure Virtual Machine, visit the Azure Marketplace: or