The Wayback Machine - https://web.archive.org/web/20160315023421/http://cloudcomputing.sys-con.com:80/node/3707532

Welcome!

@CloudExpo Authors: Elizabeth White, Liz McMillan, Pat Romanski, SmartBear Blog, Kevin Benedict

Related Topics: Wearables, Microservices Expo, Linux Containers, Containers Expo Blog, @DevOpsSummit

Wearables: Article

Load Testing Defined | @DevOpsSummit #APM #DevOps #Microservices

Includes best practices for load testing web and mobile applications

Whether you're a beginner simply looking to get started or a seasoned vet brushing up on your subject knowledge, this post will serve as a definitive guide on how to perform effective load testing on a web or mobile application.

Load Testing: A performance-related testing process that places simulated demand on software, web or mobile applications in order to measure responses and systems' behavior under both normal and anticipated peak load conditions.

Understanding the Importance and Place of Load Testing in the Software Development Life Cycle
Performance testing
, as a whole, is one of the most important things you can do when building out a web or mobile application. Falling under the umbrella of performance testing, load testing ensures that your application can handle expected and unexpected user loads. By realistically simulating user activity and monitoring infrastructure behavior, you can eliminate most, if not all, of the bottlenecks in your web or mobile applications.

The benefits of load testing are monumental. This process not only allows you to provide users with an excellent application experience, but it also helps you determine how much load an application can handle before it crashes in production, when to add another server, when to reconfigure the network, where code needs to be optimized, etc.

In many cases, load and performance testing are pushed off until the end of a development cycle. While Agile methodologies and Continuous Integration make the case for load testing early and often, a large percentage of organizations continue to place load and performance testing on the backburner which ultimately results in later release dates and delayed features.

Plan on incorporating load testing into your software development lifecycle earlier rather than later to avoid costly performance issues down the line.

When You Should Consider Load Testing
If you haven't been load testing your website or mobile application, you should be aware of a few major red flags that could potentially cause your app to crash, leaving you in an incredibly precarious position.

When your customer base grows
It honestly boils down to how fast your customer base is growing, but if you witness a steady increase in users either accessing your website or mobile app, you'll want to hire a performance tester in-house or invest in a comprehensive load testing tool.

When you purchase mainstream ads
You can't predict when or even if your application will go viral, but if your advertising team is going to air a commercial, run a national print ad, etc. make sure that your application and infrastructure are load tested properly.

When your web or mobile app starts to lag
This is a huge indicator that you need load testing. If your web or mobile application's load time slows down, your servers are probably under a bit of pressure. Address this immediately before disaster strikes. Even if you avoid an application crash, slow performance can do permanent damage to a company's image and leave users seeking out a better experience on competing apps.

When your operations team is busy keeping the website running
If Ops is already adding servers or changing configurations to try to handle your application's user load, it may signify that something's wrong with your code. Until you address the issues with your code, you won't be able to scale properly. Continuously adding more servers to mitigate the problem isn't cost effective or realistic.

Load Testing Best Practices
Load testing, perhaps more than any other type of testing, is one of those processes that you either choose to do well or otherwise risk the ever-important availability and performance of your application.

The biggest mistake most companies make when load testing is focusing on a single number: how many concurrent users their application will support. When this is the case, little effort is put into script development which results in unrealistic tests. Unrealistic tests are worthless as they'll yield little to no accurate information about the performance of your application under load in production.

Load testers should think beyond the concurrent users metric and focus on the factors required to produce the most realistic load testing scenarios, which include:

  • Geographyload testing with the cloud provides for a geographical distribution of simulated users and will allow you to test outside of your firewall.
  • Devices and Browsers: This factor can quickly become a load testing blindspot. Your application may perform in different ways across various devices and browsers. Monitor device/browser software changes and take care to account for any impact on performance.
  • User Behavior: Realistic load tests must include parameterized recordings so that variables are randomized and represent what happens most often for people when they traverse popular paths within your application. For even more realism, use Google Analytics to get a sense of the variability of parameters in actual users.
  • User Paths: Think carefully about the way a user navigates through your application and try to avoid testing only a limited set of paths. Don't overlook smaller components of your web or mobile application which can include infrastructure packages like JMS or other 3rd-party services.
  • Network Behavior: Variations in network latency and bandwidth must be taken into account when performing realistic load testing. Monitor these factors from multiple locations to ensure that they have no real adverse impact on your users.
  • Connection Parameters: Modern web browsers send requests to the server using several simultaneous connections, and as such you'll need to simulate an appropriate number of parallel requests during your tests.

Realistic Load Testing Is Key
Keeping it real is paramount to load testing. With the growing demand for perfection in web and mobile application performance, there is no replacement for realistic load testing. Whether you choose to go at it alone or decide to use a dedicated load testing tool, make sure you're accurately representing end user behavior in your testing scenarios. This will result in better performing applications that will keep you, your managers and your application's users happy and satisfied.

More Stories By Tim Hinds

Tim Hinds is the Product Marketing Manager for NeoLoad at Neotys. He has a background in Agile software development, Scrum, Kanban, Continuous Integration, Continuous Delivery, and Continuous Testing practices.

Previously, Tim was Product Marketing Manager at AccuRev, a company acquired by Micro Focus, where he worked with software configuration management, issue tracking, Agile project management, continuous integration, workflow automation, and distributed version control systems.

@CloudExpo Stories
transform operational efficiency and safety for businesses and communities, especially during critical situations. During these critical events, man-made incidents or natural disasters, identifying and reaching employees with reliable and automated communications can not only protect business assets, but can be the difference between life and death. In his session at @ThingsExpo, Imad Mouline, chief technology officer for Everbridge, will highlight incident communications best practices and ...
SYS-CON Events announced today Object Management Group® has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that DDN Storage has been named “Bronze Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2015 at the Javits Center in New York, New York. DataDirect Networks (DDN) has announced it has continued its leadership as the dominant storage provider of the world’s fastest supercomputers for the seventh consecutive year with storage solutions that power two-thirds of identifiable sites on the most recent TOP500.org rankings list. The Top500 list r...
SYS-CON Events announced today that LeaseWeb USA Inc., one of the world's largest hosting brands, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. LeaseWeb USA Inc. was established in 2011, a separate and distinct operating entity providing services in the USA. LeaseWeb is a trusted partner to mid-market companies, helping them find the right solution to their critical cloud-hosted needs from our global...
SYS-CON Events announced today that HGST, a Western Digital Company, has been named “Bronze Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2015 at the Javits Center in New York, New York. Helping the world harness the power of data, Western Digital Corporation (NASDAQ: WDC), has announced that its HGST Active Archive System has been certified with the FXT 5000 Series Edge Filer family from Avere, a leading provider of cloud file storage infrastructure. The combined st...
SYS-CON Events announced today that Interface Masters Technologies, a leading vendor in the network monitoring and high speed networking markets, will exhibit at the 18th International CloudExpo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, New York, and the 19th International Cloud Expo, which will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. PacketSled and Interface Masters have partnered to offer a complete net...
SYS-CON Events announced today that VAI, a leading ERP software provider, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. VAI (Vormittag Associates, Inc.) has announced that users of its S2K software will be able to share standardized documents electronically through Rocket® TRUedx, developed by Rocket Software, Inc. VAI has been a Rocket partner for more than 20 years and has incorporated a number of ...
SYS-CON Events announced today that iDevices®, the preeminent brand in the connected home industry, will exhibit at SYS-CON's 18th International Cloud Expo® | @ThingsExpo, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. iDevices has announced that it has entered into a definitive agreement to sell the world’s #1 app-enabled grilling and cooking thermometer brands, namely iGrill® and Kitchen Thermometer, to Weber-Stephens Products, LLC. Weber®, the world’s lar...
SYS-CON Events announced today that Men & Mice, the leading global provider of DNS, DHCP and IP address management overlay solutions, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Men & Mice announced the release of Version 7.1 of the Men & Mice Suite. The Men & Mice Suite is a software-based IP Address Management (IPAM) solution, used by many large and growing global enterprises, to establish secur...
SYS-CON Events announced today CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. CrowdReviews.com is the first buyer’s guide that ranks products and services based on client reviews.
SYS-CON Events announced today BZ Media LLC has been named “Media Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. BZ Media LLC is a high-tech media company that produces technical conferences and expositions, and publishes a magazine, newsletters and websites in the software development, SharePoint, mobile development and Commercial Drone markets.
SYS-CON Events announced today that Interoute, owner-operator of one of Europe's largest networks and a global cloud services platform, has been named "Bronze Sponsor" of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2015 at the Javits Center in New York, New York. Interoute has announced that WMG has chosen the Interoute Virtual Data Centre (VDC) zone in Milan to provide the high capacity and low-latency networked cloud solution for its online gaming platform.
SYS-CON Events announced today that Formation Data Systems, a company revolutionizing enterprise storage, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Formation Data Systems enables organizations to realize transformative benefits of modern, software-defined storage to address the challenges faced by customers deploying traditional and modern applications. The revolutionary FormationOne™ Dynamic Sto...
Using new techniques of information modeling, indexing, and processing, new cloud-based systems can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications. In his session at 18th Cloud Expo, John Newton, CTO, Founder and Chairman of Alfresco, will describe how to scale cloud-based content management repositories to store, manage, and retrieve billions of documents and related information with fast and linear scalability. He wi...
SYS-CON Events announced today TMCnet has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Technology Marketing Corporation (TMC) is the world's leading business-to-business and integrated marketing media company, servicing niche markets within the com...
SYS-CON Events announced today that Fusion, a leading provider of cloud services, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Fusion has announced that an East Coast affiliate of a major national non-profit organization has signed a three year agreement with Fusion to migrate its voice communications systems to the cloud. A key reason for the non-profit organization’s selection was Fusion’s ability...
SYS-CON Events announced today that (ISC)²® ("ISC-squared") will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. (ISC)²® and KPMG LLP have announced they will survey federal cybersecurity executives on the state of cybersecurity in the federal government.
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named "Bronze Sponsor" of SYS-CON's 18th International Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault has launched Commvault Clinical Archive to modernize the way health...
As the world moves towards more DevOps and Microservices, application deployment to the cloud ought to become a lot simpler. The Microservices architecture, which is the basis of many new age distributed systems such as OpenStack and NetFlix, is at the heart of Cloud Foundry – a complete developer-oriented Platform as a Service (PaaS) that is IaaS agnostic and supports vCloud, OpenStack and AWS.
SYS-CON Events announced today that Tintri Inc., a leading producer of VM-aware storage (VAS) for virtualization and cloud environments, will exhibit at the 18th International CloudExpo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, New York, and the 19th International Cloud Expo, which will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Tintri Inc. has launched its Tintri Cloud Service Provider Solution. Now it is e...