The Wayback Machine - https://web.archive.org/web/20160816090721/http://php.sys-con.com/node/3707532

Welcome!

PHP Authors: Liz McMillan, Carmen Gonzalez, Hovhannes Avoyan, Lori MacVittie, Trevor Parsons

Related Topics: @DevOpsSummit, Microservices Expo, Linux Containers, Containers Expo Blog

@DevOpsSummit: Article

Load Testing Defined | @DevOpsSummit #APM #DevOps #Microservices

Includes best practices for load testing web and mobile applications

Whether you're a beginner simply looking to get started or a seasoned vet brushing up on your subject knowledge, this post will serve as a definitive guide on how to perform effective load testing on a web or mobile application.

Load Testing: A performance-related testing process that places simulated demand on software, web or mobile applications in order to measure responses and systems' behavior under both normal and anticipated peak load conditions.

Understanding the Importance and Place of Load Testing in the Software Development Life Cycle
Performance testing
, as a whole, is one of the most important things you can do when building out a web or mobile application. Falling under the umbrella of performance testing, load testing ensures that your application can handle expected and unexpected user loads. By realistically simulating user activity and monitoring infrastructure behavior, you can eliminate most, if not all, of the bottlenecks in your web or mobile applications.

The benefits of load testing are monumental. This process not only allows you to provide users with an excellent application experience, but it also helps you determine how much load an application can handle before it crashes in production, when to add another server, when to reconfigure the network, where code needs to be optimized, etc.

In many cases, load and performance testing are pushed off until the end of a development cycle. While Agile methodologies and Continuous Integration make the case for load testing early and often, a large percentage of organizations continue to place load and performance testing on the backburner which ultimately results in later release dates and delayed features.

Plan on incorporating load testing into your software development lifecycle earlier rather than later to avoid costly performance issues down the line.

When You Should Consider Load Testing
If you haven't been load testing your website or mobile application, you should be aware of a few major red flags that could potentially cause your app to crash, leaving you in an incredibly precarious position.

When your customer base grows
It honestly boils down to how fast your customer base is growing, but if you witness a steady increase in users either accessing your website or mobile app, you'll want to hire a performance tester in-house or invest in a comprehensive load testing tool.

When you purchase mainstream ads
You can't predict when or even if your application will go viral, but if your advertising team is going to air a commercial, run a national print ad, etc. make sure that your application and infrastructure are load tested properly.

When your web or mobile app starts to lag
This is a huge indicator that you need load testing. If your web or mobile application's load time slows down, your servers are probably under a bit of pressure. Address this immediately before disaster strikes. Even if you avoid an application crash, slow performance can do permanent damage to a company's image and leave users seeking out a better experience on competing apps.

When your operations team is busy keeping the website running
If Ops is already adding servers or changing configurations to try to handle your application's user load, it may signify that something's wrong with your code. Until you address the issues with your code, you won't be able to scale properly. Continuously adding more servers to mitigate the problem isn't cost effective or realistic.

Load Testing Best Practices
Load testing, perhaps more than any other type of testing, is one of those processes that you either choose to do well or otherwise risk the ever-important availability and performance of your application.

The biggest mistake most companies make when load testing is focusing on a single number: how many concurrent users their application will support. When this is the case, little effort is put into script development which results in unrealistic tests. Unrealistic tests are worthless as they'll yield little to no accurate information about the performance of your application under load in production.

Load testers should think beyond the concurrent users metric and focus on the factors required to produce the most realistic load testing scenarios, which include:

  • Geographyload testing with the cloud provides for a geographical distribution of simulated users and will allow you to test outside of your firewall.
  • Devices and Browsers: This factor can quickly become a load testing blindspot. Your application may perform in different ways across various devices and browsers. Monitor device/browser software changes and take care to account for any impact on performance.
  • User Behavior: Realistic load tests must include parameterized recordings so that variables are randomized and represent what happens most often for people when they traverse popular paths within your application. For even more realism, use Google Analytics to get a sense of the variability of parameters in actual users.
  • User Paths: Think carefully about the way a user navigates through your application and try to avoid testing only a limited set of paths. Don't overlook smaller components of your web or mobile application which can include infrastructure packages like JMS or other 3rd-party services.
  • Network Behavior: Variations in network latency and bandwidth must be taken into account when performing realistic load testing. Monitor these factors from multiple locations to ensure that they have no real adverse impact on your users.
  • Connection Parameters: Modern web browsers send requests to the server using several simultaneous connections, and as such you'll need to simulate an appropriate number of parallel requests during your tests.

Realistic Load Testing Is Key
Keeping it real is paramount to load testing. With the growing demand for perfection in web and mobile application performance, there is no replacement for realistic load testing. Whether you choose to go at it alone or decide to use a dedicated load testing tool, make sure you're accurately representing end user behavior in your testing scenarios. This will result in better performing applications that will keep you, your managers and your application's users happy and satisfied.

More Stories By Tim Hinds

Tim Hinds is the Product Marketing Manager for NeoLoad at Neotys. He has a background in Agile software development, Scrum, Kanban, Continuous Integration, Continuous Delivery, and Continuous Testing practices.

Previously, Tim was Product Marketing Manager at AccuRev, a company acquired by Micro Focus, where he worked with software configuration management, issue tracking, Agile project management, continuous integration, workflow automation, and distributed version control systems.

@ThingsExpo Stories
For basic one-to-one voice or video calling solutions, WebRTC has proven to be a very powerful technology. Although WebRTC’s core functionality is to provide secure, real-time p2p media streaming, leveraging native platform features and server-side components brings up new communication capabilities for web and native mobile applications, allowing for advanced multi-user use cases such as video broadcasting, conferencing, and media recording.
Amazon has gradually rolled out parts of its IoT offerings in the last year, but these are just the tip of the iceberg. In addition to optimizing their back-end AWS offerings, Amazon is laying the ground work to be a major force in IoT – especially in the connected home and office. Amazon is extending its reach by building on its dominant Cloud IoT platform, its Dash Button strategy, recently announced Replenishment Services, the Echo/Alexa voice recognition control platform, the 6-7 strategic...
We all know the latest numbers: Gartner, Inc. forecasts that 6.4 billion connected things will be in use worldwide in 2016, up 30 percent from last year, and will reach 20.8 billion by 2020. We're rapidly approaching a data production of 40 zettabytes a day – more than we can every physically store, and exabytes and yottabytes are just around the corner. For many that’s a good sign, as data has been proven to equal money – IF it’s ingested, integrated, and analyzed fast enough. Without real-ti...
I wanted to gather all of my Internet of Things (IOT) blogs into a single blog (that I could later use with my University of San Francisco (USF) Big Data “MBA” course). However as I started to pull these blogs together, I realized that my IOT discussion lacked a vision; it lacked an end point towards which an organization could drive their IOT envisioning, proof of value, app dev, data engineering and data science efforts. And I think that the IOT end point is really quite simple…
WebRTC is bringing significant change to the communications landscape that will bridge the worlds of web and telephony, making the Internet the new standard for communications. Cloud9 took the road less traveled and used WebRTC to create a downloadable enterprise-grade communications platform that is changing the communication dynamic in the financial sector. In his session at @ThingsExpo, Leo Papadopoulos, CTO of Cloud9, discussed the importance of WebRTC and how it enables companies to focus...
"We've discovered that after shows 80% if leads that people get, 80% of the conversations end up on the show floor, meaning people forget about it, people forget who they talk to, people forget that there are actual business opportunities to be had here so we try to help out and keep the conversations going," explained Jeff Mesnik, Founder and President of ContentMX, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, will discuss the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
The emerging Internet of Everything creates tremendous new opportunities for customer engagement and business model innovation. However, enterprises must overcome a number of critical challenges to bring these new solutions to market. In his session at @ThingsExpo, Michael Martin, CTO/CIO at nfrastructure, outlined these key challenges and recommended approaches for overcoming them to achieve speed and agility in the design, development and implementation of Internet of Everything solutions wi...
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devices - comp...
Ixia has announced that the company’s ThreatARMOR™ solution, a key component of Ixia’s Security Fabric™, adds Zero-Day Malware Immunity™ (ZDMI), which blocks mutated versions of malware that use sophisticated obfuscation techniques to evade detection by signature-based security engines. The Ixia Security Fabric provides robust resilience, context-aware intelligent data handling, and security intelligence, ensuring the right data gets to the right tools every time even when encrypted, and enhanci...
Manufacturers are embracing the Industrial Internet the same way consumers are leveraging Fitbits – to improve overall health and wellness. Both can provide consistent measurement, visibility, and suggest performance improvements customized to help reach goals. Fitbit users can view real-time data and make adjustments to increase their activity. In his session at @ThingsExpo, Mark Bernardo Professional Services Leader, Americas, at GE Digital, discussed how leveraging the Industrial Internet a...
In today's uber-connected, consumer-centric, cloud-enabled, insights-driven, multi-device, global world, the focus of solutions has shifted from the product that is sold to the person who is buying the product or service. Enterprises have rebranded their business around the consumers of their products. The buyer is the person and the focus is not on the offering. The person is connected through multiple devices, wearables, at home, on the road, and in multiple locations, sometimes simultaneously...
The IETF draft standard for M2M certificates is a security solution specifically designed for the demanding needs of IoT/M2M applications. In his session at @ThingsExpo, Brian Romansky, VP of Strategic Technology at TrustPoint Innovation, explained how M2M certificates can efficiently enable confidentiality, integrity, and authenticity on highly constrained devices.
With so much going on in this space you could be forgiven for thinking you were always working with yesterday’s technologies. So much change, so quickly. What do you do if you have to build a solution from the ground up that is expected to live in the field for at least 5-10 years? This is the challenge we faced when we looked to refresh our existing 10-year-old custom hardware stack to measure the fullness of trash cans and compactors.
The IoT is changing the way enterprises conduct business. In his session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, discussed how businesses can gain an edge over competitors by empowering consumers to take control through IoT. He cited examples such as a Washington, D.C.-based sports club that leveraged IoT and the cloud to develop a comprehensive booking system. He also highlighted how IoT can revitalize and restore outdated business models, making them profitable ...
Personalization has long been the holy grail of marketing. Simply stated, communicate the most relevant offer to the right person and you will increase sales. To achieve this, you must understand the individual. Consequently, digital marketers developed many ways to gather and leverage customer information to deliver targeted experiences. In his session at @ThingsExpo, Lou Casal, Founder and Principal Consultant at Practicala, discussed how the Internet of Things (IoT) has accelerated our abil...
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effi...