TL;DR: Optimizing eCommerce sites is a huge endeavor. With these 5 steps, you’ll be able to rapidly identify and resolve your scalability issues:

1. Establish a performance baseline
2. Prioritize pages with highest business impact
3. Create a load test plan with traffic replication (a faster alternative to traffic mirroring)
4. Build a fast feedback loop
5. Analyze reports

5 Steps to Optimizing eCommerce Site Performance with Kubernetes Load Testing

If your site deals with a lot of traffic during the holidays, you need confidence that it can handle high volumes long before Black Friday and end-of-year sales roll around. But improving overall application performance is a challenging and time-consuming undertaking. In this article, we outline 5 key steps to optimize performance of your retail site when time is of the essence.

The 4 Golden Signals

To understand how your application is performing, site reliability engineers (SRE) measure four key metrics, known as the Golden Signals. Whenever possible, these metrics should be measured from the customer’s perspective. This was such a large focus area for us at Speedscale that we designed our product to highlight the Golden Signals directly in our reports:

Step 1: Establish a performance baseline

Before you start designing and running load tests, performance tests, and labs, you need to understand where you are today. By using an observability suite, you can leverage data from your own system to understand the current state of Kubernetes performance and how much you improve.  In addition to the usual suspects in the observability ecosystem, learn more about tools to monitor your cluster in our blog,  Kubernetes Monitoring: Top 5 Tools & Methodologies. Example Dashboard from play.grafana.com

If you can, take into account what the Golden Signals looked like during peak load scenarios, like during a holiday sales rush or big promotion. Having this data can help indicate performance bottlenecks in one of these 3 areas:

• At the client level: Low use of a CDN can indicate a long website load time. These issues are frequently shown in a browser or mobile app with large waterfall charts.
• At the application level:  A report of latency by endpoint can help you understand which URLs in your backend are performing poorly
• At the data level – this includes everything from third-party API calls to databases or other downstream systems that are involved in the business transaction, in particular how much time is spent in the Application vs. Data tier

Step 2: Prioritize pages with high business impact

While overall site performance is important, there are certain pages that have higher business impact (i.e. drives more revenue) than others. While it may be tempting to optimize the slowest pages first, a more strategic approach would be to prioritize the pages that most directly impact revenue. A typical eCommerce website will see the highest amount of traffic on the homepage and promotion pages, lower traffic on product listing and detail pages, and the lowest amount of traffic on a shopping cart or checkout page. Picture this as a funnel: Despite having the lowest amount of traffic, the value of shopping cart and checkout pages is much higher.  Our recommendation is to  prioritize this funnel in reverse order, starting with the highest value pages. The thinking behind this is that you want to ensure that kubernetes performance is optimized and all problems are addressed for the customers that are actually buying products from your store.

Step 3: Create a load test automation plan with traffic replication

Starting with the highest business impact pages, focus on the subset of endpoints related to the business transaction and the downstream dependencies. If you are not sure which endpoints are called and what components are downstream, now is a good time to dig into traffic replication. This approach leverages traffic data from your site to understand how it’s actually used by customers in order to pave the way for continuous performance testing.

Gathering this data will create a snapshot which includes:

• The endpoints that are part of a business transaction (e.g. cart, checkout, Thank You page, etc.)
• The downstream systems that are part of the transaction (e.g. payment processing, shipping, user validation, etc.)
• The data that’s required in order to run accurate tests (e.g. SKUs, prices, customer records, etc.)

Example Traffic Viewer from Speedscale

Traffic replication leverages traffic data from your site to understand how it’s actually used by customers in order to inform your load test plan.

If you’re using a traffic replication platform like Speedscale, simply save this data into a snapshot, and you’re ready to start running tests. If you’re not using traffic replay yet, make sure to give yourself plenty of time to write tons of scripts using your favorite Kubernetes Load Testing tool. If you depend on a large number of downstream systems, definitely allocate some time to write Service Mocks so you can isolate your app from systems that are outside of your control.

Step 4: Build a fast feedback loop

Once you have the traffic to replicate, you need to create the fastest feedback loop possible. This is a typical engineering approach that requires four steps done in rapid succession:

1. Run a test
2. Measure the result
3. Decide what you want to change
4. Run the test again

If this entire process takes your organization days or weeks, you will be severely limited in how many performance improvements you can make.