Awesome
<p align="center"> <img src="assets/images/howtheyloadtest_banner.svg" alt="howtheyloadtest banner" width="300px"> </p>How They Load Test
A curated collection of publicly available resources on how technology and tech-savvy organizations around the world plan/organize/perform/analyze load testing and related acitivities for their products.
Introduction
Inspired by howtheytest, How They Load Test is a curated knowledge collection on different aspects of performance engineering, foremost, performance and load testing and related topics, by leading technology companies around the world.
Topics
- Application Performance Management
- Architecture
- Automation
- Benchmarking
- Capacity Planning
- CI/CD
- Incidents
- Monitoring, Observability, Alerting
- Non-Functional Requirements Elicitation and Analysis
- Performance Engineering
- Scalability
- Test Environments
- Testing in Production
- Tools
Organizations
<details> <summary>Ably</summary>In alphabetical order.
Blogs & Articles
Tools
- ably-boomer - Ably load generator for Locust, based on the boomer library.
- ably-locust - A JavaScript load generator for Locust.
Blogs & Articles
Talks
- How much pressure can your app handle - Performance testing with Ruby - Nancy Cai @ RubyConf 2020
Talks
- UI, Load and Performance testing at Amazon - Leo Zhadanovsky, Dave Mozealous @ AWS re:Invent 2014
- Best Practices for Benchmarking and Performance Analysis in the Cloud - Robert Barnes @ AWS re:Invent 2013
- Large Scale Load Testing Amazon.com's Traffic on AWS - Carlos Arguelles @ AWS re:Invent 2013
Blogs & Articles
Tools
- Jira Performance Tests (JPT)
- Atlassian Performance Testing Framework
- Atlassian Data Center App Performance Toolkit
Blogs & Articles
</details> <details> <summary>Cloud Posse</summary>Tools
- Load Testing Stack - A collection of best practices, workflows, scripts and scenarios used for load and performance testing.
Blogs & Articles
- How to receive a million packets per second - 2015
- Optimizing Your Linux Stack for Maximum Mobile Web Performance - 2012
Blogs & Articles
</details> <details> <summary>Confluent</summary>Talks
- Ducktape: Keeping System Testing Simple in a Distributed World - Ian McDonald @ Current 2022
Tools
- ducktape - Distributed system integration and performance testing library.
Blogs & Articles
</details> <details> <summary>Disney+ Hotstar</summary>Blogs & Articles
Talks
- Real-time messaging service at Hotstar - Piyush Gupta @ RootConf 2020
- Scaling Hotstar.com for 25 million concurrent viewers - Gaurav Kamboj @ AWS re:Invent 2019
Blogs & Articles
- How we fixed a Node.js memory leak by using ShadowReader to replay production traffic into QA - 2018
Talks
- ShadowReader - Serverless load tests for replaying production traffic - Yuki Sawa @ SCaLE 17x 2019
Tools
- ShadowReader - Serverless load testing tool for replaying website traffic by collecting traffic patterns from access logs, powered by AWS Lambda, S3 and ELB.
Blogs & Articles
Talks
- Seven Golden Rules for Benchmarking Elasticsearch - Daniel Mitterdorfer @ JDK IO 2018
- Benchmarking Elasticsearch with Rally - Daniel Mitterdorfer @ Search Meetup Munich 2016
Tools
- Rally - Macrobenchmarking framework for Elasticsearch.
Blogs & Articles
</details> <details> <summary>Fitbit</summary>Blogs & Articles
</details> <details> <summary>Flashphoner</summary>Blogs & Articles
- Turning RTSP into WebRTC: how many cameras will the server withstand? - 2021
- Load test of WebRTC recording on AWS - 2021
- WebRTC face to face video chat. Load test - 2021
- Load testing for WebRTC mixer - 2021
- Using a headless browser for WebRTC load tests - 2021
- Choosing a server for 1000 WebRTC streams - 2021
Talks
- Load testing with F1 - Adelina Simion & Andy Kuszyk @ Conf42 Golang 2022
Tools
- f1 - A flexible load testing framework using the Go language for test scenarios.
Blogs & Articles
- The next step in performance testing? The GitLab Environment Toolkit - 2021
- How our QA team leverages GitLab’s performance testing tool (and you can too) - 2020
Tools
</details> <details> <summary>GovTech Edu</summary>Blogs & Articles
- Elevating Tech Reliability at Scale: How We Build Dependable Daily Performance Testing Platform - 2023
- Unleashing Testing at Scale: How GovTech Edu Built a 200K RPS Load Testing Platform - 2023
Blogs & Articles
Tools
</details> <details> <summary>HelloFresh</summary>Blogs & Articles
Tools
</details> <details> <summary>Helpshift</summary>Blogs & Articles
- How to benchmark a Kafka consumer that makes async HTTP requests - 2019
- Load Testing using Tsung - 2014
Blogs & Articles
- Eliminating toil with fully automated load testing - 2019
- TrafficShift: Load Testing at Scale - 2017
Talks
- Testing in production at LinkedIn - Szczepan Faber @ Devoxx Poland 2018
Blogs & Articles
Tools
- ripley - HTTP traffic replay tool at multiples of the original rate.
Blogs & Articles
</details> <details> <summary>Mattermost</summary>Blogs & Articles
- Improving performance (and more) through load testing - 2020
- Mattermost recipe: Using Google Lighthouse and ChatOps for website auditing and performance tracking - 2020
- Performance at Scale with Mattermost - 2018
Blogs & Articles
</details> <details> <summary>Meetecho</summary>Talks
- Load Testing of SIP and WebRTC Infrastructures - Lorenzo Miniero @ Kamailio World 2017
- Jattack WebRTC Load Testing tool - Simon Romano @ IIT RTC Conference 2016
Blogs & Articles
</details> <details> <summary>Miro</summary>Blogs & Articles
- Managing hundreds of servers for load testing: autoscaling, custom monitoring, DevOps culture - 2020
- Reliable load testing with regards to unexpected nuances - 2020
Blogs & Articles
Talks
- Scaling for the Known Unknown - Suhail Patel @ QCon London 2019
Blogs & Articles
- Load Testing at Mozilla - 2017
Talks
- Load testing web services at Mozilla with Molotov - Tarek Ziade @ FOSDEM 2018
Tools
- Feuerwerk - A tool designed to run load tests in Docker containers using Google Kubernetes Engine.
- Raptor - A performance testing framework for running browser pageload and browser benchmark tests.
Blogs & Articles
- Fixing Performance Regressions Before they Happen - 2022
- Manufactured Chaos: How Netflix Does Performance Testing - 2018
- Performance Under Load - 2018
- A Netflix Web Performance Case Study - 2018
- Load Testing at Netflix: Virtual Interview with Coburn Watson - 2014
- JMeter Plugin for Cassandra - 2012
Talks
- How Netflix Tunes Amazon EC2 Instances for Performance - Brendan Gregg @ AWS re:Invent 2017
- Honest Performance Testing with NDBench - Vinay Chella @ Cassandra Summit 2016
- Performance Tuning Amazon EC2 Instances - Brendan Gregg @ AWS re:Invent 2014
Tools
- Chaos Monkey - A resiliency tool that helps applications tolerate random instance failures.
- NDBench - Netflix Data Benchmark, a pluggable cloud-enabled benchmarking tool that can be used across any data store system.
Blogs & Articles
</details> <details> <summary>Outbrain</summary>Talks
- Hold My Beer - Load Testing. In Production. On Autopilot - Slava Antonenko @ USENIX SREcon 2023 APAC
Blogs & Articles
- Pinterest Druid Holiday Load Testing - 2021
- Distributed tracing at Pinterest with new open source tools - 2017
Talks
- Evolution of Observability Tools at Pinterest - Naoman Abbas @ USENIX SREcon 2019
Tools
- Bender - An easy-to-use library for creating load testing applications.
- JBender - A port of Bender to the JVM platform with Quasar lightweight threads (fibers) and channels.
Blogs & Articles
- Redis Labs Performance Testing with Live Traffic - 2014
- memtier_benchmark: A High-Throughput Benchmarking Tool for Redis & Memcached - 2013
Talks
- End-To-End Performance Testing, Profiling, and Analysis at Redis - Filipe Oliveira @ P99 CONF 2022
- How to benchmark Redis - Or Shwartz, Filipe Oliveira @ RedisConf 2021
Tools
- memtier_benchmark - NoSQL Redis and Memcache traffic generation and benchmarking tool.
- redis-benchmark-go - Redis benchmark utility in Go.
Blogs & Articles
</details> <details> <summary>Robinhood</summary>Blogs & Articles
</details> <details> <summary>Salesforce</summary>Blogs & Articles
- How to Scale Test on Salesforce - 2021
- The Importance of Data Quality & Quantity for Performance and Scale Testing - 2021
- How to Continuously Profile Tens of Thousands of Production Servers - 2020
- Performance Testing on the Lightning Platform - 2020
- Introduction to Performance Testing - 2020
Blogs & Articles
- Resiliency Planning for High-Traffic Events - 2020
- Capacity Planning at Scale - 2020
- Pummelling the Platform–Performance Testing Shopify - 2020
Tools
- Genghis - An in-house load generation tool using Lua VM in Go as core execution engine.
Blogs & Articles
- Continuous Load Testing: Building a culture of performance with Koi Pond - 2022
- Load Testing with Koi Pond: How Slack models and tests with incredibly large groups of users - 2021
- Preparing for Huge Waves of Traffic via Load Testing - 2019
Talks
- Better Integration Tests for Performance Monitoring - Maude Lemaire @ Strange Loop Conference 2019
- Mobile performance testing at Slack. How to Build a Performance Test Pipeline from Scratch - Valera Zakharov @ DevFest Ukraine 2018
Blogs & Articles
Tools
- Lighthouse Audit Service - A service meant to help you run, schedule, store, and monitor Lighthouse reports over time.
Blogs & Articles
Talks
- How Supabase does performance benchmarking using k6 - Egor Romanov @ k6 Office Hours 2023
Tools
- supabench - Platform to run and keep the history of benchmark runs.
Blogs & Articles
</details> <details> <summary>Twitter</summary>Talks
- Testing Systems at Scale @Twitter - James Waldrop @ GTAC 2013
Tools
- iago/iago2 - A load generator, built for engineers.
- rpc-perf - A tool for benchmarking RPC services.
Blogs & Articles
- Introducing Shadower: A Minimalistic Load Testing Tool - 2022
- Introducing Ballast: An Adaptive Load Test Framework - 2022
- Introducing QALM, Uber’s QoS Load Management Framework - 2018
- Reliability at Scale: Engineering an Uneventful New Year's Eve - 2017
Talks
- Testing in Production at Scale - Amit Gud @ USENIX SREcon 2019
Blogs & Articles
- Monitoring benchmark: how to generate 100 million samples/s of production-like data - 2023
- Grafana Mimir and VictoriaMetrics: performance tests - 2022
- Benchmarking Prometheus-compatible time series databases - 2022
Talks
- VictoriaMetrics: scaling to 100 million metrics per second - Aliaksandr Valialkin @ OSMC 2022
Tools
- prometheus-benchmark - Benchmark for Prometheus-compatible systems.
Blogs & Articles
- Performance Testing a data pipeline at scale - 2020
- Overcoming the Challenges of Performance Testing Single-page Apps - 2015
Blogs & Articles
</details> <details> <summary>Wix</summary>Blogs & Articles
Talks
- Testing for Performance - Dan Shappir @ Wix Engineering Tech Talks 2019
- Improving Load Time for 100 Million Websites - Dan Shappir @ Wix Engineering Tech Talks 2019
Blogs & Articles
- Building an end-to-end load test automation system on top of Kubernetes - 2021
- How Zalando prepares for Cyber Week - 2020
- End-to-end load testing Zalando's production website - 2019
- End-to-end latency challenges for microservices - 2016
Talks
- Load Testing in the Microservices World - Arjun Naik @ LeaseWeb Tech Summit Berlin 2016
Tools
- docker-locust - A ready and easy-to-use version of locust which also contains additional/useful features that are required.
- transformer - A command-line tool and Python library to transform/convert web browser sessions (HAR files) into locust load testing scenarios (locustfile).
- typhoon - A stress and load testing tool for distributed systems that simulates traffic from a test cluster toward a system-under-test and visualizes infrastructure-, protocol- and application-related latencies.
- zelt - Zalando End-to-end Load Tester, a command-line tool for orchestrating the deployment of locust in Kubernetes.
Blogs & Articles
- Distributed load testing with Kubernetes and Predator - 2020
- Optimizing Node.js Performance in Microservice Architecture - 2019
- The Rise of Predator - 2019
Tools
- Predator - A distributed open-source platform for load testing APIs using artillery as load testing engine.
Credits
- Inspired by How They Test from Abhijeet Vaikar.
- Banner cartoon vector by vectorjuice from freepik.com.
Other How They... collections
Contributors
<a href="https://github.com/aliesbelik/how-they-load/graphs/contributors"> <img src="https://contrib.rocks/image?repo=aliesbelik/how-they-load" alt="contributors"> </a>Contribute
Contributions are welcome!<br> Read the CONTRIBUTING guidelines first.