Master Apache JMeter : from load testing to DevOps : master performance testing with JMeter

Cover FM Copyright Table of Contents Preface Chapter 1: Quick Start with JMeter Our Process Setup JMeter to Record Our Browsing Session Configure Your Browser Save Our Script Validate Our Script with Only One User Setup Our Load Test and Launch It Run Our Load Test and Analyze It Chapter 2: JMeter Overview JMeter Overview Types of Load Tests Supported Supported Test Protocols Reporting Chapter 3: Designing a Test Case Introduction Warning Type of Load Test Performance/Load Test Stress Test Soak/Endurance Test Failover/Resilience Test Spike Test Other Load Model Concurrency User (Closed Model) Throughput (Open Model) Arrivals Rate (Open Model) Structure of a Test Case Ramp-Up Plateau/Step Ramp-Down Example: Step Load Test Identify Critical Business Scenarios to Script Frequent Vital Risky How Many Virtual Users Do I Need? Parameters to Take into Account when Creating a Scenario Vary User Input Reuse the Same Values Vary the Types of Users Vary and Adjust Think Times Adjust the Ramp-Up Time Adjust the Test Duration Error Handling User Connection Type Size of the Scenarios Meeting Point/Rendezvous Cookie Management Cache Management Conclusion Chapter 4: Important Concepts in JMeter Scoping Elements' Execution Order How Timer Scope Works Rule 1: Timers Are Executed before Each Sampler in Their Scope Rule 2: If There Is More Than One Timer in the Scope, All the Timers Will Be Processed before the Sampler Controlling the Execution Order of Timers How Assertion Scope Works Rule 1: Assertions Are Executed after Each Sampler in Their Scope or to Parent Samplers Rule 2: Failed Assertions Cause the Failure of the Entire Transaction Controller Rule 3: Assertions Can Validate the Main Sample and/or the Sub-Samples Rule 4: Be Careful with Low-Performing Assertions Our Advice How Properties Differ from Variables How Properties Are Created How Variables Are Created How ${} Differs from ${_P} Chapter 5: Preparing the Test Environment (Injectors and Tested Systems) Introduction Setting Up the Injectors Never Host Injectors on the Same Server as the Tested System Calibrating Your Test Monitoring Injectors IP Spoofing Using the Latest Version JMeter Memory Configuration Avoiding Load Testing behind a Proxy Preparation of the System under Test A Testing Environment An Environment Consistent with the Target Datasets Take into Account Calls to Third-Party Services Disabling Protection Systems Using Isolated Environments License Management Monitoring Conclusion Chapter 6: Being Productive with JMeter Introduction Good Practices When Recording a Script Use the HTTP(S) Test Script Recorder Element BlazeMeter Chrome Extension Pre-Populating HTTP Request Defaults before Recording the Script Use Tools / Import from cURL Static Resources Using Timeouts Applying a Naming Convention to Transactions/Requests Global Assertion Reusing Script Parts Recording an HTTPS website Keyboard Shortcuts Debugging a script Using View Results Tree Capturing Errors Debug Sampler jp@gc - Dummy Sampler Log Viewer BlazeMeter's Step-by-Step Debugger The Old-Fashioned Way in the Console Using a Third-Party Tool Finalizing a Script Changing the Name of a Transaction According to a Parameter Sharing an Object between Different Thread Groups Getting the Most out of CSV Files Marking a Response as an Error Using a Regular Expression Extractor on Content with Spaces and Multiple Lines Executing an Action Based on the Status of the Previous One Adding Headers to Our HTTP Requests Waiting with While Controller The Right Extractor at the Right Time Handle Cookies Conclusion Chapter 7: Load Testing a Website A Bit of Theory Setup with JMeter Methodology Put into Practice with JMeter Example 1: Simulate Realistic Load Example 2: Technical Tests with Byteman Example 3: Technical Tests with JProfiler Example 4: Tricking CAPTCHAs with a Java Request Conclusion Chapter 8: Load Testing Web Services A Few Concepts REST (REpresentational State Transfer) Web Services WS-\* Web Services Setup with JMeter Methodology Practice with JMeter SOAP/XML-RPC Web Services REST Web Service: Discussion Forum REST Web Service: Customer Database Conclusion Chapter 9: Load Testinga Database Server A Bit of Theory Methodology Setup with JMeter Putting Theory into Practice with JMeter Example 1: Load Test of a Database Example 2: Studying the Impact of Indexes on Performance Example 3: ETL Conclusion Chapter 10: Load TestingMessage-Oriented Middleware (MOM) via JMS A Bit of Theory Asynchronous Messages Decoupling Back Pressure Communication Models What is a Message Composed of? Setup with JMeter Installing the MOM libraries The JMS Point-to-Point Element JMS Resources and JNDI Properties Publish/Subscribe Methodology Putting It into Practice with JMeter Example 1: Testing the Configuration of an MOM server with Point-to-Point Messaging Example 2: Testing the Performance of Our Consumer with JMS Publish/Subscribe Example 3: Testing the Configuration of an MOM Server with Publish/Subscribe Example 4: Testing Any MOM Conclusion Chapter 11: Performinga Load Test Introduction Methodology Testing Your Script with the Graphical User Interface Running Your Test from the Command Line Running Your Test on the Command Line with Taurus Running Your Test from Apache Maven Running Your Test from Jenkins Running Your Test from Apache Ant Best Practices Have Well-Prepared Injectors Generating Reports at the End of the Test Chapter 12: Visualizing and Analyzing the Load Testing Results Introduction Visualizing the Results with Listeners View Results Tree Summary Report Aggregate Report Backend Listener Report Dashboard Particularities of the Visualization of Results a Distributed Load Test before JMeter 5.0 Visualizing the Results with Third Party Visualizing Tools Visualizing the Results with PaaS Load Testing tools Redline13 BlazeMeter Some Tips to Read the Results Prefer Percentiles over Average Be Careful with Downsampling and Data Retention Be Careful with Metric Definition Be Careful with Response Time at the Beginning of the Load Test Don't Rely on the Metrics of a Short Load Test Check Response Time Distribution Some Tips to Present the Results Don't Average Percentiles Define the Number of Metrics to Display in a Time Series Line Graph Define the Resolution/Granularity of the Measures Don't Forget to Add Labels, Legends, and Units in Graphs Axis Forced 0 Don't Use Pie Charts Prefer Bar Graphs When We Have Sparse Metrics Present Errors with Toplist Time Series Graphs and Single-Value Summaries Conclusion Chapter 13: Integration of JMeter in the DevOpsTool Chain Introduction Organization/Team Topology Load Testing Team in Its Ivory Tower DevOps and Load Test Team Collaboration One Performance Tester Integrated on DevOps Team No Performance Tester Team of Evangelists Performance Testers Setting Up Shift-Left Strategy Modification in JMeter Script to Implement Shift-Left Strategy Integrating JMeter in Our Software Factory Example 1: Integrating with Jenkins Using Maven Example 2: Enhancing Integration with Jenkins Using Performance Plugin Automation Example 3: Non-Regression Testing of Memory Consumption with EJ JProfiler Example 4: Detecting a Memory Leak during an Endurance Test with EJ JProfiler Example 5: Retrieving SQL Queries Executed during a Load Test with YourKit Java Profiler Example 6: Analysis of the Garbage Collector (GC) Log File with GCViewer Example 7: Non-Regression Testing of Web APIs with Dynatrace AppMon Conclusion Index Learn how to get the most out of JMeter, improve the productivity of your apps, and integrate JMeter with your Agile and DevOps processes. Key Features Gain insights into preparing test environments and selecting the correct use cases to load test Learn to analyze a load test with Backend Listener, HTML Report Dashboard, and View Results Tree Explore how to integrate JMeter in the software factory Book Description Load tests help identify the maximum number of requests a software system can handle. One popular open source tool for load testing is JMeter. By leveraging the features and capabilities of JMeter, you can perform extensive load testing and fix issues in your application before they become problematic. This book is written by JMeter developers and begins by discussing the whole process, including recording a script, setting it up, and launching it, enabling you to almost immediately start load testing. You'll learn the best practices that you must follow while designing test cases. You'll also explore the different protocols offered by JMeter through various real-world examples. Finally, you'll see how to integrate JMeter into the DevOps approach and create professional reports. You'll discover ways to use the eco-system of JMeter to integrate new protocols, enrich its monitoring, and leverage its power through the use of the cloud. By the end of this book, you'll know all that's needed to perform comprehensive load testing on your applications by using all the best practices and features of JMeter. What you will learn Explore various JMeter concepts, including Timers scope and Assertions scope Discover the types of test protocols and load tests that JMeter supports Design a realistic test scenario using various tips and best practices Prepare your test environment with injectors and the system under test Learn and apply good practices when recording a script Integrate JMeter with Jenkins using Maven Who this book is for This book contains all the valuable information you need in one place and is a must for everybody who is seriously working with JMeter. It might be a little condensed for absolute beginners, but this book is the best you can find if you already have some performance testing experience and want to get further. In particular, it would be invaluable to developers who want to expand their JMeter knowledge into advanced topics or switch to JMeter from other load testing tools This book is your one-stop solution to mastering performance testing using JMeter. It takes you through the basics of working with JMeter, then goes on to explain the advanced aspects of JMeter and performance testing in general. The book ends by talking about the complete integration of JMeter into DevOps.