A practical guide to Testing in DevOps

Table of Contents Preface Background What is DevOps? DevOps and continuous delivery DevOps and Agile DevOps and testing TESTING IN A DEVOPS CULTURE Establishing your context Start with a test strategy retrospective Agile testing assessment DevOps in your organisation Collaboration beyond development Blazing a trail Paths for testing Choose your map Resistance TESTING IN DEVELOPMENT Feedback in development Automation Exploration Test practices in development Deployment pipeline Feature toggles Bug bash Crowdsourced testing TESTING IN PRODUCTION Feedback in production Monitoring and alerting Analytics events Logging Customer feedback Test practices in production A/B testing Beta testing Monitoring as testing Exposure control Canary release Staged rollout Dogfooding Dark launching TESTING IN DEVOPS ENVIRONMENTS Platform evolution Infrastructure as code Configuration management Containers Cloud Test practices for environments Environment management Infrastructure testing Destructive testing INDUSTRY EXAMPLES King: AI in testing Capital One: Hygieia delivery pipeline dashboard The Guardian: Testing in production Bank of New Zealand: A/B testing Etsy: Monitoring as testing Spotify: Using Docker PagerDuty: Failure Fridays TEST STRATEGY IN DEVOPS Risk workshop Rethinking the test pyramid Finding balance in exploration Testing vs Tester Documenting a strategy Conclusion References About the Author