دام‌های رایج در سیستم و تست نرم‌افزار: چگونه از آن‌ها جلوگیری و آن‌ها را کاهش دهیم

""Don's book is a very good addition both to the testing literature and to the literature on quality assurance and software engineering... . [It] is likely to become a standard for test training as well as a good reference for professional testers and developers. I would also recommend this book as background material for negotiating outsourced software contracts. I often work as an expert witness in litigation for software with very poor quality, and this book might well reduce or eliminate these lawsuits...."" -Capers Jones, VP and CTO, Namcook Analytics LLC Software and system testers repeatedly fall victim to the same pitfalls. Think of them as "anti-patterns" mistakes that make testing far less effective and efficient than it ought to be. In "Common System and Software Testing Pitfalls, " Donald G. Firesmith catalogs 92 of these pitfalls. Drawing on his 35 years of software and system engineering experience, Firesmith shows testers and technical managers and other stakeholders how to avoid falling into these pitfalls, recognize when they have already fallen in, and escape while minimizing their negative consequences. Firesmith writes for testing professionals and other stakeholders involved in large or medium-sized projects. His anti-patterns and solutions address both "pure software" applications and "software-reliant systems," encompassing heterogeneous subsystems, hardware, software, data, facilities, material, and personnel. For each pitfall, he identifies its applicability, characteristic symptoms, potential negative consequences and causes, and offers specific actionable recommendations for avoiding it or limiting its consequences. This guide will help youPinpoint testing processes that need improvement-before, during, and after the projectImprove shared understanding and collaboration among all project participantsDevelop, review, and optimize future project testing programsMake your test documentation far more usefulIdentify testing risks and appropriate risk-mitigation strategiesCategorize testing problems for metrics collection, analysis, and reportingTrain new testers, QA specialists, and other project stakeholders With 92 common testing pitfalls organized into 14 categories, this taxonomy of testing pitfalls should be relatively complete. However, in spite of its comprehensiveness, it is also quite likely that additional pitfalls and even missing categories of pitfalls will be identified over time as testers read this book and compare it to their personal experiences. As an enhancement to the print edition, the author has provided the following location on the web where readers can find major additions and modifications to this taxonomy of pitfalls: http: //(http://donald.firesmith.net/home/common-testing-pitfalls) donald.firesmith.net/home/common-test... Please send any recommended changes and additions to dgf (at) sei (dot) cmu (dot) edu, and the author will consider them for publication both on the website and in future editions of this book. “Don's book is a very good addition both to the testing literature and to the literature on quality assurance and software engineering.... [It] is likely to become a standard for test training as well as a good reference for professional testers and developers. I would also recommend this book as background material for negotiating outsourced software contracts. I often work as an expert witness in litigation for software with very poor quality, and this book might well reduce or eliminate these lawsuits....” –Capers Jones, VP and CTO, Namcook Analytics LLC Software and system testers repeatedly fall victim to the same pitfalls. Think of them as “anti-patterns”: mistakes that make testing far less effective and efficient than it ought to be. In Common System and Software Testing Pitfalls, Donald G. Firesmith catalogs 92 of these pitfalls. Drawing on his 35 years of software and system engineering experience, Firesmith shows testers and technical managers and other stakeholders how to avoid falling into these pitfalls, recognize when they have already fallen in, and escape while minimizing their negative consequences. Firesmith writes for testing professionals and other stakeholders involved in large or medium-sized projects. His anti-patterns and solutions address both “pure software” applications and “software-reliant systems,” encompassing heterogeneous subsystems, hardware, software, data, facilities, material, and personnel. For each pitfall, he identifies its applicability, characteristic symptoms, potential negative consequences and causes, and offers specific actionable recommendations for avoiding it or limiting its consequences. This guide will help you Pinpoint testing processes that need improvement–before, during, and after the project Improve shared understanding and collaboration among all project participants Develop, review, and optimize future project testing programs Make your test documentation far more useful Identify testing risks and appropriate risk-mitigation strategies Categorize testing problems for metrics collection, analysis, and reporting Train new testers, QA specialists, and other project stakeholders With 92 common testing pitfalls organized into 14 categories, this taxonomy of testing pitfalls should be relatively complete. However, in spite of its comprehensiveness, it is also quite likely that additional pitfalls and even missing categories of pitfalls will be identified over time as testers read this book and compare it to their personal experiences. As an enhancement to the print edition, the author has provided the following location on the web where readers can find major additions and modifications to this taxonomy of pitfalls: http://donald.firesmith.net/home/common-testing-pitfalls Please send any recommended changes and additions to dgf (at) sei (dot) cmu (dot) edu, and the author will consider them for publication both on the website and in future editions of this book. CONTENTS......Page 8 FOREWORD......Page 14 PREFACE......Page 18 Intended Audience......Page 19 How to Use This Book and Its Contents......Page 20 Organization of This Book......Page 21 Acknowledgments......Page 22 ABOUT THE AUTHOR......Page 24 1.1 What Is Testing?......Page 26 1.2 Testing and the V Models......Page 27 1.3 What Is a Defect?......Page 30 1.4 Why Is Testing Critical?......Page 32 1.5 The Limitations of Testing......Page 34 1.6 What Is a Testing Pitfall?......Page 35 1.8 Pitfall Specifications......Page 36 2.1.1 Test Planning and Scheduling Pitfalls......Page 38 2.1.3 Management-Related Testing Pitfalls......Page 39 2.1.4 Staffing Pitfalls......Page 40 2.1.5 Test-Process Pitfalls......Page 41 2.1.6 Test Tools and Environments Pitfalls......Page 42 2.1.7 Test Communication Pitfalls......Page 43 2.1.8 Requirements-Related Testing Pitfalls......Page 44 2.2.2 Integration Testing Pitfalls......Page 45 2.2.3 Specialty Engineering Testing Pitfalls......Page 46 2.2.5 System of Systems (SoS) Testing Pitfalls......Page 47 2.2.6 Regression Testing Pitfalls......Page 48 3.1 Common Negative Consequences......Page 50 3.2 General Recommendations......Page 51 3.3.1 Test Planning and Scheduling Pitfalls......Page 53 3.3.2 Stakeholder Involvement and Commitment Pitfalls......Page 69 3.3.3 Management-Related Testing Pitfalls......Page 76 3.3.4 Staffing Pitfalls......Page 90 3.3.5 Test Process Pitfalls......Page 100 3.3.6 Test Tools and Environments Pitfalls......Page 131 3.3.7 Test Communication Pitfalls......Page 156 3.3.8 Requirements-Related Testing Pitfalls......Page 168 3.4.1 Unit Testing Pitfalls......Page 189 3.4.2 Integration Testing Pitfalls......Page 194 3.4.3 Specialty Engineering Testing Pitfalls......Page 202 3.4.4 System Testing Pitfalls......Page 231 3.4.5 System of Systems (SoS) Testing Pitfalls......Page 236 3.4.6 Regression Testing Pitfalls......Page 250 4.1 Future Work......Page 266 4.2 Maintaining the Lists of Pitfalls......Page 267 B......Page 268 D......Page 269 F......Page 270 I......Page 271 P......Page 272 S......Page 273 T......Page 274 V......Page 276 W......Page 277 B: ACRONYMS......Page 278 C: NOTES......Page 280 D: REFERENCES......Page 294 E: PLANNING CHECKLIST......Page 296 B......Page 304 D......Page 305 G......Page 306 I......Page 307 L......Page 309 O......Page 310 Q......Page 311 R......Page 312 S......Page 313 T......Page 315 U......Page 318 W......Page 319 CONTENTS 8 FOREWORD 14 PREFACE 18 Scope 19 Intended Audience 19 How to Use This Book and Its Contents 20 Organization of This Book 21 Acknowledgments 22 ABOUT THE AUTHOR 24 1 OVERVIEW 26 1.1 What Is Testing? 26 1.2 Testing and the V Models 27 1.3 What Is a Defect? 30 1.4 Why Is Testing Critical? 32 1.5 The Limitations of Testing 34 1.6 What Is a Testing Pitfall? 35 1.7 Categorizing Pitfalls 36 1.8 Pitfall Specifications 36 2 BRIEF OVERVIEWS OF THE TESTING PITFALLS 38 2.1 General Testing Pitfalls 38 2.1.1 Test Planning and Scheduling Pitfalls 38 2.1.2 Stakeholder Involvement and Commitment Pitfalls 39 2.1.3 Management-Related Testing Pitfalls 39 2.1.4 Staffing Pitfalls 40 2.1.5 Test-Process Pitfalls 41 2.1.6 Test Tools and Environments Pitfalls 42 2.1.7 Test Communication Pitfalls 43 2.1.8 Requirements-Related Testing Pitfalls 44 2.2 Test-Type-Specific Pitfalls 45 2.2.1 Unit Testing Pitfalls 45 2.2.2 Integration Testing Pitfalls 45 2.2.3 Specialty Engineering Testing Pitfalls 46 2.2.4 System Testing Pitfalls 47 2.2.5 System of Systems (SoS) Testing Pitfalls 47 2.2.6 Regression Testing Pitfalls 48 3 DETAILED DESCRIPTIONS OF THE TESTING PITFALLS 50 3.1 Common Negative Consequences 50 3.2 General Recommendations 51 3.3 General Testing Pitfalls 53 3.3.1 Test Planning and Scheduling Pitfalls 53 3.3.2 Stakeholder Involvement and Commitment Pitfalls 69 3.3.3 Management-Related Testing Pitfalls 76 3.3.4 Staffing Pitfalls 90 3.3.5 Test Process Pitfalls 100 3.3.6 Test Tools and Environments Pitfalls 131 3.3.7 Test Communication Pitfalls 156 3.3.8 Requirements-Related Testing Pitfalls 168 3.4 Test-Type-Specific Pitfalls 189 3.4.1 Unit Testing Pitfalls 189 3.4.2 Integration Testing Pitfalls 194 3.4.3 Specialty Engineering Testing Pitfalls 202 3.4.4 System Testing Pitfalls 231 3.4.5 System of Systems (SoS) Testing Pitfalls 236 3.4.6 Regression Testing Pitfalls 250 4 CONCLUSION 266 4.1 Future Work 266 4.2 Maintaining the Lists of Pitfalls 267 A: GLOSSARY 268 A 268 B 268 C 269 D 269 E 270 F 270 G 271 H 271 I 271 L 272 M 272 O 272 P 272 Q 273 R 273 S 273 T 274 U 276 V 276 W 277 B: ACRONYMS 278 C: NOTES 280 D: REFERENCES 294 E: PLANNING CHECKLIST 296 INDEX 304 A 304 B 304 C 305 D 305 E 306 F 306 G 306 H 307 I 307 J 309 L 309 M 310 N 310 O 310 P 311 Q 311 R 312 S 313 T 315 U 318 V 319 W 319