Best Practices for the Use of Simulation in POD Curves Estimation: Application to UT Weld Inspection (IIW Collection)

This book provides best-practice guidance and practical recommendations on the use of numerical simulation for probability of detection (POD) curve estimation in the study of non-destructive testing reliability. It focuses on ultrasonic testing (UT) weld inspection but many of the principles can be applied to a broader range of techniques and situations. The first part lists and briefly describes the principal documents that establish the recommended statistical framework adapted for POD curve estimation. It also presents the most important initiatives on the model assisted probability of detection (MAPOD) approach in recent years. The second part provides details of the advantages and limitations of the simulation in this context. The third part then describes the prerequisites for the use of simulation (validation of the software, expertise of the user), and the fourth and main part offers the methodology and guidance as well as possible applications for using POD curves determined using simulation Acknowledgements 6 Contents 7 Introduction 9 Context 9 Scope of the Document 10 Content 10 Background on POD and MAPOD Approach 11 1 Recommendation Documents on Statistical Methodology Dedicated to POD Analysis 12 2 Documentation and Recent Initiatives on the Use of Simulation in the Context of POD 14 Advantages and Limitations of the Simulation 15 3 Advantages of Simulation 16 4 Difficulties, Limitations 18 Human Factors 18 Lack of Knowledge on Influential Parameters, Epistemic and Aleatory Uncertainties 19 Identification of Aleatory Parameters 20 Knowledge of Statistical Distributions of Aleatory Parameters 20 Availability of Suitable and Validated Models 21 5 Possible Ways of Using Simulation in the Context of POD Curve Estimation 22 Prerequisites for the Use of Simulation 24 6 Validation of the Software Tools 25 7 Training/Expertise of the Operators 27 Methodology and Guidance 28 8 Basics of Statistics for POD 29 POD Curves 29 Hit/Miss Analysis 31 Signal Response (or â vs. a) 32 Noise and Probability of False Alarms (PFA) 34 Min(POD) greaterthan 0 and/or Max(POD) lessthan 1 35 Variation of Sensitivity in the Inspected Zone 36 9 Best Practices Principles and Guidance for POD Curves Estimation Using Simulation 37 Step 1: Input of Nominal Values of Parameters 39 Step 2: Description of Aleatory Uncertainties (Variability of Influential Parameters) 40 Step 3: Simulations 42 Step 4: Analysis of the Results and Computation of the POD Curve 43 Step 5: Evaluation of the Reliability of a Simulated POD Curve 44 Step 6: Report 47 10 Best Practice Principles and Guidance for the Exploitation of Simulated POD Data in Relation with Experimental Data 48 Complement an Experimental Data Set for Estimation of a POD Curve 48 Comparison Between Experimental POD Curves and POD Curves Estimated by Simulation 49 Optimization of the Design of Experiments in a POD Study 50 Quantification of the Impact of an Additional Parameter 50 Quantification of the Influence of a Change in the Inspection Procedure 51 Modify the Procedure to Bring Back a POD Curve to an Acceptable Value 52 Conclusion 53 Appendix: Specificities of AUT Systems Using Zonal Discrimination Method 54 References 56 Front Matter ....Pages i-x Front Matter ....Pages 1-1 Recommendation Documents on Statistical Methodology Dedicated to POD Analysis (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 3-4 Documentation and Recent Initiatives on the Use of Simulation in the Context of POD (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 5-5 Front Matter ....Pages 7-7 Advantages of Simulation (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 9-10 Difficulties, Limitations (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 11-14 Possible Ways of Using Simulation in the Context of POD Curve Estimation (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 15-16 Front Matter ....Pages 17-17 Validation of the Software Tools (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 19-20 Training/Expertise of the Operators (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 21-21 Front Matter ....Pages 23-23 Basics of Statistics for POD (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 25-32 Best Practices Principles and Guidance for POD Curves Estimation Using Simulation (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 33-43 Best Practice Principles and Guidance for the Exploitation of Simulated POD Data in Relation with Experimental Data (Bastien Chapuis, Pierre Calmon, Frédéric Jenson)....Pages 45-49 Back Matter ....Pages 51-56