Search-Based Software Engineering: 11th International Symposium, SSBSE 2019, Tallinn, Estonia, August 31 – September 1, 2019, Proceedings (Lecture Notes in Computer Science Book 11664)

This book constitutes the refereed proceedings of the 11th International Symposium on Search-Based Software Engineering, SSBSE 2019, held in Tallinn, Estonia, in August/September 2019. The 9 research papers and 3 short papers presented together with 1 keynote and 1 challenge paper were carefully reviewed and selected from 28 submissions. SSBSE is a research area focused on the formulation of software engineering problems as search problems, and the subsequent use of complex heuristic techniques to attain optimal solutions to such problems. A wealth of engineering challenges - from test generation, to design refactoring, to process organization - can be solved efficiently through the application of automated optimization techniques. SBSE is a growing field - sitting at the crossroads between AI, machine learning, and software engineering - and SBSE techniques have begun to attain human-competitive results. Foreword 6 Message from the General Chair 6 Message from the Program Chairs 6 Organization 9 Contents 12 Keynote 14 Search-Based Predictive Modelling for Software Engineering: How Far Have We Gone? 15 1 Introduction 15 References 16 Research Papers 20 A Systematic Comparison of Search Algorithms for Topic Modelling—A Study on Duplicate Bug Report Identification 21 1 Introduction 21 2 Background and Related Work 22 3 Empirical Study 26 3.1 Experimental Methodology 29 4 Empirical Results 30 5 Conclusion and Future Work 34 References 34 Constructing Search Spaces for Search-Based Software Testing Using Neural Networks 37 1 Introduction 37 1.1 Property Targeting Search Landscape 38 1.2 Diversity Driven Search Landscape 38 1.3 Contributions and Scope 39 2 Tools and Datasets 39 2.1 AFL 39 2.2 Pin 40 2.3 Valgrind 40 2.4 Dataset 41 3 Experimental Setup 42 4 Evaluation 44 4.1 Size and Continuity of Landscapes 44 4.2 Representation Condition 45 4.3 Meaningful Ordering of Candidate Solutions 46 5 Conclusion 49 References 49 A Review of Ten Years of the Symposium on Search-Based Software Engineering*-14pt 52 1 Introduction 52 2 RQ1 – SSBSE in Numbers 54 3 RQ2 – Citations Analysis and External Impact 59 4 RQ3 – Software Engineering Areas and Tasks 62 5 RQ4 – Experimental Rigour 64 6 Recommendations to Future SSBSE Authors 66 7 Conclusion 66 References 67 Does Diversity Improve the Test Suite Generation for Mobile Applications? 68 1 Introduction 68 2 Background: Sapienz and Fitness Landscape Analysis 69 3 Fitness Landscape Analysis of Sapienz 69 3.1 Fitness Landscape of Sapienz 69 3.2 Experimental Setup 70 3.3 Results 70 3.4 Discussion 75 4 Sapienzdiv 75 5 Evaluation 77 5.1 Experimental Setup 78 5.2 Results 78 5.3 Discussion 81 6 Threats to Validity 81 7 Related Work 81 8 Conclusions and Future Work 82 References 82 PRICE: Detection of Performance Regression Introducing Code Changes Using Static and Dynamic Metrics 85 1 Introduction 85 2 Methodology 86 2.1 Approach Overview 86 2.2 Data Collection 87 2.3 Solution Representation 89 2.4 Solution Evaluation 89 2.5 Solution Variation 90 3 Experimental Setting 91 3.1 Research Questions 91 3.2 Parameter Tuning 92 4 Results 92 4.1 RQ1. To What Extent Does NSGA-II Provide Better Regression Detection Compared with Other Techniques? 92 4.2 RQ2 Do the Generated Rules Continue to Perform Well with the Evolution of the Software? 95 5 Threats to Validity 95 6 Related Work 96 7 Conclusion and Future Work 97 References 97 General Program Synthesis Using Guided Corpus Generation and Automatic Refactoring 99 1 Introduction 99 2 Background 101 3 Methodology 102 3.1 Simplified Language 102 3.2 Neural Network and Search Architecture 103 3.3 Corpus Generation 105 3.4 Automatic Corpus Refactoring 106 4 Results 106 4.1 Program Synthesis 107 4.2 Requirements in Corpus Generation 109 4.3 Effects of Corpus Refactoring 111 5 Conclusion 113 References 113 A Search-Based Approach to Generate MC/DC Test Data for OCL Constraints 115 1 Introduction 115 2 Strategy to Achieve the MC/DC Criterion 117 2.1 OCL Constraint Reformulation for MC/DC 117 2.2 Handling Negation for OCL 118 2.3 Logical Operations Reformulation 119 2.4 Applying Case-Based Reasoning 120 2.5 Identifying Conflicting Constraints 121 3 Empirical Evaluation 122 3.1 Experiment Design and Settings 122 3.2 Results and Analysis 123 3.3 Threats to Validity 126 4 Related Work 127 5 Conclusion 127 References 128 Bio-Inspired Optimization of Test Data Generation for Concurrent Software 131 1 Introduction 131 2 Concurrent Software Testing: Basic Concepts 133 3 Search-Based Software Testing for Concurrent Software 134 4 BioConcST: Bio-Inspired Optimization for Concurrent Software Testing 135 5 Experimental Evaluation 140 5.1 Study Subjects: Concurrent Programs 141 5.2 Experimental Setup 141 5.3 Analysis of Results 142 5.4 Discussion 143 6 Conclusion and Suggestions for Future Work 144 References 145 Revisiting Hyper-Parameter Tuning for Search-Based Test Data Generation 147 1 Introduction 147 2 Empirical Study 149 2.1 Objective and Research Questions 149 2.2 Experiment Design 150 2.3 Results 153 2.4 Threats to Validity 159 3 Related Works 159 4 Conclusion and Future Work 160 References 161 Short and Student Papers 163 Towards Automated Boundary Value Testing with Program Derivatives and Search 164 1 Introduction 164 2 Illustrative Example: Constrained Sum 166 3 Difference Quotient and Derivative of a Program 166 4 Boundary Value Analysis of Constrained Sum 168 5 Discussion 170 References 171 Code Naturalness to Assist Search Space Exploration in Search-Based Program Repair Methods 173 1 Introduction 173 2 Proposed Approach 174 2.1 Doc2vec Model 175 2.2 LSTM Model 175 3 Preliminary Empirical Study 176 3.1 Preliminary Results 176 4 Threats to Validity 178 5 Final Remarks 179 References 179 Dorylus: An Ant Colony Based Tool for Automated Test Case Generation 180 1 Introduction 180 2 Dorylus 181 3 Experimental Setup 183 4 Results 184 5 Related Work 186 6 Conclusion 187 References 188 Challenge Paper 190 Software Improvement with Gin: A Case Study 191 1 Introduction 191 2 Subject Program 191 3 Test Suite 192 4 Methodology 192 4.1 Search 192 4.2 Setup 193 5 Results 193 5.1 Runtime Improvement 194 5.2 Repair 195 6 Conclusions 196 References 196 Author Index 198 Front Matter ....Pages i-xiv Front Matter ....Pages 1-1 Search-Based Predictive Modelling for Software Engineering: How Far Have We Gone? (Federica Sarro)....Pages 3-7 Front Matter ....Pages 9-9 A Systematic Comparison of Search Algorithms for Topic Modelling—A Study on Duplicate Bug Report Identification (Annibale Panichella)....Pages 11-26 Constructing Search Spaces for Search-Based Software Testing Using Neural Networks (Leonid Joffe, David Clark)....Pages 27-41 A Review of Ten Years of the Symposium on Search-Based Software Engineering (Thelma Elita Colanzi, Wesley Klewerton Guez Assunção, Paulo Roberto Farah, Silvia Regina Vergilio, Giovani Guizzo)....Pages 42-57 Does Diversity Improve the Test Suite Generation for Mobile Applications? (Thomas Vogel, Chinh Tran, Lars Grunske)....Pages 58-74 PRICE: Detection of Performance Regression Introducing Code Changes Using Static and Dynamic Metrics (Deema Alshoaibi, Kevin Hannigan, Hiten Gupta, Mohamed Wiem Mkaouer)....Pages 75-88 General Program Synthesis Using Guided Corpus Generation and Automatic Refactoring (Alexander Wild, Barry Porter)....Pages 89-104 A Search-Based Approach to Generate MC/DC Test Data for OCL Constraints (Hassan Sartaj, Muhammad Zohaib Iqbal, Atif Aftab Ahmed Jilani, Muhammad Uzair Khan)....Pages 105-120 Bio-Inspired Optimization of Test Data Generation for Concurrent Software (Ricardo F. Vilela, Victor H. S. C. Pinto, Thelma E. Colanzi, Simone R. S. Souza)....Pages 121-136 Revisiting Hyper-Parameter Tuning for Search-Based Test Data Generation (Shayan Zamani, Hadi Hemmati)....Pages 137-152 Front Matter ....Pages 153-153 Towards Automated Boundary Value Testing with Program Derivatives and Search (Robert Feldt, Felix Dobslaw)....Pages 155-163 Code Naturalness to Assist Search Space Exploration in Search-Based Program Repair Methods (Altino Dantas, Eduardo F. de Souza, Jerffeson Souza, Celso G. Camilo-Junior)....Pages 164-170 Dorylus: An Ant Colony Based Tool for Automated Test Case Generation (Dan Bruce, Héctor D. Menéndez, David Clark)....Pages 171-180 Front Matter ....Pages 181-181 Software Improvement with Gin: A Case Study (Justyna Petke, Alexander E. I. Brownlee)....Pages 183-189 Back Matter ....Pages 191-191