Testing of Software and Communicating Systems: 19th IFIP TC 6/WG 6.1 International Conference, TestCom 2007, 7th International Workshop, FATES 2007, Tallinn, Estonia, June 26-29, 2007, Proceedings

This book constitutes the refereed proceedings of the 19th IFIP TC 6/WG 6.1 International Conference on Testing Communicating Systems, TestCom 2007, and the 7th International Workshop on Formal Approaches to Testing of Software, FATES 2007, held in Tallinn, Estonia. It covers all current issues in testing communicating systems and formal approaches in testing of software, from classical telecommunication issues to general software testing. Title Page Preface Organization Table of Contents Implementing Conformiq Qtronic New Approach for EFSM-Based Passive Testing of Web Services Introduction Related Work EFSM-Based Observation: Forward and Backward Walks The Homing Controller Algorithm Processing Observed Requests Processing Observed Responses Performing Backward Walk Discussion Example Conclusion References Automation of Avionic Systems Testing Introduction SystemOverview Testing Environment Constraints The Tool General Strategies Case Study Conclusions and Future Work References Automatic Test Generation from Interprocedural Specifications Introduction Introductive Example Testing Theory Modeling Recursive Specifications and Test Purposes Test Selection on the Recursive Canonical Tester Concluding Remarks References A New Method for Interoperability Test Generation Introduction Formal Background Preliminary Definitions IOLTS Model and Related Definitions Interoperability Formal Definitions: iop Criteria Interoperability Test Generation Preliminary Definitions Classical Methods New Approach: Bilateral Criterion Based Method Applying the New Method to a Connection Protocol A Simplified Version of the ISDN Connection Protocol CADP Toolbox Used for Implementing the Method Applying the Classical Approach on the Client/Server Mode Applying Our New Method on the Client/Server Version Application to the Complete Client and Server Mode Summary of the Experimentation Results Conclusion References Component Testing Is Not Enough - A Study of Software Faults in Telecom Middleware Introduction Terminology Related Work Case Study Process and Data Selection Identified Failure Distributions Fault Classification Fault Distribution Validation and Threats Future Work Discussions and Conclusions References Symbolic Model Based Testing for Component Oriented Systems Introduction Structured Input/Output Symbolic Transition Systems Basic Definitions of IOSTS Systems An Example of a Slot Machine System Based Test Purposes for Sub-systems Symbolic Execution Symbolic Behavior Projections Symbolic Execution Based Conformance Testing Conformance Testing and System-Based Test Purposes Conclusion and Future Works References A Compositional Testing Framework Driven by Partial Specifications Introduction The General Approach Notations Formal Requirements Test Process Algebra Test Generation Test Execution and Test Verdicts Application to Variant of LTL The Logic Test Generation Soundness Proposition Java-CTPS Case Study Conclusion References Nodes Self-similarity to Test Wireless Ad Hoc Routing Protocols Introduction Related Works Conformance Testing of an Ad Hoc Routing Protocol Testing Architecture Testing Assumptions Formal Specification Self-similarity of Nodes Definition of Self-similarity A Case Study: DSR Dynamic Source Routing Protocol DSR Formal Model Specification Reduction Using Nodes Self-similarity Test Scenarios Equivalence Experiment Context Sets Management for Unexpected Messages Conclusion References Testing and Model-Checking Techniques for Diagnosis Introduction Background Techniques and Heuristics for Diagnostic Testing Distinguishability Orthogonality Automating Diagnostic Testing Preliminaries Strong Distinguishability and Strong Orthogonality Weak Distinguishability andWeak Orthogonality Optimisations Diagnostic Testing Methodology Example Concluding Remarks References Model-Based Testing of Service Infrastructure Components Introduction Modelling a Solution for Fault-Tolerant Service Infrastructure Structural Model Behavioural Rules Generation of Execution Sequences by Model Checking Test Requirements State Space Generation and Model Checking Derivation of Test Cases A Distributed Test Architecture Creating the Test Suite Discussion Related Work Conclusions and Future Work References Testing Input/Output Partial Order Automata Introduction IOPOA Framework IOPO Automata I/O Vector Sequences Completion of an IOPOA Morphisms and Conformance Conformance Testing for Automata with Distinguishing Sequences Assumptions Sequential Input Automata Complete Transition Identification Algorithm for IOPOA Conformance Testing Checking Sequence Construction ExtensionsandOutlook Conformance Testing for Automata Without Distinguishing Sequences State Identification and State Verification Homing and Synchronizing Sequences Conclusion References A Framework for Testing AIS Implementations Introduction Application Interface Specification Overview Current AIS Implementation Testing Systems SAFtest SAFtest Next Generation The Message-Based AIS Testing Framework (MATF) Test Coordination Message Processing Controlling and Observing the IUT Testing Experiments Test Suite Configuration Test Execution Future Work Conclusion References An Object-Oriented Framework for Improving Software Reuse on Automated Testing of Mobile Phones Introduction Related Work Practices in the Corporate Environment Related Research Topics TAF Design Description Low-Level Implementation Infrastructure High-Level ATC Encoding TAF Organization Automating a Test Case with the Aid of TAF Object-Oriented Framework: A Keystone for Worthy Automation Experimental Results Quantifying Reuse Upon TAF The Impact of Software Reuse The Overall Impact of Test Automation Conclusions and Future Work References Model Based Testing of an Embedded Session and Transport Protocol Introduction The Approach NoTA Architecture, Session and Transport Protocol Layer Modeling the System and Constructing the Tester The Models Use Cases, Data and Control of the System Test Configuration Results and Conclusions References Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites Introduction Foundations Smells in Tests A TTCN-3 Code Smell Catalogue TTCN-3 Code Smell: Duplicate Alt Branches TTCN-3 Code Smell: Activation Asymmetry A Tool for Detecting TTCN-3 Code Smell Instances Implementation Related Work Application Conclusion References A Bounded Incremental Test Generation Algorithm for Finite State Machines Introduction Finite State Machines Representing Changes to FSMs FSM Test Generation and the HIS-Method The HIS-Method Incremental Computation Model Evaluating the Complexity of an Incremental Algorithm Incremental Test Generation Method Incremental Algorithm for Maintaining a Prefix-Closed State Cover Set Incremental Algorithm for Maintaining a Separating Family of Sequences Total Complexity of the Incremental Testing Related Work Conclusion References Experimental Testing of TCP/IP/Ethernet Communication for Automatic Control Introduction Motivation Tests of TCP/IP/Ethernet network Properties Tests of Transmission Time Packet Loss Measurement Influence of Transmission Time on Control Quality (LabVIEW Platform) Materials and Methods Experimental Tests Observations and Conclusions Influence of Transmission Time on Control Quality (Logix Platform) Materials and Methods Results and Conclusions Influence of Transmission Time on Control Quality in Simatic Platform Materials and Methods Results and Conclusions Concluding Remarks References Towards Systematic Signature Testing Motivation On the Derivation of Signatures On the Test of Signatures Methods for the Test of Signatures Preliminary Test Tests for Under Specified Signatures Tests for over Specified Signatures Test of Escape Events Example: Test for Under Specified Signatures Modeling Signatures in EDL Test Steps Final Remarks References TPLan-A Notation for Expressing Test Purposes Introduction About Test Purposes Test Purpose Specification with TPLan Test Purpose Structure Fundamental Building Blocks User Defined Extensions Arrangement of Test Purpose Definitions First Experiences Improving of Test Specification Efficiency Conclusions References Testing Nondeterministic Finite State Machines with Respect to the Separability Relation Introduction Preliminaries Fault Model and a Test Suite Deriving a Complete Test Suite w.r.t. Fault Model $ Deriving a Complete Test Suite w.r.t. Fault Model $ $ Conclusion and Future Research Work References Learning and Integration of Parameterized Components Through Testing Introduction Parameterized Model Algorithm Observation Table Algorithm Illustration Dealing with Counterexamples IntegrationTesting Test Generation by Scenario or Model Checking Test Generation Using Information from Learning Procedure Conclusion References An EFSM-Based Passive Fault Detection Approach Introduction Preliminaries The Proposed Approach Algorithm Main Algorithm Search Trace Tree Algorithm Check Trace and the Hybrid Method Function $action$ Optimization on Constraints Experiments Conclusions References Test Data Variance as a Test Quality Measure: Exemplified for TTCN-3 Introduction Related Work The Principal Approach The Data Variance Computation Method Distance Metrics for TTCN-3 Values Distance Metrics for TTCN-3 Templates AnExample Implementation Conclusions and Outlook References Model-Based Testing of Optimizing Compilers Introduction The OTK Method Process of Analyzing an Optimization Algorithm Formalization of Requirements Automated Tests Generation and Tests Execution Practical Applications Conclusion References Author Index Blank Page Blank Page This book constitutes the refereed proceedings of the 19th IFIP TC 6/WG 6.1 International Conference on Testing Communicating Systems, TestCom 2007, and the 7th International Workshop on Formal Approaches to Testing of Software, FATES 2007, held in Tallinn, Estonia in June 2007. The 24 revised full papers presented together with 1 invited talk were carefully reviewed and selected from initially 61 submissions to both events. The papers address all current issues in testing communicating systems and formal approaches in testing of software, ranging from classical telecommunication issues to general software testing. They were presented in 8 multipart sessions coverering automata-based testing, practical experiences, system testing, modular systems, and test quality