Verification, Validation, and Testing of Engineered Systems.
Title:
Verification, Validation, and Testing of Engineered Systems.
Author:
Engel, Avner.
ISBN:
9780470618844
Personal Author:
Edition:
1st ed.
Physical Description:
1 online resource (715 pages)
Series:
Wiley Series in Systems Engineering and Management ; v.73
Wiley Series in Systems Engineering and Management
Contents:
Cover -- Series page -- Title page -- Copyright page -- Dedication -- Contents -- Preface -- Part I: Introduction -- Chapter 1: Introduction -- 1.1 OPENING -- 1.1.1 Background -- 1.1.2 Purpose -- 1.1.3 Intended Audience -- 1.1.4 Book Structure and Contents -- 1.1.5 Scope of Application -- 1.1.6 Terminology and Notation -- 1.2 VVT SYSTEMS AND PROCESS -- 1.2.1 Introduction-VVT Systems and Process -- 1.2.2 Engineered Systems -- 1.2.3 VVT Concepts and Definition -- 1.2.4 The Fundamental VVT Dilemma -- 1.2.5 Modeling Systems and VVT Lifecycle -- 1.2.6 Modeling VVT and Risks as Cost and Time Drivers -- 1.3 CANONICAL SYSTEMS VVT PARADIGM -- 1.3.1 Introduction-Canonical Systems VVT Paradigm -- 1.3.2 Phases of the System Lifecycle -- 1.3.3 Views of the System -- 1.3.4 VVT Aspects of the System -- 1.4 METHODOLOGY APPLICATION -- 1.4.1 Introduction -- 1.4.2 VVT Methodology Overview -- 1.4.3 VVT Tailoring -- 1.4.4 VVT Documents -- 1.5 REFERENCES -- Part II: VVT Activities and Methods -- Chapter 2: System VVT Activities: Development -- 2.1 STRUCTURE OF CHAPTER -- 2.1.1 Systems Development Lifecycle Phases and VVT Activities -- 2.1.2 VVT Activity Aspects -- 2.1.3 VVT Activity Format -- 2.2 VVT ACTIVITIES DURING DEFINITION -- 2.2.1 Generate Requirements Verification Matrix (RVM) -- 2.2.2 Generate VVT Management Plan (VVT-MP) -- 2.2.3 Assess the Request For Proposal (RFP) Document -- 2.2.4 Assess System Requirements Specification (SysRS) -- 2.2.5 Assess Project Risk Management Plan (RMP) -- 2.2.6 Assess System Safety Program Plan (SSPP) -- 2.2.7 Participate in System Requirements Review (SysRR) -- 2.2.8 Participate in System Engineering Management Plan (SEMP) Review -- 2.2.9 Conduct Engineering Peer Review of the VVT-MP Document -- 2.3 VVT ACTIVITIES DURING DESIGN -- 2.3.1 Optimize the VVT Strategy -- 2.3.2 Assess System/Subsystem Design Description (SSDD).
2.3.3 Validate System Design by Means of Virtual Prototype -- 2.3.4 Validate System Design Tools -- 2.3.5 Assess System Design for Meeting Future Lifecycle Needs -- 2.3.6 Participate in the System Design Review (SysDR) -- 2.4 VVT ACTIVITIES DURING IMPLEMENTATION -- 2.4.1 Preparing the Test Cycle for Subsystems and Components -- 2.4.2 Assess Suppliers' Subsystems Test Documents -- 2.4.3 Perform Acceptance Test Procedure-Subsystems/Enabling Products -- 2.4.4 Assess System Performance by Way of Simulation -- 2.4.5 Verify Design Versus Implementation Consistency -- 2.4.6 Participate in Acceptance Test Review-Subsystems/Enabling Products -- 2.5 VVT ACTIVITIES DURING INTEGRATION -- 2.5.1 Develop System Integration Laboratory (SIL) -- 2.5.2 Generate System Integration Test Plan (SysITP) -- 2.5.3 Generate System Integration Test Description (SysITD) -- 2.5.4 Validate Supplied Subsystems in Stand-Alone Configuration -- 2.5.5 Perform Components, Subsystem, Enabling Products Integration Tests -- 2.5.6 Generate System Integration Test Report (SysITR) -- 2.5.7 Assess Effectiveness of the System Built In Test (BIT) -- 2.5.8 Conduct Engineering Peer Review of the SysITR -- 2.6 VVT ACTIVITIES DURING QUALIFICATION -- 2.6.1 Generate a Qualification/Acceptance System Test Plan (SysTP) -- 2.6.2 Create Qualification/Acceptance System Test Description (SysTD) -- 2.6.3 Perform Virtual System Testing by Means of Simulation -- 2.6.4 Perform Qualification Testing/Acceptance Test Procedure (ATP)-System -- 2.6.5 Generate Qualification/Acceptance System Test Report (SysTR) -- 2.6.6 Assess System Testability, Maintainability and Availability -- 2.6.7 Perform Environmental System Testing -- 2.6.8 Perform System Certification and Accreditation (C&A) -- 2.6.9 Conduct Test Readiness Review (TRR) -- 2.6.10 Conduct Engineering Peer Review of Development Enabling Products.
2.6.11 Conduct Engineering Peer Review of Program and Project Safety -- 2.7 REFERENCES -- Chapter 3: Systems VVT Activities: Post-Development -- 3.1 STRUCTURE OF CHAPTER -- 3.2 VVT ACTIVITIES DURING PRODUCTION -- 3.2.1 Participate in Functional Configuration Audit (FCA) -- 3.2.2 Participate in Physical Configuration Audit (PCA) -- 3.2.3 Plan System Production VVT Process -- 3.2.4 Generate a First Article Inspection (FAI) Procedure -- 3.2.5 Validate the Production-Line Test Equipment -- 3.2.6 Verify Quality of Incoming Components and Subsystems -- 3.2.7 Perform First Article Inspection (FAI) -- 3.2.8 Validate Pre-Production Process -- 3.2.9 Validate Ongoing-Production Process -- 3.2.10 Perform Manufacturing Quality Control -- 3.2.11 Verify the Production Operations Strategy -- 3.2.12 Verify Marketing and Production Forecasting -- 3.2.13 Verify Aggregate Production Planning -- 3.2.14 Verify Inventory Control Operation -- 3.2.15 Verify Supply Chain Management -- 3.2.16 Verify Production Control Systems -- 3.2.17 Verify Production Scheduling -- 3.2.18 Participate in Production Readiness Review (PRR) -- 3.3 VVT ACTIVITIES DURING USE/MAINTENANCE -- 3.3.1 Develop VVT Plan for System Maintenance -- 3.3.2 Verify the Integrated Logistics Support Plan (ILSP) -- 3.3.3 Perform Ongoing System Maintenance Testing -- 3.3.4 Conduct Engineering Peer Review on System Maintenance Process -- 3.4 VVT ACTIVITIES DURING DISPOSAL -- 3.4.1 Develop VVT Plan for System Disposal -- 3.4.2 Assess the System Disposal Plan -- 3.4.3 Assess System Disposal Strategies by Means of Simulation -- 3.4.4 Assess On-Going System Disposal Process -- 3.4.5 Conduct Engineering Peer Review to Assess System Disposal Processes -- 3.5 REFERENCES -- Chapter 4: System VVT Methods: Non-Testing -- 4.1 INTRODUCTION -- 4.2 PREPARE VVT PRODUCTS -- 4.2.1 Requirements Verification Matrix (RVM).
4.2.2 System Integration Laboratory (SIL) -- 4.2.3 Hierarchical VVT Optimization -- 4.2.4 Defect Management and Tracking -- 4.2.5 Classification Tree Method -- 4.2.6 Design of Experiments (DOE) -- 4.3 PERFORM VVT ACTIVITIES -- 4.3.1 VVT Process Planning -- 4.3.2 Compare Images and Documents -- 4.3.3 Requirements Testability and Quality -- 4.3.4 System Test Simulation -- 4.3.5 Failure Mode Effect Analysis -- 4.3.6 Anticipatory Failure Determination -- 4.3.7 Model-Based Testing -- 4.3.8 Robust Design Analysis -- 4.4 PARTICIPATE IN REVIEWS -- 4.4.1 Expert Team Reviews -- 4.4.2 Formal Technical Reviews -- 4.4.3 Group Evaluation and Decision -- 4.5 REFERENCES -- Chapter 5: Systems VVT Methods: Testing -- 5.1 INTRODUCTION -- 5.2 WHITE BOX TESTING -- 5.2.1 Component and Code Coverage Testing -- 5.2.2 Interface Testing -- 5.3 BLACK BOX-BASIC TESTING -- 5.3.1 Boundary Value Testing -- 5.3.2 Decision Table Testing -- 5.3.3 Finite State Machine Testing -- 5.3.4 Human-System Interface Testing (HSI) -- 5.4 BLACK BOX-HIGH-VOLUME TESTING -- 5.4.1 Automatic Random Testing -- 5.4.2 Performance Testing -- 5.4.3 Recovery Testing -- 5.4.4 Stress Testing -- 5.5 BLACK BOX-SPECIAL TESTING -- 5.5.1 Usability Testing -- 5.5.2 Security Vulnerability Testing -- 5.5.3 Reliability Testing -- 5.5.4 Search-Based Testing -- 5.5.5 Mutation Testing -- 5.6 BLACK BOX-ENVIRONMENT TESTING -- 5.6.1 Environmental Stress Screening (ESS) Testing -- 5.6.2 EMI/EMC Testing -- 5.6.3 Destructive Testing -- 5.6.4 Reactive Testing -- 5.6.5 Temporal Testing -- 5.7 BLACK BOX-PHASE TESTING -- 5.7.1 Sanity Testing -- 5.7.2 Exploratory Testing -- 5.7.3 Regression Testing -- 5.7.4 Component and Subsystem Testing -- 5.7.5 Integration Testing -- 5.7.6 Qualification Testing -- 5.7.7 Acceptance Testing -- 5.7.8 Certification and Accreditation Testing -- 5.7.9 First Article Inspection (FAI).
5.7.10 Production Testing -- 5.7.11 Installation Testing -- 5.7.12 Maintenance Testing -- 5.7.13 Disposal Testing -- 5.8 REFERENCES -- Part III: Modeling and Optimizing VVT Process -- Chapter 6: Modeling Quality Cost, Time and Risk -- 6.1 PURPOSE AND BASIC CONCEPTS -- 6.1.1 Historical Models for Cost of Quality -- 6.1.2 Quantitative Models for Cost/Time of Quality -- 6.2 VVT COST AND RISK MODELING -- 6.2.1 Canonical VVT Cost Modeling -- 6.2.2 Modeling VVT Strategy as a Decision Problem -- 6.2.3 Modeling Appraisal Risk Cost -- 6.2.4 Modeling Impact Risk Cost -- 6.2.5 Modeling Total Quality Cost -- 6.2.6 VVT Cost and Risk Example -- 6.3 VVT TIME AND RISK MODELING -- 6.3.1 System/VVT Network -- 6.3.2 Modeling Time of System/VVT Lifecycle -- 6.3.3 Time and Risk Example -- 6.4 FUZZY VVT COST MODELING -- 6.4.1 Introduction -- 6.4.2 General Fuzzy Logic Modeling -- 6.4.3 Fuzzy Modeling of the VVT Process -- 6.4.4 Fuzzy VVT Cost and Risk Estimation Example -- 6.4.5 Fuzzy Logic Versus Probabilistic Modeling -- 6.5 REFERENCES -- Chapter 7: Obtaining Quality Data and Optimizing VVT Strategy -- 7.1 SYSTEMS' QUALITY COSTS IN THE LITERATURE -- 7.2 OBTAINING SYSTEM QUALITY DATA -- 7.2.1 Quality Data Acquisition -- 7.2.2 Quality Data Aggregation -- 7.3 IAI/LAHAV QUALITY DATA-AN ILLUSTRATION -- 7.3.1 IAI/Lahav Pilot Project -- 7.3.2 Obtaining Raw System and Quality Data -- 7.3.3 Anchor System and Quality Data -- 7.3.4 Generating the VVT Model Database -- 7.4 THE VVT-TOOL -- 7.4.1 Background -- 7.4.2 Tool Availability -- 7.5 VVT COST, TIME AND RISK OPTIMIZATION -- 7.5.1 Optimizing the VVT Process -- 7.5.2 Loss Function Optimization-VVT Cost -- 7.5.3 Weight Optimization-VVT Cost -- 7.5.4 Goal Optimization-VVT Cost -- 7.5.5 Genetic Algorithm Optimization-VVT Time -- 7.5.6 Genetic Multi-Domain Optimization-VVT Cost and Time -- 7.6 REFERENCES.
Chapter 8: Methodology Validation and Examples.
Abstract:
Systems' Verification Validation and Testing (VVT) are carried out throughout systems' lifetimes. Notably, quality-cost expended on performing VVT activities and correcting system defects consumes about half of the overall engineering cost. Verification, Validation and Testing of Engineered Systems provides a comprehensive compendium of VVT activities and corresponding VVT methods for implementation throughout the entire lifecycle of an engineered system. In addition, the book strives to alleviate the fundamental testing conundrum, namely: What should be tested? How should one test? When should one test? And, when should one stop testing? In other words, how should one select a VVT strategy and how it be optimized? The book is organized in three parts: The first part provides introductory material about systems and VVT concepts. This part presents a comprehensive explanation of the role of VVT in the process of engineered systems (Chapter-1). The second part describes 40 systems' development VVT activities (Chapter-2) and 27 systems' post-development activities (Chapter-3). Corresponding to these activities, this part also describes 17 non-testing systems' VVT methods (Chapter-4) and 33 testing systems' methods (Chapter-5). The third part of the book describes ways to model systems' quality cost, time and risk (Chapter-6), as well as ways to acquire quality data and optimize the VVT strategy in the face of funding, time and other resource limitations as well as different business objectives (Chapter-7). Finally, this part describes the methodology used to validate the quality model along with a case study describing a system's quality improvements (Chapter-8). Fundamentally, this book is written with two categories of audience in mind. The first category is composed of VVT practitioners, including Systems, Test, Production and Maintenance
engineers as well as first and second line managers. The second category is composed of students and faculties of Systems, Electrical, Aerospace, Mechanical and Industrial Engineering schools. This book may be fully covered in two to three graduate level semesters; although parts of the book may be covered in one semester. University instructors will most likely use the book to provide engineering students with knowledge about VVT, as well as to give students an introduction to formal modeling and optimization of VVT strategy.
Local Note:
Electronic reproduction. Ann Arbor, Michigan : ProQuest Ebook Central, 2017. Available via World Wide Web. Access may be limited to ProQuest Ebook Central affiliated libraries.
Genre:
Electronic Access:
Click to View