Certified Tester Test Automation Engineer (CT-TAE)
Table of Contents
Revision History ............................................................................................................................................ 3
Table of Contents.......................................................................................................................................... 4
Acknowledgements ....................................................................................................................................... 6
0. Introduction to this Syllabus ................................................................................................................. 7
0.1 Purpose of this Document ........................................................................................................... 7
This syllabus forms the basis for the International Software Testing Qualification at the Advanced Level for Test Automation - Engineering. The ISTQB provides this syllabus as follows:
To Member Boards, to translate into their local language and to accredit training providers. National boards may adapt the syllabus to their particular language needs and modify the references to adapt to their local publications.
To Exam Boards, to derive examination questions in their local language adapted to the learning objectives for each module.
To training providers, to produce courseware and determine appropriate teaching methods.
To certification candidates, to prepare for the exam (as part of a training course or independently).
To the international software and system engineering community, to advance the profession of software and system testing, and as a basis for books and articles.
The ISTQB may allow other entities to use this syllabus for other purposes, provided they seek and obtain prior written permission.
0.2 Scope of this Document............................................................................................................... 7
0.2.1 In Scope ..................................................................................................................................7
This document describes the tasks of a test automation engineer (TAE) in designing, developing, and maintaining test automation solutions. It focuses on the concepts, methods, tools, and processes for automating dynamic functional tests and the relationship of those tests to test management, configuration management, defect management, software development processes and quality assurance.
Methods described are generally applicable across variety of software lifecycle approaches (e.g., agile, sequential, incremental, iterative), types of software systems (e.g., embedded, distributed, mobile) and test types (functional and non-functional testing).
0.2.2 Out of Scope............................................................................................................................ 7
The following aspects are out of scope for this Test Automation – Engineering syllabus:
Test management, automated creation of test specifications and automated test generation.
Tasks of test automation manager (TAM) in planning, supervising and adjusting the development and evolution of test automation solutions. Specifics of automating non-functional tests (e.g., performance). Automation of static analysis (e.g., vulnerability analysis) and static test tools.
Teaching of software engineering methods and programming (e.g., which standards to use and which skills to have for realizing a test automation solution).
Teaching of software technologies (e.g., which scripting techniques to use for implementing a test automation solution).
Selection of software testing products and services (e.g., which products and services to use for a test automation solution).
0.3 The Certified Tester Advanced Level Test Automation Engineer ............................................... 8
0.3.1 Expectations ............................................................................................................................ 8
0.3.2 Entry and Renewal Requirements........................................................................................... 8
0.3.3 Level of Knowledge ................................................................................................................. 8
0.3.4 Examination............................................................................................................................. 8
0.3.5 Accreditation............................................................................................................................ 8
0.4 Normative versus Informative Parts ............................................................................................ 9
0.5 Level of Detail .............................................................................................................................. 9
0.6 How this Syllabus is Organized ...................................................................................................9
0.7 Terms, Definitions and Acronyms................................................................................................ 9
1. Introduction and Objectives for Test Automation - 30 mins. .............................................................. 11
1.1 Purpose of Test Automation ......................................................................................................12
1.2 Success Factors in Test Automation .........................................................................................13
2. Preparing for Test Automation - 165 mins. ........................................................................................ 16
2.1 SUT Factors Influencing Test Automation.................................................................................17
2.2 Tool Evaluation and Selection ...................................................................................................18
2.3 Design for Testability and Automation.......................................................................................20
3. The Generic Test Automation Architecture - 270 mins. ..................................................................... 22
3.1 Introduction to gTAA..................................................................................................................23
3.1.1 Overview of the gTAA ...........................................................................................................24
3.1.2 Test Generation Layer...........................................................................................................26
3.1.3 Test Definition Layer .............................................................................................................26
3.1.4 Test Execution Layer.............................................................................................................26
3.1.5 Test Adaptation Layer ...........................................................................................................27
3.1.6 Configuration Management of a TAS....................................................................................27
3.1.7 Project Management of a TAS .............................................................................................. 27
3.1.8 TAS Support for Test Management.......................................................................................27
3.2 TAA Design................................................................................................................................ 28
3.2.1 Introduction to TAA Design ...................................................................................................28
3.2.2 Approaches for Automating Test Cases ...............................................................................31
3.2.3 Technical considerations of the SUT ....................................................................................36
3.2.4 Considerations for Development/QA Processes...................................................................37
3.3 TAS Development......................................................................................................................38
3.3.1 Introduction to TAS Development .........................................................................................38
3.3.2 Compatibility between the TAS and the SUT........................................................................39
3.3.3 Synchronization between TAS and SUT...............................................................................40
3.3.4 Building Reuse into the TAS .................................................................................................42
3.3.5 Support for a Variety of Target Systems ...............................................................................43
4 Deployment Risks and Contingencies - 150 mins.............................................................................. 44
4.1 Selection of Test Automation Approach and Planning of Deployment/Rollout .........................45
4.1.1 Pilot Project ...........................................................................................................................45
4.1.2 Deployment ...........................................................................................................................46
4.1.3 Deployment of the TAS Within the Software Lifecycle..........................................................47
4.2 Risk Assessment and Mitigation Strategies ..............................................................................47
4.3 Test Automation Maintenance...................................................................................................49
4.3.1 Types of Maintenance ...........................................................................................................49
4.3.2 Scope and Approach.............................................................................................................49
5 Test Automation Reporting and Metrics - 165 mins........................................................................... 52
5.1 Selection of TAS Metrics ...........................................................................................................53
5.2 Implementation of Measurement ............................................................................................... 56
5.3 Logging of the TAS and the SUT......................................................................................................57
5.4 Test Automation Reporting........................................................................................................58
6 Transitioning Manual Testing to an Automated Environment - 120 mins. ......................................... 60
6.1 Criteria for Automation...............................................................................................................61
6.2 Identify Steps Needed to Implement Automation within Regression Testing............................65
6.3 Factors to Consider when Implementing Automation within New Feature Testing...................67
6.4 Factors to Consider when Implementing Automation of Confirmation Testing .........................68
7 Verifying the TAS - 120 mins.............................................................................................................. 69
7.1 Verifying Automated Test Environment Components ............................................................... 70
7.2 Verifying the Automated Test Suite ...........................................................................................72
8 Continuous Improvement - 150 mins. ................................................................................................ 74
8.1 Options for Improving Test Automation .....................................................................................75
8.2 Planning the Implementation of Test Automation Improvement................................................77
9 References ......................................................................................................................................... 79
9.1 Standards...................................................................................................................................79
9.2 ISTQB Documents.....................................................................................................................80
9.3 Trademarks................................................................................................................................ 80
9.4 Books .........................................................................................................................................80
9.5 Web References ........................................................................................................................81
10 Notice to Training Providers ............................................................................................................... 82
10.1 Training Times ...........................................................................................................................82
10.2 Practical Exercises in the Workplace ........................................................................................82
10.3 Rules for e-Learning ..................................................................................................................82
11 Index...................................................................................................................................................