Certified Tester Test Automation Engineer (CT-TAE)

Table of Contents 

Revision History ............................................................................................................................................ 3 

Table of Contents.......................................................................................................................................... 4 

Acknowledgements ....................................................................................................................................... 6 

0. Introduction to this Syllabus ................................................................................................................. 7 

0.1 Purpose of this Document ........................................................................................................... 7 

This syllabus forms the basis for the International Software Testing Qualification at the Advanced Level for Test Automation - Engineering. The ISTQB provides this syllabus as follows: 


The ISTQB may allow other entities to use this syllabus for other purposes, provided they seek and obtain prior written permission. 


0.2 Scope of this Document............................................................................................................... 7 

0.2.1 In Scope ..................................................................................................................................7 


0.2.2 Out of Scope............................................................................................................................ 7 


0.3 The Certified Tester Advanced Level Test Automation Engineer ............................................... 8 

0.3.1 Expectations ............................................................................................................................ 8 

0.3.2 Entry and Renewal Requirements........................................................................................... 8 

0.3.3 Level of Knowledge ................................................................................................................. 8 

0.3.4 Examination............................................................................................................................. 8 

0.3.5 Accreditation............................................................................................................................ 8 

0.4 Normative versus Informative Parts ............................................................................................ 9 

0.5 Level of Detail .............................................................................................................................. 9 

0.6 How this Syllabus is Organized ...................................................................................................9 

0.7 Terms, Definitions and Acronyms................................................................................................ 9 

1. Introduction and Objectives for Test Automation - 30 mins. .............................................................. 11 

1.1 Purpose of Test Automation ......................................................................................................12 

1.2 Success Factors in Test Automation .........................................................................................13 

2. Preparing for Test Automation - 165 mins. ........................................................................................ 16 

2.1 SUT Factors Influencing Test Automation.................................................................................17 

2.2 Tool Evaluation and Selection ...................................................................................................18 

2.3 Design for Testability and Automation.......................................................................................20 

3. The Generic Test Automation Architecture - 270 mins. ..................................................................... 22 

3.1 Introduction to gTAA..................................................................................................................23 

3.1.1 Overview of the gTAA ...........................................................................................................24 

3.1.2 Test Generation Layer...........................................................................................................26 

3.1.3 Test Definition Layer .............................................................................................................26 

3.1.4 Test Execution Layer.............................................................................................................26 

3.1.5 Test Adaptation Layer ...........................................................................................................27 

3.1.6 Configuration Management of a TAS....................................................................................27 

3.1.7 Project Management of a TAS .............................................................................................. 27 

3.1.8 TAS Support for Test Management.......................................................................................27 

3.2 TAA Design................................................................................................................................ 28 

3.2.1 Introduction to TAA Design ...................................................................................................28 

3.2.2 Approaches for Automating Test Cases ...............................................................................31 

3.2.3 Technical considerations of the SUT ....................................................................................36 

3.2.4 Considerations for Development/QA Processes...................................................................37 

3.3 TAS Development......................................................................................................................38 

3.3.1 Introduction to TAS Development .........................................................................................38 

3.3.2 Compatibility between the TAS and the SUT........................................................................39 

3.3.3 Synchronization between TAS and SUT...............................................................................40 

3.3.4 Building Reuse into the TAS .................................................................................................42 

3.3.5 Support for a Variety of Target Systems ...............................................................................43 

4 Deployment Risks and Contingencies - 150 mins.............................................................................. 44 

4.1 Selection of Test Automation Approach and Planning of Deployment/Rollout .........................45 

4.1.1 Pilot Project ...........................................................................................................................45 

4.1.2 Deployment ...........................................................................................................................46 

4.1.3 Deployment of the TAS Within the Software Lifecycle..........................................................47 

4.2 Risk Assessment and Mitigation Strategies ..............................................................................47 

4.3 Test Automation Maintenance...................................................................................................49 

4.3.1 Types of Maintenance ...........................................................................................................49 

4.3.2 Scope and Approach.............................................................................................................49 

5 Test Automation Reporting and Metrics - 165 mins........................................................................... 52 

5.1 Selection of TAS Metrics ...........................................................................................................53 

5.2 Implementation of Measurement ............................................................................................... 56 

5.3 Logging of the TAS and the SUT......................................................................................................57 

5.4 Test Automation Reporting........................................................................................................58 

6 Transitioning Manual Testing to an Automated Environment - 120 mins. ......................................... 60 

6.1 Criteria for Automation...............................................................................................................61 

6.2 Identify Steps Needed to Implement Automation within Regression Testing............................65 

6.3 Factors to Consider when Implementing Automation within New Feature Testing...................67 

6.4 Factors to Consider when Implementing Automation of Confirmation Testing .........................68 

7 Verifying the TAS - 120 mins.............................................................................................................. 69 

7.1 Verifying Automated Test Environment Components ............................................................... 70 

7.2 Verifying the Automated Test Suite ...........................................................................................72 

8 Continuous Improvement - 150 mins. ................................................................................................ 74 

8.1 Options for Improving Test Automation .....................................................................................75 

8.2 Planning the Implementation of Test Automation Improvement................................................77 

9 References ......................................................................................................................................... 79 

9.1 Standards...................................................................................................................................79 

9.2 ISTQB Documents.....................................................................................................................80 

9.3 Trademarks................................................................................................................................ 80 

9.4 Books .........................................................................................................................................80 

9.5 Web References ........................................................................................................................81 

10 Notice to Training Providers ............................................................................................................... 82 

10.1 Training Times ...........................................................................................................................82 

10.2 Practical Exercises in the Workplace ........................................................................................82 

10.3 Rules for e-Learning ..................................................................................................................82 

11 Index...................................................................................................................................................