Test Automation the Smart Way

► Overview ◄

This is a MasterClass delivered personally by Dorothy Graham (UK)

Dorothy Graham is an internationally recognised leader in software testing.

Many types of test execution tools are available today and yet many organisations don’t achieve the significant benefits that are often promised through automation.

So, what are the secrets to test automation success? Dorothy Graham explains there are no secrets, but the paths to success are not commonly understood. Success depends on how the automation work is managed as well as technical aspects of the automation regime, rather the specific tool that is used. Throwing more resources at the wrong automation approach is not the solution. Working smarter, not harder, is the key to success.

In this one day course, Dorothy will lead you through some of the most important aspects that must be addressed, that will help you decide on smarter approaches that are right for your organisation.

Dorothy Graham

Dorothy is co-author of three books. She co-wrote Software Inspection with Tom Gilb, Software Test Automationwith Mark Fewster and Foundations of Software Testing with Isabel Evans, Erik Van Veenendaal and Rex Black. She originated and co-authored four editions of The CAST Report, detailing Computer-Aided Software Testing tools available in Europe in the 1990s. These were published by Unicom Seminars and Cambridge Market Intelligence.

Dorothy has worked in the area of Software Testing for over 30 years, first for Bell Telephone Laboratories in New Jersey and then with Ferranti Computer Systems in Manchester.

At the EuroSTAR Conference in Barcelona in 1999 she was awarded the IBM European Excellence Award in Software Testing. Dorothy helped to start the British Computer Society's Specialist Interest Group in Software Testing and participated in the development of the Software Component Testing Standard. She was a founder member of the ISEB Software Testing Board. She is a member of the Foundation Syllabus and Glossary Working Parties of the ISTQB.

At STANZ 2006 (Software Testing Australia New Zealand Conference) Dorothy ran a very popular Test Automation workshop.

► Intended For ◄

This course is suitable for those who have had a test execution tool for a number of months or years, but have been disappointed with the results achieved or with the costs of testware maintenance. It is also suitable for those who have recently acquired a test execution tool and want to start off “on the right foot.”

► Prerequisites ◄

While no prior experience is necessary, it is assumed that participants are familiar with the principles of test execution automation at a basic level. For example, they already understand why a simple capture/replay approach alone does not lead to long term success.

► Objectives ◄

By the end of this course participants will understand the strategy for managing successful test automation and will know the basics of a good technical approach to achieve lasting benefits from the use of test execution tools.

► Content ◄

Planning and managing test automation

Achieving good test automation is a journey rather than a destination. Where are you on your current journey? Take the self-assessment test to see what further progress you can make. Many people have unrealistic objectives for test automation – choosing the right objectives is the first step to ensure you are going in the right direction. This session looks at how and what to explore on your journey in order to get the best results for your organisation. Understand the pros and cons of different ways to organise teams of testers and test automators. Everyone wants to achieve good benefits at reasonable cost, but how do you know you have achieved the best results? We conclude this session with some critical attributes and ways to measure them plus a practical and easy measure of benefit.

Scripting techniques

Scripting is often the backbone of test automation. Pros and cons of different scripting techniques are explored with particular emphasis on data-driven, keyword-driven approaches. The more sophisticated scripting methods are not difficult to implement, and can be the key to increased productivity in test automation. Higher level scripting techniques can minimise maintenance and can allow maximum independence from particular tools.

Testware architecture

Knowing where to put things is just as important as knowing where to find them. Having a well organised scheme for storing all the testware artefacts that accumulate, typically in the thousands, is a must for high productivity with test automation. This session considers the main issues that must be addressed and describes a basic approach that can be tailored to suit specific organisational needs.

Pre and post processing

Automating individual test cases is one thing, automating testing is another! The difference between these two things will be explained and an approach to bridging the gap will be covered.

Comparison techniques

Automated test execution is of little use without automated comparison of test results. In this session we will look at different ways of comparing (dynamic and post-execution) and ways to implement them. Test sensitivity is an important consideration in automated comparison. Complex comparions can be achieved through the use of simple filters. Automated test status most usefuly includes more than just pass and fail.

Testware maintenance

Maintenance of automated tests have proven to be the downfall of many test automation efforts. This session describes what the most common problems are and suggests ways in which maintenance effort can be minimised. Concluding advice covers what to automate and what not to automate, automation in agile development and getting the right balance between the many factors involved in successful smart automation.

► Method Used ◄

Interactive classroom discussion.