GUI testing: from developing scripts to creating AI-enabled agents

Keynote 5     Start Time : 12:00     End Time : 13:00

A scriptless testing approach can automate test generation for event-based Systems Under Test (SUT) without the need of previously developed or recorded test scripts. The only thing that is needed is sufficient information about the characteristics of the states of the SUT and what actions or events the SUT expects in a specific state. Knowing this, we can test the SUT fully automatically, without any other previously defined test cases. This is due to the agents that implement various action selection mechanisms and test oracles.

The underlying principles are very simple: generate test sequences of (state,action)-pairs by starting up the System Under Test (SUT) in its initial state and continuously select an action to bring the SUT into another state. The action selection characterises the most basic problem of intelligent systems: what to do next. The difficult part is optimising the action selection to find faults and recognising a faulty state when it is found. Faulty states are not restricted to errors in functionality. Violations of other quality characteristics, like accessibility or security, could be also be detected by inspecting the state.

In this keynote we will explain what script less testing is and how we can define more intelligent action selection algorithms using Machine Learning. We will show how this will totally shifts the paradigm of event-based testing; from developing scripts to developing intelligent AI-enabled agents.

Key Takeaways:

  1. How scriptless testing works.
  2. How AI is used to make scriptless testing more intelligent.
  3. What is means to shift the paradigm from developing scripts to developing intelligent AI-enabled agents


Back to Programme


  • Speaker

  • Tanja Vos


    Tanja Vos - Professor, Open University , Netherlands

    Tanja E.J. Vos is a full professor at the Open University (Netherlands) and an associate professor at the Universitat Politècnica de València (Spain). For over 20 years she has been teaching and researching in the area of software testing. She has worked with many companies on automated testing projects in an industrial setting. She is currently project lead for the approach for automated testing at the Graphical User Interface level. Tanja has successfully coordinated EU-funded projects (FITTEST, EvoTest) related to software testing and has been involved in various Erasmus and Leonardo initiatives that try to help business understand academia and vice versa.

    She started the Software Testing Innovation Alliance in Spain and is now involved in the European Alliance. She is part of the Dutch consortium of the ITEA TESTOMAT ( and IVVES ( projects researching and developing the next level of test automation including AI. She is part of the Spanish consortium in the H2020 DECODER project ( and the iv4XR project (

<< previous next >>