Programme launch offer - Save 20% Book Now

EuroSTAR Conference

Europe's Largest Quality Engineering Conference

Tutorial B

Don’t say Hello to LLM: Dive into the System Under Test

Maryna Didkovska

9:300 - 12:30 CEST, Tuesday 3rd June

This tutorial is designed to demystify the core workings of Large Language Models (LLMs), focusing on the process of converting human language into machine-understandable formats, the key components of neural networks used in LLMs, and their applications in real-world AI systems. Building an efficient testing strategy for AI-infused applications is impossible without a thorough understanding of the system under test.

Participants will dive deep into core components of the flow, such as tokenization, the embedding process, and the transformer block with the self-attention mechanism and MLP. On a practical level, you will see the impact of both good and bad prompts and how they can influence your budgets.

You’ll also need to recall from your university background how to multiply matrices. We will conduct a thorough analysis of the nature of LLMs, revisiting the math under the hood to reveal that there is no magic behind them. There is no “God in the machine,” but rather a complex network of connections, vast amounts of data, and biased datasets driving their behavior.

Finally, we will discuss how to build an effective test strategy for AI-infused applications, those with a natural language layer. The focus will be on testing approaches that are specific to these types of applications, highlighting  their challenges and  limitations.

This session is ideal for professionals with a background in software development, AI, or quality engineering, who are looking to deepen their understanding of LLM architectures and applications.

What you will learn

  1. Learn how LLMs work with input data, break down, process, and generate human language.
  2. Understand key challenges of LLM infused applications and their limitations.
  3. Practical knowledge of testing specific of LLMs infused applications.

Session Details

  • Advanced
  • Half day
  • Interactive Tutorial
  • Implementing/integrating AI tools
Buy Conference Ticket

Check out this video from Maryna Didkovska to hear more about her talk, ‘Don’t say Hello to LLM: dive into the system under test.’

We look forward to welcoming you to EuroSTAR 2025.

Session Speaker

Maryna-Didkovska

Maryna Didkovska

EPAM, Ukraine

Maryna Didkovska is a Quality Engineering Director at EPAM Systems. As a Test Manager and Quality architect  Maryna has managed teams to build scalable testing process on a projects with over 600 participants, develop testing ecosystems on Enterprise level and coached others be experts and leaders.

Having academical background in AI domain, she leverages theory with hands-on experience  to interact with teams to improve software quality and drive digital transformations. Maryna is a regular speaker at conferences such as STAREAST, SEETEST, EUROSTAR etc, covering a variety of testing topics.

Maryna is passionate about making quality improvements process transparent and trackable.

BACK TO PROGRAMME

Ticket Offer

Save 20% on individual tickets until February 28th

Book a group and save even more. The more you bring, the more you save.

Individual

From €1,352

save 20%

BOOK TICKET

Groups

From €1,002

Based on 10 Tickets

Book Group

Stay in the Loop

We want to ensure you never miss important announcements, updates and special offers from EuroSTAR.