Programme launch offer - Save 20% Book Now

EuroSTAR Conference

Europe's Largest Quality Engineering Conference

Keynote K3

Assured LLM-Based Software Test Generation

Mark Harman

09:00 - 10:00 CEST Thursday 5th June

Assured Large Language Model Software Engineering (Assured LLMSE) addresses the twin challenges:

1. Ensuring LLM-generated code does not regress the properties of the original code

2. Quantifying the improvement over the original archived by the improve code in a verifiable and measurable way.

In so doing, the Assured LLMSE approach tackles the problem of LLMs’ tendency to hallucinate, as well as providing confidence that generated code improves an existing code base. This keynote outlines the overall approach to Assured LLMSE, and presents results from its deployment at Meta.

What you will learn

  1. How Assured LLM-based Software Engineering (Assured LLMSE) assures freedom from LLM hallucinations.
  2. How an Assured LLMSE agentic pipeline can generate test cases that follow required coding styles and increase code coverage.
  3. How Meta is using Assured LLMSE to automate test case design.

Session Details

  • All
  • 1 hour
  • Includes 15 mins Q&A
  • Ethical implications of AI
Buy Conference Ticket

Check out this video from Mark Harman to hear more about his talk, ‘Assured LLM-Based Software Test Generation’.

We look forward to welcoming you to EuroSTAR 2025.

Session Speaker

Mark Harman

Mark Harman

Meta, UK

Mark Harman is a full-time Research Scientist at Meta Platforms working on software engineering automation.  He was previously in the Simulation-Based Testing (SBT) team at Meta, which he co-founded.

The SBT team developed and deployed both the Sapienz and WW platforms for client- and server- side testing. Sapienz grew out of Majicke (a start up Mark co-founded) that was acquired by Facebook (now Meta Platforms) in 2017.

The technologies Mark has researched, developed and deployed have been used to test systems of 100s of millions of lines of lines of code, daily relied upon by over 3 billion people for communications, business, social media and community building.

The commercial viability of approximatively 200 million companies worldwide rests on the reliability of these systems, for which this automated testing work plays an important role. Mark is also a part time professor at UCL. In his more purely scientific work, he co-founded the field Search Based Software Engineering (SBSE) in 2001, now the subject of active research in over 40 countries worldwide.

He received the IEEE Harlan Mills Award and the ACM Outstanding Research Award in 2019 for his research work, and was awarded a fellowship of the Royal Academy of Engineering in 2020.

BACK TO PROGRAMME

Ticket Offer

Save 20% on individual tickets until February 28th

Book a group and save even more. The more you bring, the more you save.

Individual

From €1,352

save 20%

BOOK TICKET

Groups

From €1,002

Based on 10 Tickets

Book Group

Stay in the Loop

We want to ensure you never miss important announcements, updates and special offers from EuroSTAR.