EuroSTAR Conference

Europe's Best Software Testing Conference

Track Talk F9

The Rollercoaster Ride of Load Testing an AV Platform with 350K Users

Vimmi Walia

Yogesh Bawa

10:00-10:45 CEST Friday 10th June

Due to the COVID pandemic, the software industry is drastically transforming to service this new era of digitization by focusing on innovation and value driven agility. QA practices, test approaches and skillsets need to be aligned and upgraded so that we are ready for the newer challenges in testing. The client still needs delivery with quality, but now within strict budget constraints.

In this talk we will present a recent journey of carrying out performance testing on a complex use case of an audio video streaming platform. The test was to be executed with a load of 350K users within a limited budget. Hence, we had to opt for open-source tool, look for cost effective test infrastructure and develop a couple in-house utilities. The focus area for performance was not only overall performance of the system but also on monitoring the quality of audio video streaming when 350K users are live in the application joining different conferences running in parallel.

A varied technology stack was used like JMeter for load test, AWS for test infra to host load generator machines, Selenium with JMeter for simulating user actions like mute/unmute, share screen, turn on/off audio video streaming, Jenkins for creating a CI CD pipleline and to deploy the necessary components, trigger the test on all the created load agents, Terraform using AMIs for scale up and scale down test infrastructure, Influx DB to store the KPI’s related to audio video streaming as a time series data and grafana for report visualization. Along with that created a couple of in-house utilities for extracting the webrtc stats to present the streaming, utilities to push test data to different load agents and collect back the data and prepare a meaningful report from all the data from all the machines

This implementation was an experience packed with lots of challenges not limited to following:

  • Spawning and managing AWS instances from different regions.
  • Supplying data to all JMeter containers in parallel.
  • Storing stats from JMeter containers simultaneously in different S3 buckets.
  • Real Time monitoring for infrastructure along with data collation for results preparation.
  • Configuring S3 for collecting stats from JMeter containers simultaneously.
  • Building date-based folders in S3 buckets using terraform scripts.
  • Utility setup for WebRTC stats collation for data obtained from 300K users.

 

In this talk we will discuss these challenges and how we overcame them.

What you will learn

  1. Understanding the technical consideration while designing performance scripts of AV platform to depict real time user behavior like screen sharing, mute/unmute, stream audio/video
  2. How to overcome the challenges faced while self-managing a huge test infrastructure to support large user load
  3. Insights on the importance of devops concepts in the life of QA by understanding the practical examples of using these concepts in setting up a huge test infrastructure

Session Details

  • Intermediate
  • 45 Minutes
  • Includes 15mins Q&A
  • Approaches, Techniques & Types of Testing
Buy Conference Ticket

Vimmi & Anjali share more about their talk, ‘The Rollercoaster Ride of Load Testing an AV Platform with 350K Users’.

We look forward to welcoming you to EuroSTAR 2022.

Session Speaker

Vimmi Walia EuroSTAR 2022 Speaker

Vimmi Walia

Principal QA Consultant – Nagarro, India

A seasoned technologist, and a continuous learner, Vimmi has more than 14 years of experience in software engineering. She is leading Centre of Testing Excellence and working as head of Emerging QA practice at Nagarro. A passionate QA, blogger, trainer, speaker, Vimmi is dynamic, self-motivated leader and believes in delivering value driven software quality. She has deep knowledge and experience in Performance Testing, Test Automation, DevOps and proven QA delivery experience in different SDLC models like Agile, V model, waterfall. She is passionate about community driven learning specially in the area of technology. She is leading the local chapter for Ministry of Testing, esteemed member on advisory board for CPSAT and active speaker with QA communities like STeP-IN, QAI STC, AgileTestingAlliance.

Session Co-Speaker

Yogesh Bawa

Yogesh Bawa

Performance Engineering Consultant – Nagarro, India

Yogesh Bawa is a Performance Engineering Consultant at Nagarro with 10+ years of experience.

He has extensive expertise in providing innovative solutions for challenging and complex problems in Performance Engineering domain. He is passionate about exploring new tools and technologies. He loves to mentor and conduct performance testing knowledge sessions. Yogesh likes to drive and explore hidden places. He spends his free time by listening to folk music.

BACK TO PROGRAMME

Early Bird Offer

Get the best priced tickets for EuroSTAR 2024. Book by 21st April

Book a group and save even more. Teams save up to 35% with this offer.

Individual

From €1,790

Save 10%

BOOK TICKET

Groups

From €1,519

Based on 10 Tickets

Book Group

Stay in the Loop

We want to ensure you never miss important announcements, updates and special offers from EuroSTAR.