The full regression suite takes six hours, so the team releases only once a week. How would you get feedback down to under 30 minutes without losing confidence?
What the interviewer wants to hear
- Analyse the suite: duration, failure history, value and duplicate coverage
- Push tests down the pyramid: replace UI tests with API or unit tests where possible
- Parallelise and shard, with isolated data, and speed up setup via APIs and saved login state
- Risk-based and change-based selection for pull requests; full suite nightly
- Remove or merge low-value and flaky tests, and track confidence with escaped defects
Model answer
I would start with data: how long each test takes, how often it finds real bugs and what it covers. Usually a few slow UI tests dominate, and many duplicate each other. I would move checks down the pyramid, verifying business rules through APIs and keeping UI tests for true user journeys. Setup is often the hidden cost, so tests should create data through APIs and reuse a saved login state instead of clicking through forms. Next comes parallel execution and sharding across CI machines, which needs isolated test data. For pull requests I would run a risk-based subset chosen by the code that changed, plus a critical smoke set, and run the full suite nightly and before releases. Finally I would delete or merge low-value and flaky tests and watch escaped defects to make sure confidence did not drop.
Can you answer it under time pressure?
Take a timed hard round and get scored on every answer.
More hard QA Engineer questions
- A critical bug reached production even though QA tested the release. How do you handle it and what do you change afterwards?
- Which quality metrics would you track for a product team, and which would you avoid?
- How would you test an integration with a third-party payment gateway that you do not control?
- Your team finds most bugs late, just before release. How would you shift quality earlier in the process?
- How would you test a feature whose output is not fixed, such as an AI chatbot or a recommendation engine?
- You join a company with no automation. How would you design a UI and API test automation framework that will still be healthy in three years?
- A product is built from 15 microservices owned by different teams. The shared end-to-end environment is slow and often broken. How would you design the testing strategy?
- You are not a penetration tester, but you are the only QA on the team. How do you include security testing in your everyday work?
- How would you design the test strategy for releasing a mobile banking app on iOS and Android every two weeks?