The E2E suite fails on about 30% of runs and developers now ignore it. How do you turn this around?
What the interviewer wants to hear
- Measure: identify which tests fail and why
- Quarantine flaky tests out of the gate with owners and deadlines
- Fix root causes: waits, data, environments, real bugs
- Reduce and push tests down the pyramid
- Protect the gate with policies and visible metrics
Model answer
First I gather data: which tests fail most, how often they pass on rerun, and the error types. Usually a small number of tests cause most failures. I move those out of the blocking gate into a quarantine suite that still runs and reports, and each one gets an owner and a deadline, so the gate becomes green and meaningful quickly. Then I fix root causes by category: fixed sleeps replaced with proper waits, shared data replaced with unique factories, shared environment problems solved with seeded or ephemeral environments, and genuine product race conditions raised as bugs. I also question whether every E2E test is needed and move checks to the API level. Finally I agree on a team policy: new tests must pass many repeated runs before joining the gate, and flake rate is shown on a dashboard so trust is earned back visibly.
Can you answer it under time pressure?
Take a timed hard round and get scored on every answer.
More hard Automation Test Engineer questions
- Design a test automation strategy for a product with 15 microservices, a web app and a mobile app.
- Your regression suite has grown to 3 hours. How do you bring feedback time under 15 minutes?
- What does testing in production mean, and how would you do it safely?
- What is your view on AI-based and self-healing test automation tools in 2026?
- Developers keep changing the UI and breaking your tests. How do you fix this at the team level, not just in your code?
- How do you measure whether your test automation is healthy and worth the investment?
- Your company has 2,000 Selenium tests and wants to move to Playwright. How would you plan the migration?
- How do you design automated tests for an event-driven microservices system where services talk through a message broker?
- Your product adds an AI assistant built on a large language model. Its answers vary between runs. How would you automate testing for it?