All 64 questions
How do you decide which tests to automate and which to keep manual, especially under tight deadlines?
Asked in 9 of 245 interviews · last asked Oct 18 · Concept · Senior
Show answer
I automate stable, repeatable tests that run often and protect important features. I keep exploratory, usability, and fast-changing tests manual. Under tight deadlines, I test the biggest risks first and automate only where setup and upkeep are worth the time saved. I stop automating a test when its cost outweighs its value.
- Good automation candidates have clear expected results and frequent reuse, such as core regression tests.
- Wait for features to stabilize if frequent changes would cause repeated script updates.
- Keep tests manual when they need human judgment or will rarely run.
- Under tight deadlines, prioritize risk coverage over building new automation.
What the interviewer checks: The interviewer checks whether you balance risk, feature stability, time saved, and maintenance effort.
Common mistake (in 3 of 6 reviewed answers): Many answers forget that fast-changing features may be better tested manually until they stabilize.
Other ways it was asked
- “How do you decide what to automate and what to test manually? What is worth automating?”
- “How do you decide what to automate, what not to automate, and when to stop automating a test?”
- “How do you decide what to automate versus what you keep manual?”
What is the testing pyramid?
Asked in 4 of 245 interviews · last asked Oct 8 · Concept · Junior
Show answer
The testing pyramid is a guide for balancing automated tests. It suggests many unit tests at the base, fewer integration tests in the middle, and a small number of end-to-end tests at the top. API tests often sit in the middle. This balance gives fast feedback while limiting slow, costly tests.
- Unit tests check small pieces of code in isolation.
- Integration tests check that parts work together; API tests often fit here.
- End-to-end tests check complete user flows, often through the user interface.
- The pyramid is a guide, not a fixed ratio; API tests can also be end-to-end.
What the interviewer checks: The interviewer checks whether you can balance test coverage, speed, and maintenance cost.
Other ways it was asked
- “What is the testing pyramid, and what levels does it typically include?”
- “What is the test pyramid, and how does it guide the balance of different types of tests?”
- “What is the testing pyramid and how does API testing fit into it?”
How do you keep automated tests reliable and useful when features, experiments, or feature flags change frequently?
Asked in 2 of 245 interviews · last asked Sep 24 · Scenario · Senior
Other ways it was asked
- “How would you use test automation to keep baseline tests reliable when experiments or feature-flag changes alter the application?”
- “How do you handle situations where automated tests might not provide clear feedback because features are changing often?”
How would you structure a test automation framework, and what changes are needed when transitioning it to AI-based testing?
Asked once · last asked Jul 30 · Design · Senior
Other ways it was asked
- “How would you structure a test automation framework, including its folder structure, and what changes are needed when transitioning it to AI-based testing?”
What are the key components of an automation framework?
Asked once · last asked Sep 11 · Concept · Mid-level
How would you define success metrics for a test automation project?
Asked once · last asked Sep 22 · Scenario · Mid-level
Other ways it was asked
- “How would you define the success of an automation project?”
What business outcome does faster regression testing create?
Asked once · last asked Sep 22 · Scenario · Mid-level
Other ways it was asked
- “What business outcome does faster regression testing translate to?”
How would you design a reliable, high-signal testing framework for a system affected by timing, concurrency, nondeterminism, or external dependencies?
Asked once · last asked Oct 22 · Scenario · Senior
When should you perform a system refresh for a QA environment?
Asked once · last asked Mar 9 · Concept · Mid-level
How do you manage end-to-end testing when an application consists of many services that must be started or kept running?
Asked once · last asked Mar 19 · Scenario · Senior
How do you integrate testing into a CI/CD process, which tools do you use, and how does the process work?
Asked once · last asked Apr 10 · Tooling · Mid-level
How would you approach designing an automated testing strategy, and what factors would you consider?
Asked once · last asked Apr 16 · Behavioral · Senior
Other ways it was asked
- “What was your role in designing an automated testing strategy, how did you approach it, and what did you consider?”
Which metrics are most important for evaluating a test automation suite, and which would you track?
Asked once · last asked Apr 16 · Concept · Mid-level
Other ways it was asked
- “Which metrics are most important for evaluating a test automation suite, and which do you track?”
How would you automate a large workflow involving filling out a form and retrieving information from an email? Would you write one large test or split it into smaller tests?
Asked once · last asked Apr 16 · Scenario · Senior
How would you maintain automated tests for several application versions in parallel, including older and newer versions?
Asked once · last asked Apr 16 · Scenario · Senior
If you had to choose between having no tests and having flaky tests, which would you choose for a system, and why?
Asked once · last asked Apr 17 · Scenario · Senior
Which automated testing tools would you implement for UAT?
Asked once · last asked Apr 18 · Tooling · Mid-level
How would you design an enterprise-level Robot Framework setup for more than 2,000 test cases? What would your approach be?
Asked once · last asked Apr 22 · Design · Senior
If 300 out of 2,000 test cases start failing after a UI release, what would your action plan be?
Asked once · last asked Apr 22 · Scenario · Senior
How would you design and begin building a test automation framework for a flight-booking application?
Asked once · last asked Apr 24 · Design · Mid-level
How would you apply the test pyramid to a project involving Microsoft Dynamics 365 and a companion mobile app?
Asked once · last asked Apr 27 · Scenario · Senior
How should teams assess test flakiness rather than counting a test case as automated after it succeeds once?
Asked once · last asked Apr 28 · Scenario · Mid-level
In a CI pipeline for a production service, what minimum automated test types and gates would you require before allowing a merge to main?
Asked once · last asked May 5 · Scenario · Senior
How would you automate or improve testing processes to increase stability and overall code quality?
Asked once · last asked May 25 · Behavioral · Mid-level
Other ways it was asked
- “How have you automated or improved testing processes to increase stability and overall code quality?”
How would you decide how many environments a team needs and organize the movement of changes through them during frequent releases?
Asked once · last asked May 28 · Behavioral · Mid-level
Other ways it was asked
- “How many environments did your team use, and how did changes move through them during frequent releases?”
If you had to choose between spending more time on automated testing or manual testing for a project, what factors would influence your decision, and why?
Asked once · last asked Jun 8 · Scenario · Mid-level
What proportion of unit, integration, and end-to-end tests should you have?
Asked once · last asked Jun 24 · Concept · Mid-level
How would you evaluate test infrastructure costs and choose solutions to reduce them?
Asked once · last asked Jul 16 · Scenario · Senior
How would you design a test automation strategy to maximize its value?
Asked once · last asked Jul 21 · Design · Senior
How do you calculate test automation coverage?
Asked once · last asked Aug 5 · Concept · Mid-level
How would you build an automation strategy for a large microservices-based application with UI, API, and backend layers?
Asked once · last asked Aug 17 · Design · Senior
How do you design an automation testing framework for a microservices-based application?
Asked once · last asked Aug 17 · Design · Senior
How will you decide which test cases are good candidates for automation?
Asked once · last asked Aug 25 · Scenario · Mid-level
Imagine you join a team and there is no test framework. How would you start building one from scratch?
Asked once · last asked Aug 25 · Design · Senior
How would you design a test strategy to automate cross-validation testing?
Asked once · last asked Sep 4 · Scenario · Mid-level
How would you test an application with multiple business areas and about 100 users when the number of test runners is limited?
Asked once · last asked Sep 8 · Scenario · Senior
You have one preproduction environment, 80% of tests fail because of UI or data changes, and four days for regression. What would you do now, and how would you prevent this situation in the future?
Asked once · last asked Sep 8 · Scenario · Senior
How would you develop and organize automated tests for 100 test cases?
Asked once · last asked Sep 18 · Scenario · Mid-level
How would you implement test automation with Playwright, and what would your tests cover?
Asked once · last asked Sep 21 · Tooling · Mid-level
Other ways it was asked
- “When using Playwright for test automation, what did you personally implement, and what did your tests cover?”
How would you measure the quality of automation compared with manual testing?
Asked once · last asked Sep 22 · Scenario · Mid-level
If you joined a team with no automated tests but already had documented scenarios, how would you approach test automation?
Asked once · last asked Oct 8 · Scenario · Senior
How do you approach manual testing before automating an application?
Asked once · last asked Oct 12 · Scenario · Mid-level
What are the trade-offs between running tests on every code push and running them nightly?
Asked once · last asked Oct 13 · Scenario · Mid-level
Other ways it was asked
- “Why might a team run tests nightly rather than trigger them on every code push?”
- “What constraints can prevent a team from running tests on every code push?”
How would you make end-to-end tests deterministic and stable despite asynchronous callbacks, retries, and out-of-order events? What synchronization or observation mechanism would you use?
Asked once · last asked Oct 13 · Scenario · Senior
What advanced techniques can make a test framework more innovative than sending requests and polling a database, and how would you implement one?
Asked once · last asked Oct 13 · Scenario · Senior
In a CI pipeline, what test types would you run at each stage—pull request, merge to main, and nightly—and how would you set pass/fail gates to balance speed and confidence?
Asked once · last asked Oct 18 · Scenario · Senior
Which levels of testing would you include in CI, and which would you include in CD?
Asked once · last asked Oct 22 · Scenario · Senior
How would you audit an existing Playwright automation suite and propose a plan of action to the client?
Asked once · last asked Oct 22 · Scenario · Senior
What should a client expect from you when you join a project to audit existing test automation?
Asked once · last asked Oct 22 · Scenario · Senior
What guardrails or checks would you add to prevent a user flow from regressing after an interface change?
Asked once · last asked Oct 23 · Scenario · Senior
Where does test automation fit into the QA process?
Asked once · last asked Jan 27 · Concept · Mid-level
What are the differences between manually performing an integration test and automating it?
Asked once · last asked Apr 28 · Concept · Junior
Who should be accountable for keeping automated tests green in every environment?
Asked once · last asked Apr 28 · Scenario · Mid-level
How do you set up a test environment?
Asked once · last asked May 8 · Tooling · Junior
How often should you run end-to-end tests?
Asked once · last asked Jun 24 · Concept · Mid-level
How should automated testing and a dedicated QA team fit into a software development workflow?
Asked once · last asked Jun 25 · Scenario · Mid-level
What would your ideal test pyramid look like for a software project?
Asked once · last asked Jun 25 · Concept · Mid-level
When building a testing pyramid, which test level would you start with?
Asked once · last asked Jul 24 · Scenario · Junior
What do you know about BDD and Cucumber?
Asked once · last asked Sep 17 · Concept · Junior
How do you test code changes across local and intermediate environments?
Asked once · last asked Sep 21 · Scenario · Mid-level
When should end-to-end tests be run during the development and release cycle?
Asked once · last asked Sep 21 · Concept · Mid-level
Why is it important to compare an automated test's output with the expected value?
Asked once · last asked Sep 22 · Concept · Junior
How can test automation improve testing productivity?
Asked once · last asked Sep 22 · Concept · Junior
Why would cost be a success metric for automation?
Asked once · last asked Sep 22 · Concept · Junior
More Manual Testing interview questions
- All Manual Testing interview questions
- Software Testing Basics Interview Questions
- Test Planning and QA Process Interview Questions
- Test Case Design and Exploratory Testing Interview Questions
- Bug Reporting and Defect Management Interview Questions
- Manual Testing Scenarios Interview Questions
- Backend and Data Testing Interview Questions
- Test Metrics and Release Readiness Interview Questions
How this list is made
Every question here was asked by a real interviewer in a real job interview that a candidate ran MeetAssist in. After the call, the interviewer's questions are pulled from the transcript. Practice sessions, tests, exams and anything that was not a job interview are dropped.
Questions are rewritten so they make sense on their own: names of people, employers and clients are removed, and speech-to-text mistakes are fixed. Small talk, logistics and questions about one candidate's own résumé are left out. Rephrasings of the same question are merged, and the count is the number of different interviews it came up in.
The interviews come from candidates who use MeetAssist, so they lean towards software, data and AI roles: the shares describe these interviews, not every Manual Testing interview. Answers to the most asked questions are written and checked by an editor; a "common mistake" is shown only when reviews of real answers in these interviews show it, with the count.
245 interviews, 143 candidates, Jan 2026 to Oct 2026. Updated every month with new interviews.
Or add the Chrome extension