What should I focus on for an automation testing interview?
Can I explain what is worth automating?
Choosing which tests to automate and which to keep manual was the most asked question in these interviews. It appeared in 10 of 109 interviews. Check whether you can explain your choices, not just define automation.
- Which tests would you automate, and which would you keep manual?
- How would you estimate the effort and time needed to automate a set of test scenarios?
- How would you measure success and explain the business value of automation?
Can I walk through a framework from start to finish?
Framework design appeared in 37 of 109 interviews. Questions covered framework structure, reusable code, and patterns such as Page Object Model. Can you explain how you would implement the pattern, rather than just describe it?
Connect the components, rather than just naming them. In 3 of 5 reviewed answers to the maintainable-framework question, candidates did not explain how components work together through setup, test execution, teardown, and reporting.
- Can you follow a test through that full flow?
- Can you explain what each component does along the way?
- Which code would you reuse across tests?
Can I explain tool choices and timing issues?
Questions asked about Playwright's advantages over Selenium, as well as locators, fixtures, browser contexts, and configuration. Can you explain the trade-offs in your Playwright framework structure?
For Selenium, can you name the waits it supports and explain when you would choose explicit waits over implicit waits? For Playwright, can you explain how you would debug a test and handle asynchronous actions?
Can I write the small coding tasks too?
Coding tasks appeared in 8 of 109 interviews. Check whether you can write code for these recorded tasks, not just describe the steps:
- Upload a file with Playwright.
- Read test data from Excel or CSV using Python.
- Make a helper reusable across tests that use different values.
- Use Playwright to click a button.
Can I investigate failures and keep tests reliable?
Can you explain how you would identify, measure, and fix flaky tests while separating them from real defects? Questions also covered unstable selectors, timing issues, and tests that behave differently locally and in CI.
Check the wider workflow too:
- How would you keep test data isolated during parallel runs?
- How would test results control whether a release can proceed?
- What risks arise when AI generates tests, and how would you validate those tests and limit the risks?
Who gets asked Automation Testing
The 20 most asked Automation Testing questions
Counted by interview, not by mention: a question asked twice in one conversation counts once.
How do you decide which tests to automate and which to keep manual?
Asked in 10 of 109 interviews · last asked Oct 18 · Concept · Senior
Show answer
I automate tests that run often, cover important risks, and have clear expected results. I compare the time saved and faster feedback with the cost of building and maintaining them. I keep exploratory, usability, and rarely repeated checks manual when automation adds little value. I retire or rework automated tests when their upkeep outweighs their value.
- Prioritize repeatable regression checks for critical features.
- Choose tests with reliable setup, controlled data, and clear pass or fail results.
- Use manual testing where human judgment matters or requirements change often.
- Review slow, flaky, or duplicate tests; fix useful coverage rather than simply removing it.
What the interviewer checks: The interviewer wants to see whether you balance risk, repeatability, human judgment, and maintenance cost.
Other ways it was asked
- “How do you decide what to automate and what to test manually? What is worth automating?”
- “How do you decide what to automate, what not to automate, and when to stop automating a test?”
- “How do you decide what to automate versus what you keep manual?”
What is the Page Object Model, and how would you implement it in an automation framework?
Asked in 9 of 109 interviews · last asked Oct 24 · Concept · Mid-level
Show answer
The Page Object Model is a design pattern that separates page interactions from test logic. I create a class for each page, keep its locators there, and expose methods for actions such as login. Tests call these methods and check results. I use it to reduce repeated code and make UI changes easier to handle.
- Pass the browser driver into page objects so they use the test's browser session.
- Keep locators, page actions, and waits inside page objects.
- Keep test assertions in tests; page objects can check that the expected page loaded.
- Use reusable component objects for shared UI parts, such as navigation menus.
What the interviewer checks: The interviewer checks whether you can separate UI details from test intent and build maintainable tests.
Other ways it was asked
- “What is the Page Object Model, and when would you use it?”
- “What is the Page Object Model, and how have you used it in test automation?”
- “What is the Page Object Model, and how do you use it in test automation?”
What are the advantages of Playwright over Selenium?
Asked in 8 of 109 interviews · last asked Oct 22 · Concept · Mid-level
Show answer
Playwright offers built-in automatic waits, retrying assertions, network mocking, and detailed test traces. These features reduce setup and help prevent timing-related failures. Its lightweight browser contexts make isolated tests easier and can speed up execution. Selenium supports more languages and browser configurations, so Playwright is not always the better choice.
- Playwright waits for elements to be ready before actions; Selenium usually needs more explicit wait handling.
- Browser contexts isolate cookies and storage without starting a new browser for every test.
- Network mocking and traces help test failures and debug problems without extra tools.
- Playwright supports Chromium, Firefox, and WebKit; WebKit testing is not the same as testing real Safari.
What the interviewer checks: The interviewer checks whether you understand Playwright’s practical benefits without claiming it is always faster or better.
Other ways it was asked
- “What are the advantages of Playwright compared with Selenium or Cypress?”
- “Why might Playwright be more convenient and faster than Selenium?”
- “What is the difference between Selenium and Playwright?”
How would you structure a maintainable test automation framework, and what components would you include?
Asked in 7 of 109 interviews · last asked Oct 8 · Design · Mid-level
Show answer
I would separate test cases from page objects or API clients, test data, configuration, and shared helpers. A test runner would manage execution, with fixtures for setup and teardown. Setup creates the required state, tests perform actions and check results, and teardown cleans up even after failures. Reports capture results and failure evidence, and CI runs the suite automatically.
- Keep test intent and assertions clear; hide UI selectors and request details in reusable components.
- Keep environment settings separate from test logic, and store secrets securely.
- Make tests independent, with controlled data and reliable cleanup.
- Include logs, screenshots where useful, and reports that help explain failures.
What the interviewer checks: The interviewer checks whether you can design clear components that work together and stay easy to maintain.
Common mistake (in 3 of 5 reviewed answers): Many answers forget that the components must work together through setup, test execution, teardown, and reporting.
Other ways it was asked
- “How would you create a new test automation framework?”
- “Can you describe the structure and key components of an automation testing framework?”
- “How is a test automation framework typically structured?”
How do you identify, measure, and fix flaky tests while distinguishing them from real defects?
Asked in 6 of 109 interviews · last asked Oct 18 · Scenario · Senior
Show answer
I identify flaky tests by checking results across repeated runs with unchanged code and inputs. I measure inconsistent results over time, not just one successful run. I compare logs, screenshots, timing, and environment details to separate test problems from real product defects. I fix the cause and confirm stability with repeated runs.
- Track first-run failures and retry passes; retries can hide failures.
- Check shared data, test order, timing, and environment differences.
- An intermittent failure can be a real product defect; investigate before blaming the test.
- Replace fixed sleeps with condition-based waits, isolate test data, and assign owners to temporarily quarantined tests.
What the interviewer checks: The interviewer checks whether you measure reliability, investigate causes, and fix tests without hiding product defects.
Other ways it was asked
- “How do you handle flaky tests?”
- “How do you identify and handle flaky tests, and what do you do when you find one?”
- “How would you diagnose and stabilize flaky tests that pass inconsistently?”
How would you structure a maintainable Playwright framework, and what trade-offs would you consider?
Asked in 5 of 109 interviews · last asked Oct 24 · Design · Senior
Show answer
I would separate tests, page or component objects, fixtures, and test data, with shared settings in Playwright config. Tests would describe user behavior, while small helpers handle repeated steps. I would keep tests independent and use stable locators, balancing code reuse against extra layers that make failures harder to understand.
- Use role or test ID locators and auto-retrying assertions; avoid fixed waits.
- Use fixtures for setup and cleanup; keep each test's data separate.
- Parallel runs save time, but shared accounts or data can cause conflicts.
- Collect traces for CI failures, and investigate flaky tests instead of relying on retries.
What the interviewer checks: The interviewer checks whether you can balance reuse, readability, test isolation, speed, and easy debugging.
Other ways it was asked
- “How would you structure a Playwright test automation framework, and what are the trade-offs of that structure?”
- “What would you improve in an existing Playwright test automation framework if you were rebuilding it from scratch?”
- “How is your JavaScript Playwright automation framework structured?”
What waits does Selenium support, and when would you choose explicit waits over implicit waits?
Asked in 4 of 109 interviews · last asked Oct 22 · Concept · Mid-level
Show answer
Selenium supports implicit and explicit waits. An implicit wait sets how long element searches can retry before failing. An explicit wait waits for a specific condition, such as visibility or clickability. I choose explicit waits for dynamic pages because an element may exist but not yet be ready to use.
- Implicit waits apply across the session; explicit waits target specific conditions.
- In Java, FluentWait supports explicit waits with custom polling intervals and ignored exceptions.
- Avoid mixing implicit and explicit waits; this can cause unexpected delays.
- Playwright automatically checks action readiness before actions; its web-first assertions also retry.
What the interviewer checks: The interviewer checks whether you can handle timing issues without fixed sleeps or unreliable element checks.
Other ways it was asked
- “Can you explain the difference between explicit wait and implicit wait?”
- “What types of waits are available in Selenium?”
- “Which wait is better in Selenium: implicit wait or explicit wait?”
What mistakes and risks arise when AI generates automated tests, and how would you limit them?
Asked in 4 of 109 interviews · last asked Oct 8 · Scenario · Mid-level
Show answer
AI can generate tests with wrong assertions, made-up APIs, missed edge cases, or flaky timing. Public AI tools can also expose private code and data. I review tests against requirements, run them, and use only approved tools with safe inputs. I write tests manually when complex rules or high risks make checking AI output harder than writing it.
- A passing test proves little if its expected result is wrong or it checks the wrong behavior.
- Check generated APIs, test data, cleanup, and waits to prevent broken or flaky tests.
- Review coverage against requirements, including failure paths and edge cases.
- Never send secrets or customer data to public AI; follow company policy for code sharing.
What the interviewer checks: The interviewer checks whether you can spot unreliable tests, protect company data, and choose when human judgment is needed.
Other ways it was asked
- “What challenges have you encountered when integrating AI with Playwright to create tests, how did you address them, and what safeguards do you use to limit errors and hallucinations?”
- “What are the main risks and limitations of using a public AI in commercial test automation?”
- “What mistakes does AI commonly make when generating tests, and which are most disruptive to a tester's work?”
How would you estimate the effort and time needed to automate a set of test scenarios?
Asked in 3 of 109 interviews · last asked Oct 8 · Scenario · Senior
Show answer
I group scenarios by complexity and estimate the work for each group. I automate a small sample to check those estimates, including test data, setup, coding, debugging, and review. I account for reusable framework features, dependencies, and team availability, then give a time range with clear assumptions and a buffer for unknowns.
- Check which scenarios are suitable for automation before estimating.
- Include framework changes, test data, environment setup, and CI integration where needed.
- Use sample results or past work, not one fixed time per scenario.
- Separate total work hours from calendar time; waiting and parallel work affect delivery.
What the interviewer checks: The interviewer checks whether you can build a realistic estimate rather than guess from the scenario count.
Other ways it was asked
- “How do you estimate the effort required to automate a user story?”
- “How do you estimate the effort required to automate a given user story?”
- “How do you estimate automation effort for a user story in an Agile sprint?”
How do you debug Playwright tests and handle asynchronous test execution?
Asked in 3 of 109 interviews · last asked Jul 22 · Tooling · Mid-level
Show answer
I debug Playwright tests with the Inspector, breakpoints, and Trace Viewer to inspect actions, errors, and page state. In JavaScript and TypeScript, I await browser actions and web assertions so steps finish in order. I use Playwright’s automatic waiting instead of fixed delays, and keep parallel tests independent.
- Run with --debug to open the Inspector; record traces to investigate failures after execution.
- Await promise-returning calls, including actions and retrying assertions; synchronous code does not need await.
- Playwright Test runs files in parallel workers by default; tests within each file run sequentially.
- Use fullyParallel for parallel tests within files; avoid shared accounts or data that tests could change.
What the interviewer checks: The interviewer checks whether you can investigate failures, handle asynchronous steps correctly, and run tests safely in parallel.
Other ways it was asked
- “How do you work with synchronous and asynchronous code in Playwright tests?”
- “How do you run tests in parallel in Playwright?”
What are workers used for in Playwright?
Asked in 3 of 109 interviews · last asked Oct 10 · Concept · Mid-level
Show answer
Workers in Playwright Test are separate processes that run tests in parallel to reduce total test time. Each worker runs its own browser instance. You can set the worker count to control how many run at once.
- Test files run in parallel by default; tests within one file run sequentially unless configured otherwise.
- Workers do not share in-memory variables.
- Each test gets a fresh browser context by default, even when tests share a worker.
- Too many workers can overload your machine or the application under test.
What the interviewer checks: The interviewer is checking whether you understand parallel test execution, test isolation, and resource limits.
Other ways it was asked
- “What are Playwright workers?”
- “What is Playwright used for?”
What are end-to-end tests?
Asked in 3 of 109 interviews · last asked Sep 21 · Concept · Junior
Show answer
End-to-end tests check a complete user workflow across the application and its connected systems. I use them for critical flows, such as signing in or placing an order, in a production-like test environment. I keep the suite focused because these tests are slower and harder to maintain than unit tests.
- Check the final business result, not just whether each action succeeds.
- Use controlled test data and clean up changes so tests do not affect each other.
- They complement unit and integration tests; they do not replace them.
- They can run through a user interface or API, depending on the workflow.
What the interviewer checks: The interviewer wants to know whether you understand full-workflow testing, when to use it, and its costs.
Other ways it was asked
- “What are end-to-end tests, and when should you use them?”
- “How do you implement end-to-end tests in code?”
How would you investigate automated tests that pass locally but fail in CI or cloud environments?
Asked in 3 of 109 interviews · last asked Sep 1 · Scenario · Mid-level
Show answer
I would inspect CI logs, screenshots, and error messages, then compare the local and CI setups. Using the same staging site does not mean browsers, permissions, network access, or test data are identical. I would reproduce the failure with CI settings and change one factor at a time to isolate the cause.
- Compare code revisions, dependencies, browser versions, headless mode, screen size, and environment variables.
- Check network access, credentials, permissions, and machine resources.
- Look for shared test data, test order, and parallel execution conflicts.
- Check for missing waits; use condition-based waits rather than fixed sleeps or retries that hide failures.
What the interviewer checks: The interviewer is checking whether you use evidence to separate application bugs, test problems, and environment differences.
Other ways it was asked
- “A test passes locally but fails in CI or the cloud while running against staging in both environments. What could cause this?”
- “If your automation is stable locally but fails intermittently in CI/CD, how would you systematically investigate whether the problem is code, script, or environment related?”
- “What could be the reason why a Selenium test passes on your laptop, but it fails on Jenkins?”
What is the testing pyramid?
Asked in 2 of 109 interviews · last asked Oct 8 · Concept · Junior
Show answer
The testing pyramid is a guide for balancing automated tests. It typically has many unit tests at the base, fewer integration tests in the middle, and very few end-to-end tests at the top. This balance gives fast feedback while keeping test costs and maintenance lower.
- Unit tests check small pieces of code in isolation and usually run quickly.
- Integration tests check whether components work together.
- End-to-end tests check complete user flows but are usually slower and harder to maintain.
- The pyramid is a guide, not a fixed ratio of tests.
What the interviewer checks: The interviewer is checking whether you can balance test coverage, speed, and maintenance across test levels.
Other ways it was asked
- “What is the testing pyramid, and what levels does it typically include?”
How do you implement a data-driven approach in a test automation framework?
Asked in 2 of 109 interviews · last asked Sep 18 · Tooling · Mid-level
Show answer
I keep test data separate from test logic, using files, databases, or data providers. I parameterize the test so it runs once for each dataset, with inputs and expected results. I validate the data, keep runs independent, and label each case so failures are easy to trace.
- Use the framework’s parameterization feature to run the same test with different datasets.
- Include expected results, valid inputs, invalid inputs, and boundary values.
- Reset test state between cases so one dataset does not affect another.
- Give each dataset a clear name or ID in test reports.
What the interviewer checks: The interviewer checks whether you can reuse test logic while keeping data-driven tests independent and easy to debug.
Other ways it was asked
- “How do you implement data-driven testing in your automation framework?”
Tell me about a testing framework you built for a system that was difficult to test. What made your approach more effective than standard unit tests and mocks?
Asked in 2 of 109 interviews · last asked Oct 17 · Behavioral · Senior
Show answer
I built an integration test framework for an order system with asynchronous messages. Retries, delays, and duplicate messages made it hard to test. It ran real services and a message broker in containers, injected failures, and checked order and payment records. Unlike unit tests with mocks, it exposed delivery and recovery bugs across service boundaries.
- Tested duplicate delivery and service restarts to check that retries did not create extra charges.
- Waited for expected results with a timeout instead of using fixed sleeps.
- Isolated test data and captured logs to make failures easier to diagnose.
- Kept fast unit tests; used integration tests for behavior that mocks could hide.
What the interviewer checks: The interviewer wants to see how you chose realistic tests and defined correctness for a difficult system.
Other ways it was asked
- “Tell me about a testing framework you built for a difficult-to-test system. What made the system hard to test, and how did the framework validate correctness beyond basic unit tests?”
What is the difference between a selector and a locator in Playwright?
Asked in 2 of 109 interviews · last asked Sep 8 · Concept · Mid-level
Show answer
A selector is a string that describes how to find an element, such as a CSS selector. A locator is a Playwright object used to find elements and interact with them. It finds the element again before each action and supports auto-waiting and retrying assertions.
- Create locators with page.locator(selector) or helpers like page.getByRole().
- A locator is not a saved DOM element; it resolves against the current page.
- Actions such as click fail if the locator matches multiple elements.
JavaScriptconst selector = '#submit'; const locator = page.locator(selector); await locator.click();What the interviewer checks: The interviewer checks whether you understand how locators add reliable interaction beyond an element-matching string.
How do you upload a file in a Playwright test?
Asked in 2 of 109 interviews · last asked Jun 22 · Write code · Junior
Show answer
I use locator.setInputFiles() to attach a file to the form's file input. Then I submit the form and check that the upload succeeded. If a button opens a file chooser, I start waiting for the filechooser event before clicking, then call chooser.setFiles().
- Relative file paths start from the current working directory, not the test file's folder.
- Pass an array of paths when the input supports multiple files.
- Check the upload result, not just the selected filename.
- Playwright sets files without controlling the operating system's file picker.
JavaScript// tests/upload.spec.js; run: npx playwright test tests/upload.spec.js // Assumes this local form exists and tests/fixtures/photo.png is available. import { test, expect } from '@playwright/test'; test('uploads an image', async ({ page }) => { await page.goto('http://localhost:3000/upload'); await page.locator('input[type="file"]').setInputFiles('tests/fixtures/photo.png'); await page.getByRole('button', { name: 'Upload', exact: true }).click(); await expect(page.getByText('Upload complete', { exact: true })).toBeVisible(); });What the interviewer checks: The interviewer checks whether you can select files reliably and verify that the application uploaded them.
Other ways it was asked
- “How would you write and run a Playwright test that uploads an image through a form?”
- “How do you upload files in Playwright tests?”
What is Cypress?
Asked in 2 of 109 interviews · last asked Sep 15 · Concept · Junior
Show answer
Cypress is a tool for testing web applications with JavaScript or TypeScript. I would use it for end-to-end tests in a browser and for component tests. It offers automatic waiting, retries for queries and assertions, and tools to debug failures.
- Tests user actions and checks results in a real browser.
- Supports end-to-end testing and testing individual UI components.
- Automatic waiting reduces the need for fixed delays.
- It is not designed to test native mobile or desktop apps.
What the interviewer checks: The interviewer wants to know what Cypress tests and when you would choose it.
Other ways it was asked
- “When would you use Cypress?”
What are Selenium locators, and when would you use them?
Asked in 2 of 109 interviews · last asked Oct 12 · Concept · Mid-level
Show answer
Selenium locators are rules used to find elements on a web page. I use them before clicking buttons, typing into fields, or checking results. I prefer stable, unique IDs or CSS selectors, and use XPath when element relationships make it useful.
- Selenium supports ID, name, class name, tag name, link text, partial link text, CSS selector, and XPath.
- Avoid fragile locators, such as absolute XPath paths that break when the page structure changes.
- Finding an element does not mean it is ready for interaction; use explicit waits when needed.
- Playwright offers role, label, text, and test ID locators; its actions automatically wait for relevant readiness checks.
What the interviewer checks: The interviewer checks whether you can choose reliable locators and understand how they support browser interactions.
Other ways it was asked
- “What are Selenium locators, when would you use them, and how does Playwright locate elements?”
- “Can you tell me what a locator is in Selenium?”
Automation testing basics and strategy interview questions
These questions cover testing levels, what to automate, effort estimates, QA workflows, and how to measure automation's value. 38 questions.
How would you measure the business impact of increasing test automation coverage by 60%?
Asked once · last asked Aug 17 · Behavioral · Senior
How would you define success metrics for a test automation project?
Asked once · last asked Sep 22 · Scenario · Mid-level
Other ways it was asked
- “How would you define the success of an automation project?”
How do you manage the QA process from requirements analysis through test automation and sign-off?
Asked once · last asked Jan 27 · Scenario · Mid-level
How would you approach designing an automated testing strategy, and what factors would you consider?
Asked once · last asked Apr 16 · Behavioral · Senior
Other ways it was asked
- “What was your role in designing an automated testing strategy, how did you approach it, and what did you consider?”
Which metrics are most important for evaluating a test automation suite, and which would you track?
Asked once · last asked Apr 16 · Concept · Mid-level
Other ways it was asked
- “Which metrics are most important for evaluating a test automation suite, and which do you track?”
Which automated testing tools would you implement for UAT?
Asked once · last asked Apr 18 · Tooling · Mid-level
Can you give me an example of something you automated that helped the product?
Asked once · last asked May 25 · Behavioral · Mid-level
How would you automate or improve testing processes to increase stability and overall code quality?
Asked once · last asked May 25 · Behavioral · Mid-level
Other ways it was asked
- “How have you automated or improved testing processes to increase stability and overall code quality?”
How would you design a test automation strategy to maximize its value?
Asked once · last asked Jul 21 · Design · Senior
How do you calculate test automation coverage?
Asked once · last asked Aug 5 · Concept · Mid-level
How would you build an automation strategy for a large microservices-based application with UI, API, and backend layers?
Asked once · last asked Aug 17 · Design · Senior
How will you decide which test cases are good candidates for automation?
Asked once · last asked Aug 25 · Scenario · Mid-level
Show 23 more
How would you design a test strategy to automate cross-validation testing?
Asked once · last asked Sep 4 · Scenario · Mid-level
Tell me about a time you took ownership of a test automation framework, set its direction, and mentored the team.
Asked once · last asked Sep 8 · Behavioral
Tell me about a time you persuaded developers and business stakeholders to invest in test automation, using its impact on critical defects to make the case.
Asked once · last asked Sep 8 · Behavioral · Senior
How would you develop and organize automated tests for 100 test cases?
Asked once · last asked Sep 18 · Scenario · Mid-level
What major factors do you consider when evaluating trade-offs in an automation decision?
Asked once · last asked Sep 22 · Scenario · Mid-level
How would you measure the quality of automation compared with manual testing?
Asked once · last asked Sep 22 · Scenario · Mid-level
If you joined a team with no automated tests but already had documented scenarios, how would you approach test automation?
Asked once · last asked Oct 8 · Scenario · Senior
How do you approach manual testing before automating an application?
Asked once · last asked Oct 12 · Scenario · Mid-level
What automation tests have you written from scratch, and what was the hardest problem you faced?
Asked once · last asked Oct 14 · Behavioral · Mid-level
What should a client expect from you when you join a project to audit existing test automation?
Asked once · last asked Oct 22 · Scenario · Senior
What business outcomes can result from time saved through test automation?
Asked once · last asked Sep 22 · Scenario · Mid-level
Other ways it was asked
- “What business outcomes can result from reducing testing hours through automation?”
Where does test automation fit into the QA process?
Asked once · last asked Jan 27 · Concept · Mid-level
What are the differences between manually performing an integration test and automating it?
Asked once · last asked Apr 28 · Concept · Junior
How many test cases would you estimate an intern can automate in a day: 10, 15, or 20?
Asked once · last asked Apr 28 · Scenario
What is a test script?
Asked once · last asked May 8 · Concept · Junior
How should automated testing and a dedicated QA team fit into a software development workflow?
Asked once · last asked Jun 25 · Scenario · Mid-level
Which test automation tools do you know?
Asked once · last asked Jul 27 · Concept · Junior
How do you approach testing and test automation on a project?
Asked once · last asked Aug 5 · Scenario · Mid-level
Do you know the difference between unit, integration, and end-to-end test cases?
Asked once · last asked Sep 21 · Concept · Junior
Why is it important to compare an automated test's output with the expected value?
Asked once · last asked Sep 22 · Concept · Junior
How can test automation improve testing productivity?
Asked once · last asked Sep 22 · Concept · Junior
Why would cost be a success metric for automation?
Asked once · last asked Sep 22 · Concept · Junior
What are software testing and test automation?
Asked once · last asked Oct 22 · Concept · Junior
Test automation framework design interview questions
Framework questions cover structure, reusable code, Page Object and Screenplay patterns, BDD, and frameworks for enterprise or hardware testing. 42 questions.
What are the Page Object and Screenplay patterns, and when would you use them in Cypress tests?
Asked once · last asked Feb 9 · Concept · Mid-level
What types of tests can you implement with Serenity, and how do you use it to implement them?
Asked once · last asked Mar 19 · Tooling · Mid-level
How would you design an enterprise-level Robot Framework setup for more than 2,000 test cases? What would your approach be?
Asked once · last asked Apr 22 · Design · Senior
How would you design a test automation framework's architecture and use it to automate tests?
Asked once · last asked Apr 24 · Design · Mid-level
Other ways it was asked
- “Can you explain your automation framework architecture and briefly describe how your tests are automated?”
How would you design and begin building a test automation framework for a flight-booking application?
Asked once · last asked Apr 24 · Design · Mid-level
What are the biggest differences between automating tests for a traditional web application and for Microsoft Dynamics 365?
Asked once · last asked Apr 27 · Concept · Senior
What is the Screenplay Pattern, and how is it used in test automation?
Asked once · last asked Apr 27 · Concept · Mid-level
How would you approach building a Playwright automation framework for Microsoft Dynamics 365, and which design patterns and best practices would you use?
Asked once · last asked Apr 27 · Design · Senior
How would you structure a Selenium WebDriver automation framework in Java?
Asked once · last asked May 5 · Design · Senior
What does BDD stand for, what tool is it associated with, and when and why would you use this approach?
Asked once · last asked May 28 · Concept · Mid-level
Other ways it was asked
- “What does BDD stand for, what tool is it associated with, and when would you use it? What are its benefits?”
How would you design a test bench for a hardware product, particularly an electronic control unit?
Asked once · last asked Jul 16 · Design · Mid-level
Could Java be used to manage a test bench and develop drivers for interface cards?
Asked once · last asked Jul 16 · Scenario · Mid-level
Show 25 more
If a class has 10 methods and only one needs to create test data, how would you structure the test-data creation?
Asked once · last asked Jul 23 · Scenario · Mid-level
For reusable wait functions, is it better to define shared waits or implement waits at each call site?
Asked once · last asked Aug 5 · Concept · Mid-level
How do you design an automation testing framework for a microservices-based application?
Asked once · last asked Aug 17 · Design · Senior
Imagine you join a team and there is no test framework. How would you start building one from scratch?
Asked once · last asked Aug 25 · Design · Senior
What design patterns are useful in test automation besides the Page Object Model?
Asked once · last asked Aug 25 · Concept · Mid-level
What does good code mean to you, and how do you apply those principles in a test automation framework?
Asked once · last asked Sep 8 · Scenario · Mid-level
How would you persuade a team to adopt Cucumber and BDD in a Playwright framework despite the added layer and maintenance cost?
Asked once · last asked Sep 8 · Scenario · Senior
Other ways it was asked
- “How would you assess whether adding Cucumber and BDD to a Playwright framework is worth the extra layer and maintenance cost?”
How would you design an error-code system for test-case and station failures?
Asked once · last asked Sep 11 · Design · Senior
How would you design a test framework to keep failure scenarios maintainable, express scenario setup and fault assertions clearly, and avoid flaky timing?
Asked once · last asked Sep 11 · Design · Senior
How would you model shared page elements, such as menus or pop-ups, in a test automation framework?
Asked once · last asked Sep 18 · Design · Mid-level
How do you decide whether to keep test automation in a separate project or within the application's source code?
Asked once · last asked Sep 24 · Scenario · Senior
How would you make a test helper method reusable across tests that use different values?
Asked once · last asked Oct 8 · Write code · Mid-level
Other ways it was asked
- “How would you make the method reusable across tests that use different values?”
What advanced techniques can make a test framework more innovative than sending requests and polling a database, and how would you implement one?
Asked once · last asked Oct 13 · Scenario · Senior
How do you structure Python automation checks to avoid duplication and keep tests maintainable? Give an example.
Asked once · last asked Oct 20 · Behavioral · Mid-level
What are the four principles of object-oriented programming, and how would you apply one in test automation?
Asked once · last asked Oct 22 · Concept · Mid-level
Other ways it was asked
- “What are the four principles of object-oriented programming, and how have you applied one in test automation?”
How can reusable test flows reduce duplication in automated tests?
Asked once · last asked Jun 18 · Concept · Mid-level
What coding standards do you follow when writing test automation code?
Asked once · last asked Jul 23 · Concept · Mid-level
Can you name the keywords in Cucumber?
Asked once · last asked Aug 25 · Concept · Junior
What is the difference between Scenario and Scenario Outline in Cucumber?
Asked once · last asked Aug 25 · Concept · Junior
Other ways it was asked
- “What is the difference between scenario and scenario outline?”
What is the Cucumber hook that runs before a scenario?
Asked once · last asked Aug 25 · Concept · Junior
What is the purpose of a base class in a test automation framework, and how is it used?
Asked once · last asked Sep 16 · Concept · Mid-level
Other ways it was asked
- “What responsibilities should a base class's methods handle in a test automation framework?”
In data-driven testing with Excel, what does a scenario represent?
Asked once · last asked Sep 16 · Concept · Junior
What components are needed to run a test automation framework after its methods and base class have been created?
Asked once · last asked Sep 16 · Concept · Mid-level
What do you know about BDD and Cucumber?
Asked once · last asked Sep 17 · Concept · Junior
What is Gherkin syntax?
Asked once · last asked Sep 18 · Concept · Junior
Playwright interview questions
Explore Playwright locators, asynchronous actions, fixtures, browser contexts, configuration, and browser automation tasks. 39 questions.
How does getByRole work in Playwright?
Asked once · last asked Aug 4 · Concept · Mid-level
Other ways it was asked
- “Do you know how getByRole works in Playwright internally?”
When do you need to import `test` and `expect` in a Playwright test file?
Asked once · last asked Sep 11 · Concept · Junior
How would you use Playwright to click a button?
Asked once · last asked Jan 27 · Write code · Junior
Why might you avoid XPath selectors in Playwright?
Asked once · last asked Jan 27 · Concept · Mid-level
How does Playwright handle waits?
Asked once · last asked Jan 27 · Concept · Mid-level
How do you handle dynamic elements in the UI with Playwright?
Asked once · last asked Jan 27 · Tooling · Mid-level
How would you configure Playwright to test multiple environments and browsers and handle feature flags?
Asked once · last asked Apr 27 · Tooling · Senior
What is the difference between fixtures and projects in Playwright, and what would you use each for?
Asked once · last asked Apr 27 · Concept · Mid-level
How would you create and use custom extensions or plugins for Playwright?
Asked once · last asked Apr 27 · Tooling · Senior
What are user-facing attributes in Playwright, and how would you describe them?
Asked once · last asked May 28 · Concept · Mid-level
In a Playwright test, what happens if you omit `await` from an asynchronous action? Will the test still run or produce an error?
Asked once · last asked Jun 22 · Concept · Junior
In a Playwright image-upload test, how do you select the image file and specify its file path?
Asked once · last asked Jun 22 · Tooling · Junior
Show 22 more
What is a browser context in Playwright?
Asked once · last asked Jul 22 · Concept · Mid-level
Which locator types do you prefer in Playwright, and why?
Asked once · last asked Jul 22 · Tooling · Mid-level
How would you implement a custom getByRole locator using element attributes in Playwright?
Asked once · last asked Aug 4 · Write code · Senior
Other ways it was asked
- “How would you implement a custom getByRole locator in Playwright?”
- “How would you implement a custom getByRole locator using element attributes?”
How do you run only the failed test cases in Playwright?
Asked once · last asked Aug 31 · Tooling · Mid-level
When would you build custom wrappers or helpers around Playwright's built-in mechanisms, and when would you use its native API and auto-waiting directly?
Asked once · last asked Sep 8 · Concept · Senior
Is Playwright's console logging sufficient, and how do you handle logging in a Playwright test framework?
Asked once · last asked Sep 8 · Tooling · Mid-level
What are Playwright fixtures, and when would you create custom fixtures?
Asked once · last asked Sep 8 · Concept · Mid-level
Why might a team migrate from ReadyAPI to Playwright, and how would you plan the migration?
Asked once · last asked Sep 8 · Scenario · Senior
What is the difference between the test timeout and the action timeout in Playwright configuration?
Asked once · last asked Sep 8 · Concept · Mid-level
Other ways it was asked
- “What is the difference between a timeout and an action timeout in Playwright?”
How do you prepare or manipulate test data in Playwright before making an assertion?
Asked once · last asked Sep 11 · Tooling · Mid-level
How would you write a Playwright test for a login flow and verify successful login?
Asked once · last asked Sep 11 · Write code · Mid-level
Other ways it was asked
- “How would you write a JavaScript Playwright test for a login flow?”
- “How would you use Playwright to validate a successful login?”
Why are Playwright test functions asynchronous, and what does `async` mean in a test?
Asked once · last asked Sep 11 · Concept · Mid-level
How would you implement test automation with Playwright, and what would your tests cover?
Asked once · last asked Sep 21 · Tooling · Mid-level
Other ways it was asked
- “When using Playwright for test automation, what did you personally implement, and what did your tests cover?”
How would you use Playwright to test whether content overflows its container?
Asked once · last asked Oct 2 · Tooling · Mid-level
How can you locate elements in Playwright when the page has no good selectors or class names?
Asked once · last asked Oct 8 · Scenario · Mid-level
How can you prevent timeouts in Playwright tests?
Asked once · last asked Oct 8 · Scenario · Mid-level
What is Playwright's storage state, and how is it used?
Asked once · last asked Oct 8 · Concept · Mid-level
How would you write an asynchronous Playwright method to enter a starting amount, an ending amount, and a currency?
Asked once · last asked Oct 8 · Write code · Mid-level
How would you audit an existing Playwright automation suite and propose a plan of action to the client?
Asked once · last asked Oct 22 · Scenario · Senior
What does the `page` object represent in Playwright?
Asked once · last asked Sep 11 · Concept · Junior
Which Playwright method would you use to fill an input field?
Asked once · last asked Oct 8 · Tooling · Junior
What do you understand by Playwright?
Asked once · last asked Oct 10 · Concept · Junior
Selenium, Cypress and mobile automation interview questions
Compare tool choices and answer questions on WebDriver, XPath, waits, browser actions, Cypress, Appium, and iOS testing. 46 questions.
How many types of XPath are there, and what are the differences between them?
Asked in 2 of 109 interviews · last asked Jul 16 · Concept · Junior
Show answer
In automation testing, XPath is usually described in two forms: absolute and relative. Absolute XPath starts at the document root and commonly follows the full element path. Relative XPath starts from the current context node. Paths based on stable attributes are usually less fragile than full structural paths.
- Absolute XPath begins with / or // and starts at the document root.
- Relative XPath depends on the current context; .// searches within that context.
- Full structural paths can break when the page layout changes.
- Both forms can use attributes; stable attributes usually make locators easier to maintain.
CodeAbsolute: /html/body/form/input Relative: .//input[@id='email']What the interviewer checks: The interviewer checks whether you understand XPath starting points and can choose maintainable locators.
Other ways it was asked
- “What are the different types of XPath?”
What is the technical difference between Appium and Playwright?
Asked once · last asked Apr 13 · Concept · Mid-level
Other ways it was asked
- “What are the key component differences between Appium and Playwright?”
How would you use BrowserStack for cross-browser and cross-device testing?
Asked once · last asked Sep 21 · Tooling · Mid-level
How would you find all the links on a web page and identify which ones are broken?
Asked once · last asked Mar 24 · Tooling · Mid-level
In Selenium, how would you switch directly to the 48th window when there are 50 windows and no title or other identifying information?
Asked once · last asked Mar 24 · Tooling · Mid-level
How would you reliably test a feature embedded in a cross-origin iframe when you cannot access the iframe's code?
Asked once · last asked Apr 10 · Scenario · Senior
Will a Selenium script run with an older Chrome version, and what determines whether the browser and WebDriver versions are compatible?
Asked once · last asked Jul 14 · Scenario · Mid-level
Other ways it was asked
- “What happens if a Selenium script uses a browser version that is incompatible with its WebDriver version?”
Do Selenium browser and WebDriver versions need to match?
Asked once · last asked Jul 14 · Concept · Junior
Does Selenium 4 automatically upgrade the browser driver?
Asked once · last asked Jul 14 · Concept · Mid-level
In XPath, what is the difference between a single slash and a double slash?
Asked once · last asked Jul 16 · Concept · Junior
In XPath, what does starting a relative path from any element mean compared with starting from the document root?
Asked once · last asked Jul 16 · Concept · Junior
In Selenium tests, which type of assertion lets execution continue after an assertion failure?
Asked once · last asked Jul 16 · Concept · Junior
Show 31 more
What do try, catch, and finally do in Selenium test code, and how do they relate to assertions?
Asked once · last asked Jul 16 · Concept · Junior
Other ways it was asked
- “What do try, catch, and finally do in Selenium, and how do they relate to assertions?”
How would you combine assertions with try/catch in a Selenium test so execution can continue when an element is not found?
Asked once · last asked Jul 16 · Scenario · Junior
Other ways it was asked
- “How can you use try/catch so a Selenium test can continue when an element is not found?”
What does `//` mean in an XPath selector?
Asked once · last asked Jul 22 · Concept · Junior
When should you use different Selenium locator strategies, and how do you choose them for automated tests?
Asked once · last asked Jul 22 · Tooling · Mid-level
How would you write a stable automated test that detects horizontal overflow?
Asked once · last asked Aug 15 · Tooling · Mid-level
Other ways it was asked
- “After fixing a responsive overflow bug, what UI test would you add to prevent it from regressing, and what would the test assert?”
- “In a component test, how would you detect no horizontal overflow in a robust way, and how would you keep it stable across environments?”
Why is using a static WebDriver variable dangerous when running tests in parallel?
Asked once · last asked Sep 1 · Concept · Mid-level
How do you create reliable Selenium locators for elements whose attributes or values change dynamically?
Asked once · last asked Sep 1 · Scenario · Mid-level
Suppose clicking on a button opens a new tab, but sometimes the test switches to the wrong window. How do you make it reliable?
Asked once · last asked Sep 1 · Scenario · Mid-level
Why can mixing Cypress commands such as cy.get() with a native JavaScript Promise cause problems?
Asked once · last asked Sep 1 · Concept · Mid-level
Suppose your Selenium framework runs tests in parallel. Explain what ThreadLocal can help with and what problem it does not solve.
Asked once · last asked Sep 1 · Concept · Senior
How do you automate opening a URL in Chrome, scrolling to the footer, and subscribing to a newsletter using Selenium and Python?
Asked once · last asked Sep 17 · Tooling · Mid-level
How do you retrieve the text from a browser alert using Selenium?
Asked once · last asked Sep 18 · Tooling · Mid-level
How would you automate a search engine query using Selenium with Python?
Asked once · last asked Sep 18 · Tooling · Mid-level
Other ways it was asked
- “How would you automate a Google search using Selenium with Python?”
How do you write and use UI tests for an iOS application?
Asked once · last asked Oct 20 · Tooling · Mid-level
How can you avoid hard-coding an index in an XPath expression when it matches multiple elements?
Asked once · last asked Oct 22 · Tooling · Mid-level
How do XPath axes such as parent, child, and sibling help you locate elements?
Asked once · last asked Oct 22 · Tooling · Mid-level
Why might you use JavaScript within Python-based Selenium or Playwright tests?
Asked once · last asked Oct 22 · Tooling · Mid-level
What is the difference between an absolute XPath and a relative XPath?
Asked once · last asked Jul 16 · Concept · Junior
What criteria should you consider when creating a relative XPath?
Asked once · last asked Jul 16 · Concept · Junior
Other ways it was asked
- “What is a relative XPath?”
- “Can you give an example scenario for using a relative XPath?”
- “What criteria do we need to keep in mind while writing an XPath?”
Which tools can you use to find XPath expressions?
Asked once · last asked Sep 16 · Tooling · Junior
Other ways it was asked
- “Which tools do you use to find XPath?”
What is Selenium, and what is it used for in software testing?
Asked once · last asked Feb 26 · Concept · Junior
What are locators in web UI test automation, and what types are available?
Asked once · last asked Apr 22 · Concept · Junior
How do you assert the title of a web page?
Asked once · last asked Apr 22 · Tooling · Junior
How do you retrieve the CSS properties of an element?
Asked once · last asked Apr 22 · Tooling · Junior
How do you launch a browser and navigate to a URL using Selenium?
Asked once · last asked Jul 14 · Tooling · Junior
Other ways it was asked
- “Using Selenium, which method do you use to invoke a browser and navigate to a URL?”
What criteria should you consider when writing a relative locator in Selenium?
Asked once · last asked Jul 16 · Concept · Junior
In XPath, what do the parent and sibling relationships mean?
Asked once · last asked Jul 16 · Concept · Junior
Why should you avoid using Thread.sleep in Selenium tests?
Asked once · last asked Sep 1 · Concept · Junior
How do you find an XPath expression for a web page element?
Asked once · last asked Sep 16 · Tooling · Junior
Other ways it was asked
- “How do you find XPath?”
What are the advantages of using SelectorsHub?
Asked once · last asked Sep 16 · Tooling · Junior
Why do I need a WebDriver?
Asked once · last asked Sep 17 · Concept · Junior
Python pytest and Java TestNG interview questions
Python pytest and Java TestNG questions cover assertions, fixtures, hooks, test parameters, configuration, test selection, retries, and build commands. 17 questions.
Can you write Python code to read test data from an Excel or CSV file?
Asked in 2 of 109 interviews · last asked Sep 18 · Write code · Mid-level
Other ways it was asked
- “Can you write sample code to read test data from an Excel or CSV file?”
How do you rerun only failed pytest tests, and which package and options enable automatic retries?
Asked in 2 of 109 interviews · last asked Sep 18 · Scenario · Mid-level
Other ways it was asked
- “How would you rerun or handle failed test cases in your Pytest framework?”
- “What pip package and command-line options do you use in Pytest to automatically retry failed tests?”
- “If five tests run and two fail, how would you retry only the failed test cases?”
How do you implement fixtures in a Python test automation framework?
Asked in 2 of 109 interviews · last asked Sep 18 · Tooling · Mid-level
Other ways it was asked
- “How do you implement fixtures in Pytest?”
How would you launch an application using parameters from a config.properties file?
Asked once · last asked Mar 24 · Tooling · Mid-level
How do you pass and manage different parameter values through TestNG XML?
Asked once · last asked Mar 24 · Tooling · Mid-level
Other ways it was asked
- “How can you pass multiple parameters through a TestNG XML file?”
- “How would you manage properties in TestNG XML when their values differ?”
How do you run an entire test automation project with Maven?
Asked once · last asked Mar 24 · Tooling · Mid-level
What is an assertion, and how does it differ from try/catch/finally?
Asked once · last asked Jul 16 · Concept · Junior
Other ways it was asked
- “How do assertions relate to try/catch blocks?”
How do you create and use custom annotations in pytest?
Asked once · last asked Aug 5 · Tooling · Mid-level
How do you combine a functional approach with `conftest.py` in pytest?
Asked once · last asked Aug 5 · Tooling · Senior
What does `yield` do in a pytest fixture?
Asked once · last asked Aug 5 · Concept · Junior
When is pytest's `xfail` appropriate, and should you use it?
Asked once · last asked Aug 5 · Concept · Mid-level
How can .ini files be used to configure report generation in Python test automation?
Asked once · last asked Sep 18 · Tooling · Mid-level
Show 5 more
Walk through an example of a Python automation test and explain what it tests.
Asked once · last asked Oct 20 · Behavioral · Mid-level
Other ways it was asked
- “Can you walk us through a recent Python automation test you personally wrote? What was it testing?”
How would you structure Python code and functions for an automated test using pytest?
Asked once · last asked Oct 20 · Behavioral · Mid-level
Other ways it was asked
- “What Python code or functions did you write for an automation test, and how did you use pytest?”
How do you run and select tests in pytest, and which commands or options would you use?
Asked once · last asked Oct 20 · Tooling · Mid-level
Other ways it was asked
- “How do you normally run and select tests in pytest when working on a project? Can you give an example of commands or options you regularly use?”
How do you build a Java test automation project?
Asked once · last asked Mar 24 · Tooling · Mid-level
What are hooks in a test automation framework?
Asked once · last asked Apr 22 · Concept · Junior
API and end-to-end automation testing interview questions
API and end-to-end questions cover validation, authentication, mocking, integration coverage, distributed workflows, and how to check expected results. 37 questions.
How would you make tests deterministic despite asynchronous callbacks, retries, and out-of-order events without using sleeps?
Asked in 2 of 109 interviews · last asked Oct 17 · Scenario · Senior
Other ways it was asked
- “How would you make end-to-end tests deterministic and stable despite asynchronous callbacks, retries, and out-of-order events? What synchronization or observation mechanism would you use?”
- “How did you make timing-sensitive cases deterministic in a test framework, such as when a callback arrives before a synchronous response or when retries occur, without relying on sleeps or flaky real-time delays?”
What factors do you consider when designing REST API automation tests?
Asked once · last asked Jul 23 · Concept · Mid-level
Other ways it was asked
- “What coding standards and design patterns do you use when designing a REST API test automation framework?”
- “Which design patterns do you use for REST API test automation?”
- “What aspects of a REST API do you validate in automated tests?”
How do you automate testing of token-based authentication?
Asked once · last asked Jan 27 · Tooling · Mid-level
Given a username and an invitation URL, what response would you expect from the login API, and how would you automate and validate the flow?
Asked once · last asked Jan 27 · Scenario · Mid-level
If a button triggers a frontend action and sends a request to an API, how would you test reliably and repeatably that it behaves as expected?
Asked once · last asked Apr 10 · Scenario · Senior
How would you automate a large workflow involving filling out a form and retrieving information from an email? Would you write one large test or split it into smaller tests?
Asked once · last asked Apr 16 · Scenario · Senior
What trade-offs would you consider when choosing Playwright for API testing instead of Postman?
Asked once · last asked Apr 17 · Concept · Senior
How would you test a system that uses polling?
Asked once · last asked Apr 17 · Scenario · Mid-level
How would you build an API testing framework in Postman, and what validations would you include?
Asked once · last asked Apr 24 · Tooling · Mid-level
How would you approach end-to-end testing with Power Automate and flows?
Asked once · last asked Apr 27 · Tooling · Senior
Other ways it was asked
- “How did you approach end-to-end testing with Power Automate and flows?”
How do you translate tickets and acceptance criteria into end-to-end tests for developers?
Asked once · last asked May 25 · Concept · Mid-level
How can you test API behavior with mocked responses?
Asked once · last asked May 28 · Scenario · Mid-level
Show 24 more
How do you test APIs and front ends, and what tools do you use for testing Python and JavaScript?
Asked once · last asked Jun 23 · Tooling · Mid-level
Why is REST used more often for automation?
Asked once · last asked Jul 16 · Concept · Mid-level
How would you handle an automated check when a container's health check passes but its business API returns an error?
Asked once · last asked Jul 16 · Scenario · Mid-level
What automated checks can detect business-level failures when a container's health check passes?
Asked once · last asked Jul 16 · Scenario · Mid-level
How do you manage end-to-end checks in CI to ensure integration between the TypeScript and Rust components is consistent?
Asked once · last asked Jul 20 · Scenario · Senior
How would you use REST Assured or MuleSoft for integration testing?
Asked once · last asked Jul 21 · Tooling · Mid-level
Other ways it was asked
- “How have you used REST Assured or MuleSoft for integration testing?”
What is idempotency in HTTP methods and how do you verify idempotency in automated tests?
Asked once · last asked Jul 21 · Scenario · Mid-level
How would you test and automate an A/B test, including its user flows or API endpoints?
Asked once · last asked Jul 22 · Scenario · Mid-level
Which HTTP response codes should REST API automation tests cover?
Asked once · last asked Jul 23 · Concept · Junior
What do you validate in REST API automation tests besides the HTTP status code?
Asked once · last asked Jul 23 · Concept · Mid-level
Tell me about a time you built an end-to-end test harness for a system with a difficult-to-verify behavior or invariant. How did you validate it?
Asked once · last asked Sep 11 · Behavioral · Senior
How would you handle multi-factor authentication codes in an automated test?
Asked once · last asked Sep 16 · Scenario · Mid-level
Other ways it was asked
- “How would you automate a multi-factor authentication code in an automated test?”
How can you use Postman to automate API tests and verify which requests pass or fail?
Asked once · last asked Sep 21 · Tooling · Mid-level
What kinds of API tests can you build in Postman, and what could you build with a separate testing tool beyond Postman?
Asked once · last asked Sep 21 · Tooling · Mid-level
For an end-to-end payment processing test framework, what test oracles and invariants would you assert, and how would the harness observe them without mocks?
Asked once · last asked Oct 13 · Scenario · Senior
How would you systematically generate gateway scenarios involving timeouts, partial failures, and retries? Would you use a model, state machine, or property-based approach, and what properties would you enforce?
Asked once · last asked Oct 17 · Scenario · Senior
How would you build a test harness to control and replay callback sequences?
Asked once · last asked Oct 23 · Tooling · Mid-level
What is a test harness, and how is it used in software testing?
Asked once · last asked Oct 24 · Concept · Mid-level
What components are normally included in a test harness?
Asked once · last asked Oct 24 · Concept · Mid-level
How can you obtain a player ID, and how is it used when intercepting an API request?
Asked once · last asked Aug 4 · Scenario · Mid-level
Other ways it was asked
- “How would you use a player ID after retrieving it when intercepting an API request?”
How do you approach automated backend testing?
Asked once · last asked Apr 17 · Scenario · Mid-level
How do you automate testing of REST APIs?
Asked once · last asked Jul 23 · Tooling · Mid-level
Other ways it was asked
- “How do you automate REST APIs?”
How would you intercept an API request involving a player ID and change the player's status?
Asked once · last asked Aug 4 · Scenario · Mid-level
How would you determine whether an automated API test script provides end-to-end coverage rather than merely testing individual endpoints?
Asked once · last asked Sep 21 · Concept · Mid-level
Other ways it was asked
- “How can you distinguish automated end-to-end tests from API endpoints included in a test script?”
CI/CD test automation interview questions
CI/CD questions focus on pipelines, release gates, containers, parallel runs, runner capacity, environments, isolated test data, and accessible reports. 25 questions.
How do you securely manage credentials and other sensitive information in automated tests?
Asked in 2 of 109 interviews · last asked Jul 23 · Scenario · Mid-level
Other ways it was asked
- “How would you manage SQL Server connection details, such as usernames and passwords, in an automated test suite?”
- “How did you handle sensitive information like client ID and client secret during automation?”
How would you run tests in parallel, and what benefits and pitfalls should you consider?
Asked in 2 of 109 interviews · last asked Jul 16 · Scenario · Mid-level
Other ways it was asked
- “How would you run tests in parallel, what are the benefits, and what should you avoid?”
- “What should you consider when running tests in multiple threads?”
How would you configure a CI/CD pipeline to trigger and run automated tests?
Asked in 2 of 109 interviews · last asked Sep 18 · Tooling · Mid-level
Other ways it was asked
- “How have you integrated automated tests into CI/CD pipelines?”
- “How can a CI/CD pipeline be configured to trigger automated test scripts?”
Can you describe the workflow of a test automation pipeline?
Asked in 2 of 109 interviews · last asked Sep 18 · Concept · Mid-level
Other ways it was asked
- “What stages and activities are typically part of a test automation pipeline?”
How does CI/CD support software testing, and why would a test engineer use it?
Asked once · last asked Oct 13 · Concept · Mid-level
How do you manage end-to-end testing when an application consists of many services that must be started or kept running?
Asked once · last asked Mar 19 · Scenario · Senior
How do you use CI/CD pipelines and automated end-to-end testing in an AWS deployment workflow?
Asked once · last asked Mar 19 · Tooling · Mid-level
How would you prevent a test that creates 500 records for performance or limit testing from leaving those records in the environment?
Asked once · last asked Apr 10 · Scenario · Mid-level
How would you store Playwright test reports in a CI pipeline?
Asked once · last asked Apr 27 · Tooling · Mid-level
If you have 10 test cases and set the number of workers to 3, how will the test cases run?
Asked once · last asked Jul 22 · Scenario · Mid-level
How would you manage test data in an automation framework for a platform operating across nine European markets?
Asked once · last asked Sep 8 · Scenario · Senior
How do you integrate Playwright tests with GitLab CI/CD, and how do you coordinate that work with DevOps?
Asked once · last asked Sep 8 · Tooling · Mid-level
Show 13 more
How do you determine whether the number of GitLab CI runners is sufficient for a test suite?
Asked once · last asked Sep 8 · Scenario · Mid-level
How would you configure reporting in GitLab so nontechnical users can access test reports and Playwright trace views online?
Asked once · last asked Sep 8 · Tooling · Senior
How would you test an application with multiple business areas and about 100 users when the number of test runners is limited?
Asked once · last asked Sep 8 · Scenario · Senior
How do you configure your pipeline checks to stop a release when tests fail and handle environment issues during that process?
Asked once · last asked Sep 9 · Scenario · Mid-level
How would you address a CI/CD test pipeline that takes too long and sometimes has flaky tests?
Asked once · last asked Sep 17 · Scenario · Senior
How do you trigger automated scripts using a Jenkins pipeline?
Asked once · last asked Sep 17 · Tooling · Mid-level
How could you adapt a CI pipeline to catch or prevent recurring frontend regressions?
Asked once · last asked Oct 2 · Scenario · Senior
How do you design and maintain effective test data for integration and end-to-end tests so they are reliable, isolated, and safe to run in parallel?
Asked once · last asked Oct 18 · Scenario · Senior
What are the advantages and disadvantages of deleting test data after testing?
Asked once · last asked Apr 10 · Concept · Mid-level
Where do you run your automation suites?
Asked once · last asked Jun 22 · Tooling · Mid-level
How often should you run end-to-end tests?
Asked once · last asked Jun 24 · Concept · Mid-level
How do you run automated tests in Docker?
Asked once · last asked Jul 16 · Tooling · Mid-level
What types of reports can a test automation framework generate?
Asked once · last asked Sep 18 · Concept · Mid-level
Automation debugging and flaky test interview questions
Work through failure investigation, timing issues, unstable selectors, differences between local and CI runs, feature changes, and long-term test reliability. 25 questions.
How do you choose stable locators for automated UI tests?
Asked in 2 of 109 interviews · last asked Sep 8 · Scenario · Mid-level
Other ways it was asked
- “What do you consider when choosing UI elements or selectors for automated tests?”
- “What makes a locator stable in Playwright?”
How do you handle situations where automated tests might not provide clear feedback because features are changing often?
Asked in 2 of 109 interviews · last asked Sep 24 · Scenario · Mid-level
Other ways it was asked
- “What can you do when automated tests are frequently changing and failing?”
How do experiments and feature flags affect automated tests, and how do you keep baseline tests reliable?
Asked once · last asked Jan 27 · Scenario · Senior
Other ways it was asked
- “What challenges can experiments or feature-flag changes in production or staging create for Playwright tests?”
- “How would you use test automation to keep baseline tests reliable when experiments or feature-flag changes alter the application?”
How would you improve a large test automation project that uses poor practices?
Asked once · last asked Apr 16 · Scenario · Senior
How would you maintain automated tests for several application versions in parallel, including older and newer versions?
Asked once · last asked Apr 16 · Scenario · Senior
If a junior QA says their Robot Framework tests pass locally but fail in Jenkins, how would you guide them to debug the issue?
Asked once · last asked Apr 22 · Scenario · Senior
When tests pass locally but fail in Jenkins, how would you investigate the logs, and what common issues would you look for?
Asked once · last asked Apr 22 · Scenario · Mid-level
If 300 out of 2,000 test cases start failing after a UI release, what would your action plan be?
Asked once · last asked Apr 22 · Scenario · Senior
When an integration or end-to-end test intermittently fails in CI, how do you diagnose it and decide whether to quarantine, fix, or delete it?
Asked once · last asked May 5 · Scenario · Senior
Tell me about the most difficult Selenium failure you personally debugged. What was the initial symptom? Why did you investigate?
Asked once · last asked Sep 1 · Behavioral · Mid-level
Suppose in your Selenium test, you locate an element successfully, but after a page update, clicking throws a stale element reference exception. How do you fix it properly?
Asked once · last asked Sep 1 · Scenario · Mid-level
What can prevent Selenium from locating an element that exists in the DOM, even when the locator is correct?
Asked once · last asked Sep 1 · Scenario · Mid-level
Show 11 more
You have one preproduction environment, 80% of tests fail because of UI or data changes, and four days for regression. What would you do now, and how would you prevent this situation in the future?
Asked once · last asked Sep 8 · Scenario · Senior
How do you keep an automated test suite reliable over time, handle flaky tests, and get it running cleanly in a pipeline on every change?
Asked once · last asked Sep 9 · Scenario · Senior
Why does using hard delays like time.sleep impact automation framework performance, and what is the better alternative?
Asked once · last asked Sep 16 · Concept · Mid-level
How do you debug an automation test suite that passed on Friday but failed on Monday?
Asked once · last asked Sep 16 · Scenario · Mid-level
Tell me about a Python pytest test that was failing unexpectedly. How did you investigate the failure, identify the cause, and fix it?
Asked once · last asked Oct 20 · Behavioral · Mid-level
What information do you include in test logs?
Asked once · last asked Apr 16 · Tooling · Mid-level
What information do you log during automated test runs, even when no errors occur?
Asked once · last asked Apr 16 · Tooling · Mid-level
What does it mean for a test to be repeatable, and why is that important?
Asked once · last asked Jun 12 · Concept · Junior
How do you identify and fix errors in a JavaScript test file?
Asked once · last asked Sep 11 · Scenario · Mid-level
What problems can a fixed 120-second sleep cause in an automated test?
Asked once · last asked Sep 16 · Concept · Mid-level
What are flaky tests?
Asked once · last asked Oct 24 · Concept · Mid-level
AI test automation interview questions
AI testing questions cover generated tests, agent design, repeatable workflows, safeguards, validation, and testing AI applications whose outputs can vary. 20 questions.
How would you structure a test automation framework, and what changes are needed when transitioning it to AI-based testing?
Asked once · last asked Jul 30 · Design · Senior
Other ways it was asked
- “How would you structure a test automation framework, including its folder structure, and what changes are needed when transitioning it to AI-based testing?”
What components would an agent-based system need to convert test scenarios into Playwright tests?
Asked once · last asked Oct 8 · Design · Senior
Other ways it was asked
- “How would you build an agent to convert test scenarios into Playwright tests?”
- “How long might it take to build an agent that converts test scenarios into Playwright tests?”
- “If agents could connect to a test management tool and convert scenarios into Playwright tests in tens of person-days, what would be wrong with that approach—or might nothing be wrong?”
How can you use an AI agent to speed up software testing?
Asked once · last asked Oct 22 · Scenario · Senior
Other ways it was asked
- “What challenges can arise when using an AI agent to speed up software testing?”
How do you automate testing or validate nondeterministic responses from an LLM?
Asked once · last asked Jul 16 · Scenario · Senior
Where can AI be applied in software test automation?
Asked once · last asked Jul 22 · Scenario · Mid-level
What components would you include in an MCP-based AI QA agent framework built from scratch?
Asked once · last asked Jul 30 · Design · Senior
How would you test an AI chatbot using TestNG and TestRail?
Asked once · last asked Jul 30 · Tooling · Mid-level
If an AI assistant generates failing test scenarios, how would you prompt it to fix the code and make the tests pass?
Asked once · last asked Aug 25 · Scenario · Mid-level
How do you structure the observation-action loop to handle the dynamic quiz elements in a browser agent built with Playwright?
Asked once · last asked Aug 25 · Scenario · Senior
If an AI tool writes a test and reports that it passes, how would you verify that the test actually tests anything?
Asked once · last asked Sep 4 · Scenario · Senior
Other ways it was asked
- “If Claude writes a test and reports that it passes, how would you verify that the test actually tests anything?”
How would you build an adversarial testing harness for an AI application, including how it connects to the application and uses the outputs?
Asked once · last asked Sep 10 · Design · Senior
How does a vibe coding tool provision changes behind the scenes, and how can it validate that the generated site works?
Asked once · last asked Sep 29 · Design · Senior
Show 7 more
How can AI support the writing of automated tests, and which parts of the process can it help with?
Asked once · last asked Oct 8 · Tooling · Mid-level
How would you use Zephyr to estimate the effort required to automate tests with AI?
Asked once · last asked Oct 8 · Tooling · Senior
How would you use GitHub Copilot to rewrite 50 tests in a repeatable process?
Asked once · last asked Oct 8 · Scenario · Senior
In a senior setup, how would you ground an LLM or agent in the actual gameplay state machine, inputs, and interrupt rules so it generates valid automatable tests, and what artifacts and integration points would you use?
Asked once · last asked Oct 9 · Design · Senior
How would you design the CI gate to distinguish an invalid LLM-generated test sequence from a genuine game bug, and how would you classify and triage failures?
Asked once · last asked Oct 9 · Design · Senior
How would you use AI tools, skills, and agents in a software testing project?
Asked once · last asked Oct 22 · Behavioral · Senior
Other ways it was asked
- “How have you used AI tools, skills, and agents in a software testing project?”
How do you use AI tools in your automation work?
Asked once · last asked May 25 · Tooling · Mid-level
Related interview questions
- QA Engineer interview questions
- Software Engineer interview questions
- DevOps Engineer interview questions
- AI Engineer interview questions
- System Administrator interview questions
- Manual Testing interview questions
- API Testing interview questions
- Agile and Scrum interview questions
- Salesforce interview questions
How this list is made
Every question here was asked by a real interviewer in a real job interview that a candidate ran MeetAssist in. After the call, the interviewer's questions are pulled from the transcript. Practice sessions, tests, exams and anything that was not a job interview are dropped.
Questions are rewritten so they make sense on their own: names of people, employers and clients are removed, and speech-to-text mistakes are fixed. Small talk, logistics and questions about one candidate's own résumé are left out. Rephrasings of the same question are merged, and the count is the number of different interviews it came up in.
The interviews come from candidates who use MeetAssist, so they lean towards software, data and AI roles: the shares describe these interviews, not every Automation Testing interview. Answers to the most asked questions are written and checked by an editor; a "common mistake" is shown only when reviews of real answers in these interviews show it, with the count.
109 interviews, 59 candidates, Jan 2026 to Oct 2026. Updated every month with new interviews.
Or add the Chrome extension