Skip to main content

How do you decide what to automate and what to keep manual?

  • automation ROI
  • test strategy
  • manual vs automated

Answer it first, then compare. Nothing here is saved or scored.

Model answer

Automate: repetitive regression tests, data-driven tests with many input combinations, smoke tests for CI, cross-browser/device matrix testing. Keep manual: exploratory testing, usability evaluation, visual design review, one-time tests for a specific release, tests for rapidly changing features (automation can't keep up). The ROI calculation: if a test will run more than 5 times and the automation cost is less than 5× the manual cost, automate it. Don't automate everything, some tests are cheaper to run manually forever.

What interviewers listen for

  • Risk-based prioritisation
    You can defend skipping coverage on a path because the risk maths supports it.
  • Test design fluency
    You apply equivalence partitioning and decision tables to concrete inputs in real time.
  • Metric judgment
    You distinguish between metrics that drive learning and metrics that drive theatre.
  • Strategy under constraint
    You can produce a defensible plan when the team has half the time and twice the scope.

Terms to know

See all 33 methodology questions

Written by , Senior QA Automation Engineer, 50+ QA candidate interviews conductedLast updated July 2026