QA Engineer: AI-Assisted Testing

ECFX; United States; On-site; USD 85,000 - 130,000; Full time

Job summary

ECFX is seeking a hands-on QA Engineer to join our team and protect product quality across web-based SaaS offerings. You will design and execute test cases, prioritize risk, and drive thorough verification with a focus on data integrity and reliability.

You will perform manual and exploratory testing, validate API and backend behavior, and use AI-assisted testing techniques to improve coverage. Collaboration with engineering and product teams is essential.

Qualifications

• 3–7 years of software quality assurance experience for web or SaaS products.
• Strong hands-on experience with exploratory and manual testing of complex data-heavy systems.
• Comfort testing AI-assisted features and validating data integrity across endpoints.

Responsibilities

• Execute risk-based exploratory, functional, and regression testing.
• Test across UI and backend using API calls, SQL, and logs.
• Identify, document, and track defects with clear repro steps and acceptance criteria.
• Collaborate with engineers and product managers to define test plans and acceptance criteria.

Skills

Exploratory testing

Manual testing

Web applications

Attention to detail

Education

Bachelor's degree in CS/IS

Tools

Jira

Playwright

SQL

Git

Job description

Join ECFX, a company transforming how the legal industry works through technology. Every day our platform pulls court notices and legal documents from hundreds of court portals and e-filing systems, categorizes them with AI, and delivers them into our customers' document and case management systems. When something is late, dropped, or misfiled, a law firm can miss a deadline. We're looking for a hands-on QA Engineer who loves finding what others miss, and who uses AI to do it faster and deeper. Our engineers build with AI coding agents, so changes arrive quickly and in volume. You'll be the person who works out what could break and tests it thoroughly by hand, using AI as your co-pilot for test design, test data, investigation, and reporting. This is a testing role first. If you also enjoy building automation, there's room to use AI to create targeted automated checks where they pay off. You will have a real say in how we build, test, and ship software.

What You'll Engage In Test Smarter with AI:

Use AI tools (such as Claude, Claude Code, Cursor, or ChatGPT) to read tickets, merge requests, and code diffs; map out risks and edge cases; draft test charters and checklists; and decide where to focus. You bring the judgment about what matters.

Explore and Uncover:

Run risk-based exploratory, functional, and regression testing across our Vue dashboard, admin tools, email notifications, and integrations. Find defects before customers do.

Validate What Matters Most:

Make sure documents are retrieved, parsed, categorized, stored, and delivered correctly across many external sources: court portals, 2FA/OTP logins, and integrations such as Clio, Filevine, iManage, and NetDocuments. Hunt for silent failures, where a document is dropped but the run reports success.

Test Below the UI:

Much of our work has no screen to click. Verify backend and platform changes by hand, using API calls, SQL queries, logs, and dashboards (Grafana/Loki, Sentry), with AI helping you write the queries and make sense of the output.

Build Realistic Test Scenarios:

Use AI to generate test data, sample court notice emails, and edge-case documents, and drive our simulators and test environments to reproduce hard-to-reach situations.

Test Our AI Features:

Evaluate our AI document categorization and our LLM-facing tools (an MCP server used by AI assistants). Build sample sets, check accuracy and consistency, try to break them with unusual or hostile inputs, and flag when a model or prompt change makes results worse.

Guard Security and Access:

Check logins (password, SAML SSO, OAuth), user roles and permissions, and that one firm can never see another firm's data. Verify security fixes without breaking what already works.

Reproduce and Triage:

Investigate customer-reported and production issues, reproduce them reliably, and write bug reports clear enough that an engineer, or an AI agent, can act on them right away.

Automate Where It Pays Off (Optional):

If automation is in your toolkit, use AI to create focused automated checks, such as Playwright scripts or API checks, for high-risk flows you find yourself retesting.

Agile Collaboration:

Work with engineers and product managers in sprint planning, backlog refinement, and retrospectives. Help write testable acceptance criteria and raise quality risks early

What You're Likely to Bring Professional Experience:

3 to 7 years in software quality assurance for web or SaaS applications, with deep experience in exploratory and manual testing of complex, data-heavy systems.

AI Fluency

You use AI assistants in your testing every day and can give concrete examples: generating test ideas and edge cases, building test data, writing SQL or log queries, summarizing logs or diffs, reproducing bugs, and drafting clear reports. Skill at prompting and giving context, such as feeding in the ticket, the diff, and the acceptance criteria to get useful output instead of generic answers. Healthy skepticism. You verify what AI tells you, recognize when it is confidently wrong, and never let it replace your own judgment about risk. An understanding of how to test systems that don't always give the same answer, such as AI features, by using repeated trials, sample sets, and "is this answer right?" checks rather than exact matches. Careful handling of data. You use synthetic or masked data with AI tools and never paste customer or court data into unapproved services.

Technical Proficiency

Comfort with the command line, Git, and reading logs. Some experience with Docker or Kubernetes (such as port-forwarding or checking pod logs) is a plus. Experience with defect tracking and test management in Jira.

How You Work Analytical Mindset

Sharp attention to detail, curiosity, and a methodical approach to breaking software and finding root causes.

Communication Excellence

Strong written and verbal communication for bug reports, test notes, and status updates. Your reports are precise enough that another person, or an AI agent, c