Senior QA Engineer - AI-Driven Production Testing

Curative; Austin (TX); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Curative Health Plan

Dental and Vision Coverage

Life and Disability Coverage

Flexible Spending Accounts

Generous PTO

401K

Parental Leave

Job summary

Curative is hiring a Senior Software Test Engineer to help us ship quickly with the right level of quality. You will own the eval infrastructure, run exploratory testing across end-to-end workflows, and work directly with business teams to understand real needs.

You’ll translate ambiguous requirements into test plans, diagnose production signals, and push for measurable quality improvements. If you thrive in fast, pragmatic environments with ownership, this role is for you.

Qualifications

• 5+ years in software quality, testing, or engineering.
• Fluency with LLM evaluation, golden datasets and regression suites.
• Hands-on experience with AI agents and failure modes.
• Tester’s instincts and track record of finding hard bugs.
• Debugging depth: logs, traces, production forensics.
• Fluent with business stakeholders and translating needs into tests.
• Ability to work in fast, ambiguous environments without heavy processes.
• Pragmatic quality judgment: knowing what to ship vs. what to fix.
• Strong written communication that informs action.

Responsibilities

• Own the eval platform: datasets, graders, CI integration.
• Perform hands-on exploratory testing across end-to-end workflows.
• Validate we built the right thing by aligning with business stakeholders.
• Develop deep domain expertise on Curative’s workflows.
• Produce production signals, dashboards, and root-cause analyses.
• Provide product judgment and write clear requirements when needed.
• Prioritize testing under time pressure and defend the plan.

Skills

QA testing

Automation

Exploratory testing

LLM evaluation

AI agents testing

Debugging

Stakeholder communication

Ambiguity tolerance

Written communication

Tools

Python

TypeScript

Job description

Curative is hiring a Senior Software Test Engineer to help us ship quickly with the right level of quality. You will own the eval infrastructure, run exploratory testing across end-to-end workflows, and work directly with business teams to understand real needs.

You’ll translate ambiguous requirements into test plans, diagnose production signals, and push for measurable quality improvements. If you thrive in fast, pragmatic environments with ownership, this role is for you.