Senior AI-Driven QA Engineer for AI Agents

Curative; Austin (TX); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Curative Health Plan

Dental and Vision

Life and Disability

Flexible Spending Accounts

Generous PTO

401K

Parental leave

Job summary

Curative is hiring a Senior Software Test Engineer to ship fast with quality. At Curative, every engineer owns what they ship, including AI-driven evals and production signals.

You’ll work directly with business teams to test how real users interact with the product, shaping what gets built next and catching gaps before they reach customers. Join a fast-moving team investing in AI-powered testing, eval harnesses, and end-to-end quality coverage.

Qualifications

• 5+ years in software quality, testing, or engineering with automation and exploratory testing.
• Fluency with LLM evaluation and evals that catch real problems.
• Experience with AI agents and failure modes (silent drift, tool misuse).
• Strong debugging: logs, traces, production forensics; fix it yourself in Python or TS.
• Ability to work with business stakeholders and extract real needs.
• Comfort with ambiguity and speed; can work without mature processes.
• Pragmatic quality judgments on what to ship.
• Sharp written communication that impacts team decisions.

Responsibilities

• Own the eval platform: datasets, graders, CI integration for measuring agent behavior.
• Hands-on exploratory testing end-to-end, including unusual user paths.
• Validate we built the right thing by aligning with business stakeholders.
• Develop deep domain understanding of Curative's workflows.
• Provide production signals, bug hunts, and precise diagnostics for incidents.
• Apply product judgment when PM input is missing and propose behavior.
• Prioritize work under chaos, defending where effort goes first.

Skills

5+ years in software quality

LLM evaluation

AI agent testing

Exploratory testing

Debugging & production forensics

Stakeholder communication

Ambiguity tolerance

Quality judgment

Clear written communication

Python

TypeScript

Tools

Python

TypeScript

Job description

Curative is hiring a Senior Software Test Engineer to ship fast with quality. At Curative, every engineer owns what they ship, including AI-driven evals and production signals.

You’ll work directly with business teams to test how real users interact with the product, shaping what gets built next and catching gaps before they reach customers. Join a fast-moving team investing in AI-powered testing, eval harnesses, and end-to-end quality coverage.