AI Quality & Reliability Engineer (On-Site NYC)

Taxo; New York (NY); Sur place; USD 130 000 - 170 000; Plein temps

Avantages offerts par ce poste

Health coverage

Résumé du poste

Taxo is hiring a Software Engineer (AI Quality & Reliability) to build automated evaluation and regression systems for our Voice AI agents. You will turn product criteria and real failure modes into repeatable tests across conversations, tool calls, and integrations, ensuring reliable releases.

You will own evaluation frameworks, measure AI behavior, and surface regressions before launch, collaborating with engineering and product teams in an on-site New York setting.

Qualifications

• Strong software engineering skills in Python or TypeScript.
• Experience building test automation and CI pipelines.
• Experience evaluating LLM-powered apps or voice systems.
• Ability to trace failures across service boundaries.
• Ability to communicate risk and release readiness.

Responsabilités

• Build evaluation system and test harnesses.
• Automate end-to-end regression across workflows.
• Measure AI behavior including latency and scoring.
• Produce release-readiness evidence and dashboards.
• Turn failures into durable regression tests.
• Improve test infrastructure and CI/CD integration.

Connaissances

Python

TypeScript

Test automation

CI/CD

Distributed systems

LLM evaluation

Healthcare data

Description du poste

Taxo is hiring a Software Engineer (AI Quality & Reliability) to build automated evaluation and regression systems for our Voice AI agents. You will turn product criteria and real failure modes into repeatable tests across conversations, tool calls, and integrations, ensuring reliable releases.

You will own evaluation frameworks, measure AI behavior, and surface regressions before launch, collaborating with engineering and product teams in an on-site New York setting.