Senior SDET for AI Systems & Autonomous Agents

Nexxa.AI; San Francisco (CA); Presencial; USD 140 000 - 190 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Equity package

Competitive compensation

Career growth opportunities

Resumo da oferta

Nexxa.AI is seeking a Senior/Staff SDET to own quality for AI agent systems in industrial settings. You will design and maintain test frameworks, simulate environments, and build evaluation harnesses while also performing hands-on testing to verify agent behavior, safety, and tool usage.

You will collaborate with ML and backend engineers and Forward Deployed teams to define what “good” looks like and implement automated gates and dashboards to measure quality beyond simple accuracy.

Qualificações

• 5+ years as an SDET/QA engineer with ownership of test strategy and automation for distributed systems.
• Experience in both manual and automated testing, including exploratory testing and bug reporting.
• Strong programming skills (Python preferred) with maintainable, well-reviewed code.

Responsabilidades

• Design, build, and maintain test frameworks, evaluation harnesses, and regression suites for AI agent systems.
• Develop CI/CD quality gates and automated evaluation pipelines for model/prompts/tool changes.
• Create simulators, mocks, and sandbox environments for industrial systems and APIs.
• Perform hands-on exploratory testing of agent behavior and review traces to judge quality and safety.
• Write clear test plans and bug reports, and maintain manual test documentation when needed.

Conhecimentos

Test strategy

Automation ownership

Ambiguity tolerance

Strong communication

Team collaboration

Problem solving

Formação académica

Bachelor's degree in CS or related field

Ferramentas

Python

Docker

Kubernetes

GitHub Actions

Locust

LangSmith

Descrição da oferta de emprego

Nexxa.AI is seeking a Senior/Staff SDET to own quality for AI agent systems in industrial settings. You will design and maintain test frameworks, simulate environments, and build evaluation harnesses while also performing hands-on testing to verify agent behavior, safety, and tool usage.

You will collaborate with ML and backend engineers and Forward Deployed teams to define what “good” looks like and implement automated gates and dashboards to measure quality beyond simple accuracy.