Senior SDET – AI Agent Systems for Industrial Automation

Nexxa.AI; United States; Remote; USD 120,000 - 190,000; Full time

Benefits offered by this job

Competitive compensation

Equity package

Career development

Job summary

Nexxa.AI is seeking a Senior / Staff SDET to own quality for AI agent systems. You will build evaluation harnesses, simulators, and CI/CD gates, while also performing hands-on testing of agents in industrial settings.

Work with ML, backend, and Forward Deployed Engineers to define what good looks like and quantify it continuously. You will drive automated and manual testing strategies, develop robust test data, and mentor engineers on best practices for probabilistic, LLM-driven systems while

Qualifications

• 5+ years as an SDET, QA engineer, or software engineer with a strong testing focus.
• Proven experience in manual and automated testing, including exploratory testing and bug reports.
• Strong programming skills (Python) with a software engineering mindset.

Responsibilities

• Design, build, and maintain test frameworks, evaluation harnesses, and regression suites for LLM-based agents.
• Develop simulators, mocks, and sandbox environments for industrial systems and tool APIs.
• Implement API, contract, integration, and end-to-end tests for services and orchestration layers.

Skills

Test automation

Manual testing

Exploratory testing

Python

CI/CD

Docker

Kubernetes

API testing

LLM testing

Bug reporting

Tools

LangSmith

promptfoo

DeepEval

RAGAS

Langfuse

Weights & Biases

Job description

Nexxa.AI is seeking a Senior / Staff SDET to own quality for AI agent systems. You will build evaluation harnesses, simulators, and CI/CD gates, while also performing hands-on testing of agents in industrial settings.

Work with ML, backend, and Forward Deployed Engineers to define what good looks like and quantify it continuously. You will drive automated and manual testing strategies, develop robust test data, and mentor engineers on best practices for probabilistic, LLM-driven systems while