Lead AI QA Engineer: Automation & Orchestration

Embedded Shishya; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Annual bonus

401(k) match

Flexible PTO

11 paid holidays

Learning & development access

Health insurance

Job summary

Nextech is seeking a Lead Software Engineer in Test – Agentic AI to drive quality engineering across AI-powered applications and distributed systems. You will design scalable automation frameworks, validate complex AI agent behaviors, and ensure high-quality delivery across UI, API, backend, and AI orchestration layers.

This role requires leadership of QA initiatives for agentic AI and LLM workflows, collaboration with cross-functional teams, and strong experience in cloud-native environments.

Qualifications

• Bachelor’s degree in Computer Science, MIS, Engineering, or related field.

Responsibilities

• Design, develop, and maintain scalable automation frameworks across UI, API, backend, and AI-driven apps.
• Lead quality engineering initiatives for Agentic AI systems, including LLM workflows and distributed orchestration.
• Validate AI agent behaviors: multi-agent coordination, tool calling, prompt chaining, memory retention, workflows, and retries.
• Develop and execute functional, integration, regression, end-to-end, and performance tests in cloud-native environments.
• Collaborate with Engineers, PMs, and DevOps to integrate testing throughout the SDLC.
• Build reusable automation for APIs, orchestration layers, and enterprise integrations.
• Maintain robust test environments, CI/CD integrations, and observability pipelines.
• Drive best practices in code quality, maintainability, and testability.
• Lead validation for AI workflow resiliency and distributed system reliability under failures.
• Mentor QA engineers and contribute to scalable QA standards and reporting.

Skills

Automation Frameworks

Playwright

Cypress

API Testing

UI Automation

Backend Testing

AI Orchestration

LangGraph/CrewAI

CI/CD

Azure/AWS

Kubernetes

LLM workflows

Test Strategy

JavaScript/TypeScript

Java

Education

Bachelor's degree in Computer Science

Tools

Playwright

Cypress

Postman

K6

Job description

Nextech is seeking a Lead Software Engineer in Test – Agentic AI to drive quality engineering across AI-powered applications and distributed systems. You will design scalable automation frameworks, validate complex AI agent behaviors, and ensure high-quality delivery across UI, API, backend, and AI orchestration layers.

This role requires leadership of QA initiatives for agentic AI and LLM workflows, collaboration with cross-functional teams, and strong experience in cloud-native environments.