Lead Software Engineer in Test – Agentic AI (Remote - US)

Nextech; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Generous annual bonus

401(k) with employer match

Flexible Time Off

11 paid holidays

LinkedIn Learning access

Health insurance

Job summary

Nextech is a leader in specialty healthcare technology solutions and offers a generous bonus structure, comprehensive benefits, and a commitment to employee growth. We’re seeking experienced QA/SDET engineers to help build automated testing across UI, API, backend, and AI-driven applications.

Join our remote-friendly team to mentor others, drive testing best practices, and ensure reliability of AI workflows and distributed systems in cloud environments.

Qualifications

• 8+ years in Software Development or SDET/SET roles.
• Hands-on automation framework development using JavaScript/TypeScript or Java.
• Experience with Playwright, Cypress, Postman, or similar tools.
• Experience testing AI-powered applications, LLM systems, or AI orchestration.
• Strong API, backend, UI, and end-to-end testing skills.
• Cloud-native and containerized environments experience.

Responsibilities

• Design, develop, and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven apps.
• Lead QA initiatives for Agentic AI systems, including LLM workflows and orchestration platforms.
• Validate AI agent behaviors, multi-agent coordination, and prompt workflows.
• Develop and execute testing strategies across cloud-native and distributed environments.
• Collaborate with engineers, product managers, and DevOps to integrate testing in the SDLC.

Skills

SDET/SET experience

Automation testing

API testing

UI automation

Agile collaboration

Education

Bachelor’s degree in Computer Science or related field

Tools

Playwright

Cypress

Postman

K6

CI/CD tooling

Azure/AWS/GCP

Docker/Kubernetes

Job description

Why join Nextech?

We are a leader in specialty healthcare technology solutions.

We’re committed to hiring and retaining talent, which is why we invest in our employees through competitive pay, a generous bonus structure, great healthcare, a comprehensive wellness program, and many other benefits.

If you are a software engineer, finance or accounting professional, customer support specialist, or a business development expert with a passion for healthcare technology (just to name a few), we want to hear from you.

We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics are encouraged to apply. If you are a candidate in need of assistance or an accommodation in the application process, please contact [e-mail].

Essential Functions

In addition to adhering to Nextech’s conduct and behavioral standards, responsibilities include:

• Design, develop, and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven applications.
• Lead quality engineering initiatives for Agentic AI systems, including LLM workflows, RAG pipelines, autonomous agents, and distributed orchestration platforms.
• Validate complex AI agent behaviors such as multi-agent coordination, tool calling, prompt chaining, memory retention, conversational workflows, and fallback/retry mechanisms.
• Develop and execute functional, integration, regression, end-to-end, and performance testing strategies across cloud-native and distributed environments.
• Collaborate with Software Engineers, Product Managers, and DevOps teams to integrate testing throughout the software development lifecycle.
• Build reusable automation solutions to validate APIs, orchestration layers, asynchronous workflows, enterprise integrations, and AI-driven business processes.
• Design and maintain robust test environments, CI/CD integrations, cloud execution platforms, and automation pipelines to improve efficiency and reliability.
• Establish and drive best practices related to code quality, maintainability, scalability, dependency injection, observability, and testability.
• Lead validation efforts for AI workflow resiliency, distributed system reliability, data consistency, and orchestration performance under failure and edge-case conditions.
• Mentor QA engineers and contribute to the development of scalable QA standards, automation strategies, reporting practices, and continuous improvement initiatives.

Minimum Requirements

• Bachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.
• 8+ years of experience in Software Development or Software Engineer in Test (SDET/SET) roles.5+ years of hands‑on experience developing automation frameworks using JavaScript/TypeScript or Java.
• Strong experience with automation tools such as Playwright, Cypress, Postman, K6, or equivalent frameworks.2+ years of experience testing AI-powered applications, LLM systems, Agentic AI platforms, orchestration frameworks, or autonomous workflows.
• Hands‑on experience validating agent orchestration workflows, conversational AI applications, multi‑step reasoning systems, and AI-driven business processes.
• Experience testing AI orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar technologies.
• Strong expertise in API testing, backend integration testing, UI automation, and end‑to‑end workflow validation.
• Solid understanding of automation architecture, design patterns, anti‑patterns, dependency injection, and inversion of control principles.
• Experience working in cloud‑native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).Proven experience integrating automated test suites into CI/CD pipelines and distributed cloud environments.
• Experience validating asynchronous, event‑driven, and distributed systems with a focus on resiliency and fault tolerance.
• Strong analytical, debugging, troubleshooting, and problem‑solving skills.
• Excellent organizational, communication, and stakeholder collaboration skills in Agile environments.
• Experience with AI observability, telemetry, RAG pipeline validation, vector databases, or prompt evaluation frameworks (preferred).

Preferred Qualifications

• Experience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.
• Experience with AI observability tools, telemetry platforms, and prompt evaluation frameworks.Experience validating RAG pipelines, vector databases, and AI response accuracy.
• Knowledge of healthcare systems, HIPAA compliance, and regulated enterprise environments.
• Experience with event‑driven architectures, messaging systems, and distributed data platforms (including SQL Server).
• Prior experience leading QA teams, mentoring engineers, and implementing enterprise test reporting and quality metrics practices.

Work Environment/Physical Demands

• Remote work

• Activities require a significant amount of work in front of a computer monitor.

Total Rewards

• Generous annual bonus opportunity
• 401(k) with Employer Match
• Flexible Time Off: take time off when you need it without worrying about available hours
• 11 paid holidays
• Your Day Your Way - Celebrate a day of cultural or social significance to you
• Access to Linkedin Learning courses for professional development
• Insurance: Choice of Medical, Dental, and Vision plans
• Health Savings Account with employer match
• Flexible Spending Account
• 100% Company-Paid Parental leave (After 6 months with the company)
• Company-Paid Life Insurance and Short/Long Term Disability Insurance
• Nextech Luminary Peer Recognition Program
• Employee Assistance Program with free counseling sessions available
• Corporate Discounts on Retail, Travel, and Entertainment