Senior Backend QA Engineer - AI API Validation

Nexaminds; United States; On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Stock options

Remote work options

Flexible working hours

Benefits above the law

Mentorship and learning opportunities

Job summary

Nexaminds is seeking a Senior Backend QA Engineer in the United States to design and implement automated test frameworks for AI-enabled systems. You will validate non-deterministic outputs from AI agents and MCP applications, analyze upstream architectures, and drive shift-left testing across pre-production environments.

The role emphasizes building scalable automation, leveraging AI techniques, and collaborating with cross-functional teams to ensure high-quality backend services and reliable

Qualifications

• API & Backend Automation: Strong hands-on experience in API test automation using Karate Framework and manual API testing with Postman.
• AI & Non-Deterministic Testing: Understanding of testing non-deterministic systems, including response scoring techniques, AI agent/chatbot validation, or evaluation concepts like LLM as a Judge.
• Technical Code Analysis: Ability to read and analyze source code to understand backend architectures, microservices, service dependencies, and upstream impacts.
• Structured Test Planning: Proven skill in reviewing requirement documents to create concise, precise test plans and automation frameworks without relying on rigid language-specific constraints.
• Local Environment Setup: Hands-on experience configuring local dev environments for early-stage (shift-left) test execution.
• Proactive learning of emerging AI technologies and building dynamic testing solutions where standard deterministic QA falls short.
• Clear, structured, and direct technical communication.

Responsibilities

• API Testing & Automation: Analyze OpenAPI/Swagger specs to design comprehensive test plans, execute manual testing via Postman, and build robust automated test suites using Karate Framework.
• AI System & Agent Validation: Test and evaluate non-deterministic AI outputs, internal AI agents (built with ADK), and MCP applications using evaluation metrics and scoring techniques.
• Architecture & Upstream Analysis: Inspect source code and upstream services to identify critical dependencies, evaluate technical system impacts, and manage test data across pre-production and production environments.
• Shift-Left & Local Testing: Configure and launch local development environments to conduct early-stage testing on backend APIs and microservices before deployment.
• AI-Integrated Test Frameworks: Design scalable test automation strategies that dynamically integrate AI capabilities to validate scenarios standard testing tools cannot handle.

Skills

API automation

Backend testing

AI/ML testing concepts

Structured test planning

Communication

Education

Bachelor's degree in CS or related

Tools

Karate Framework

Postman

Swagger/OpenAPI

Git

Job description

Nexaminds is seeking a Senior Backend QA Engineer in the United States to design and implement automated test frameworks for AI-enabled systems. You will validate non-deterministic outputs from AI agents and MCP applications, analyze upstream architectures, and drive shift-left testing across pre-production environments.

The role emphasizes building scalable automation, leveraging AI techniques, and collaborating with cross-functional teams to ensure high-quality backend services and reliable