Senior QA Engineer - AI & Multi-Agent Systems Testing

Keylent Inc; Dallas (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Keylent Inc. is seeking a hands-on QA Engineer to design end-to-end testing strategies for agentic AI and multi-agent systems in production environments. You will partner with operations to ensure resiliency, reliability, and scale, establishing QA frameworks and reusable test assets across the SDLC.

The role requires leadership to mentor QA engineers and align with data, ops, and platform teams. The ideal candidate will have strong Python skills, experience with LLM evaluation, and a background

Qualifications

• 7 years in Software QA/Testing with 2 years in AI/ML or LL/m-based systems.
• Hands-on experience testing agentic/multi-agent architectures.

Responsibilities

• Design and execute end-to-end testing strategies for agentic AI solutions.
• Build reusable test artifacts and frameworks for multi-agent systems.
• Lead QA across dev to prod with CI/CD integration.

Skills

Python

LLM evaluation

Distributed systems

CI/CD

Tools

LangChain

LangGraph

LlamaIndex

DSPy

Azure DevOps

Job description

Keylent Inc. is seeking a hands-on QA Engineer to design end-to-end testing strategies for agentic AI and multi-agent systems in production environments. You will partner with operations to ensure resiliency, reliability, and scale, establishing QA frameworks and reusable test assets across the SDLC.

The role requires leadership to mentor QA engineers and align with data, ops, and platform teams. The ideal candidate will have strong Python skills, experience with LLM evaluation, and a background