AI Quality Assurance Lead — GenAI, LLM & RAG (8M)

Cloud Analytics Technologies, LLC; Weehawken (NJ); On-site; USD 88,000 - 125,000; Full time

Job summary

Cloud Analytics Technologies, LLC in Weehawken, NJ seeks an AI QA Lead to own AI adoption, governance, and quality across the QE lifecycle. The role emphasizes agentic AI, GenAI, LLM, RAG, and specification-driven testing with automation and governance.

Responsibilities include defining risk, designing test scenarios, validating AI models, and delivering auditable QE outcomes while collaborating with engineering, DevOps, and security teams.

Qualifications

• Minimum 15 years of Quality Engineering experience required.
• QE strategy, test automation, and cross-functional delivery experience are essential.
• Practical exposure to GenAI, LLM, RAG, or AI-enabled test automation is desired.
• Experience with agile delivery, CI/CD, test governance, and enterprise SDLC is expected.
• Bachelor's degree in a technical field is mandatory; master's and related certifications are preferred.

Responsibilities

• Lead AI-assisted requirement analysis, risk identification, acceptance-criteria definition, and specification-driven test design.
• Drive AI-based generation of test scenarios aligned to customer requirements.
• Govern LLM, RAG, and agentic AI validation including model behavior checks and hallucination validation.
• Guide automation-ready assets, self-healing automation frameworks, CI/CD orchestration, and audit-ready reporting.
• Define QE outcomes across test coverage, defect leakage, automation ROI, release confidence, and delivery efficiency.
• Engage with customers, engineering, architecture, DevOps, security, compliance, and leadership to deliver QE outcomes.

Skills

QE strategy

Test automation

Customer-facing leadership

Stakeholder management

Cross-functional delivery

Education

Bachelor's degree in computer science/IT/Engineering

Master's degree and relevant QE, cloud, automation, or AI certifications preferred

Job description

Cloud Analytics Technologies, LLC in Weehawken, NJ seeks an AI QA Lead to own AI adoption, governance, and quality across the QE lifecycle. The role emphasizes agentic AI, GenAI, LLM, RAG, and specification-driven testing with automation and governance.

Responsibilities include defining risk, designing test scenarios, validating AI models, and delivering auditable QE outcomes while collaborating with engineering, DevOps, and security teams.