Senior AVP: Generative AI Quality Engineer

Citi; New York (NY); Hybrid; USD 31,000 - 63,000; Full time

Job summary

Citi is seeking an AI Quality Engineer to lead testing across Agentic AI and Retrieval-Augmented Generation systems within its Retail and Wealth Risk Engineering program. The role demands deep AI/ML quality expertise and broad testing discipline coverage.

The incumbent will own test strategies for end-to-end AI pipelines, ensure safety, reliability, and explainability at scale, and collaborate with MLOps and security teams in a hybrid environment.

Qualifications

• 8+ years of software or AI/ML quality engineering experience.
• 3+ years of hands-on experience with RAG systems or Agentic AI.
• Proven experience building automated test frameworks for non-deterministic AI systems.
• Strong background in performance testing and AI safety/security assessments.
• Familiarity with safety, robustness, and governance considerations for AI systems.

Responsibilities

• Design and execute end-to-end test strategies for Agentic AI pipelines.
• Validate agent reasoning, planning, and decision-making chains.
• Test tool-use correctness and agent memory systems across sessions.

Skills

Agentic AI Testing

RAG Testing

Test Automation

AI Safety & Security

Performance Testing

Domain Knowledge

Education

Bachelor’s degree in Computer Science or related field

Job description

Citi is seeking an AI Quality Engineer to lead testing across Agentic AI and Retrieval-Augmented Generation systems within its Retail and Wealth Risk Engineering program. The role demands deep AI/ML quality expertise and broad testing discipline coverage.

The incumbent will own test strategies for end-to-end AI pipelines, ensure safety, reliability, and explainability at scale, and collaborate with MLOps and security teams in a hybrid environment.