Hybrid QA Automation Engineer - AI Testing Python/Selenium

Citi; New York (NY); Hybrid; USD 26,000 - 47,000; Full time

Job summary

Citi is seeking a Senior QA Automation Engineer to design and implement comprehensive test strategies for AI/ML and Generative AI applications. You will build scalable test automation with Python and Selenium, perform rigorous data validation with SQL, and collaborate with data scientists, engineers, and product managers to ensure high-quality software releases.

The role emphasizes mentoring, adherence to SDLC, and driving QA practices across teams, with a hybrid work model across Citi locations.

Qualifications

• 7+ years in Quality Engineering or Software/Data QA.
• Strong Python scripting for test automation.
• Hands-on experience with web automation using Selenium.
• SQL experience for data validation.
• Experience testing AI/ML systems; Generative AI knowledge desired.
• Solid QE fundamentals and SDLC understanding.
• Ability to design evaluation frameworks for GenAI, LLM, and RAG.
• Excellent analytical and communication skills.

Responsibilities

• Lead UAT processes and product rollout testing.
• Conduct complex process monitoring and audits; report issues and propose solutions.
• Ensure SDLC standards and documentation are followed; improve docs.
• Monitor conformance to standards; identify risks and mitigations.
• Document findings and perform root-cause analyses; propose improvements.
• Produce quality metrics reports and ensure traceability.
• Mentor junior team members and share knowledge.
• Collaborate with data scientists, software engineers, and product managers.
• Develop and execute test strategies for AI/ML and Generative AI applications.

Skills

Python scripting for test automation

Selenium web automation

AI/ML testing

Quality Engineering fundamentals

SDLC knowledge

Communication skills

Education

Bachelor’s degree or equivalent experience

Tools

Selenium

Langfuse

Arize AI

Fiddler AI

RAGAS

Promptfoo

DeepEval

TruLens

Job description

Citi is seeking a Senior QA Automation Engineer to design and implement comprehensive test strategies for AI/ML and Generative AI applications. You will build scalable test automation with Python and Selenium, perform rigorous data validation with SQL, and collaborate with data scientists, engineers, and product managers to ensure high-quality software releases.

The role emphasizes mentoring, adherence to SDLC, and driving QA practices across teams, with a hybrid work model across Citi locations.