Forward Deployed AI Engineer — AVP

Citi; Greater London; Híbrido; GBP 80.000 - 110.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid working model (up to 2 days at/

27 days annual leave

Discretionary annual bonus

Private Medical Care & Life Insurance

Employee Assistance Program

Pension Plan

Paid Parental Leave

Employee discounts

Descripción de la vacante

Citi London is hiring an intermediate Forward Deployed Engineer to build automated evaluation harnesses, optimize prompts and output schemas, and drive CI/CD testing for production AI agents. You’ll work with business and technology teams to deliver reliable agent workflows and secure, scalable systems.

The role requires hands-on Python development, API integration, and strong testing expertise within a hybrid work model. Excellent collaboration and communication are essential.

Formación

• Proficient Python development with REST/gRPC APIs, Docker, and Git workflows.
• Experience with AI evaluation frameworks, BLEU/ROUGE, and automated testing.
• Experience building automated test pipelines in CI/CD environments (Lightspeed, Tekton, Jenkins).
• Ability to work under pressure with tight sprint deadlines and changes in model outputs.
• Strong written/verbal communication and meticulous software quality.

Responsabilidades

• Construct automated evaluation test suites using Agentflow Studio.
• Curate domain-specific datasets and regression testbeds with experts.
• Optimize prompts, system instructions and JSON output parsers for determinism.
• Maintain automated test pipelines and gates in Lightspeed CI/CD.
• Analyze agent errors and recommend coding and prompt improvements.
• Implement security measures and Lakera Guardrail policies post‑implementation.
• Provide performance metrics and diagnostic reporting to stakeholders.
• Operate with limited supervision as evaluation SME to the pod team.

Conocimientos

Python

REST/gRPC APIs

AI evaluation frameworks

CI/CD pipelines

Educación

Bachelor’s degree in Computer Science or related field

Herramientas

Docker

Git workflows

Lightspeed CI/CD

Tekton

Jenkins

Descripción del empleo

Citi London is hiring an intermediate Forward Deployed Engineer to build automated evaluation harnesses, optimize prompts and output schemas, and drive CI/CD testing for production AI agents. You’ll work with business and technology teams to deliver reliable agent workflows and secure, scalable systems.

The role requires hands-on Python development, API integration, and strong testing expertise within a hybrid work model. Excellent collaboration and communication are essential.