GenAI Solutions Lead: Enterprise LLM Architect & MLOps

Citigroup Inc.; New York (NY); On-site; USD 177,000 - 265,000; Full time

Job summary

Citi in New York seeks a Lead Generative AI Developer to architect and implement GenAI and LLM solutions at scale. You will collaborate with operations, data engineers, product managers, and architects to deliver enterprise-grade AI capabilities across COO Technology.

The role is hands-on and requires building end-to-end GenAI pipelines, MLOps, and multi-agent orchestration with strong governance and data privacy adherence.

Qualifications

• 10+ years of professional software engineering experience, with at least 2+ years focused on Generative AI / LLM application development
• Python proficiency including async programming & API development (FastAPI, Flask)
• GenAI & LLM Stack with LangChain, LangGraph, LlamaIndex; Google Cloud AI Platform; RAG architectures; embeddings; prompt engineering; LLM APIs
• Machine Learning foundations; model evaluation, fine-tuning (LoRA, PEFT); inference optimization
• Cloud experience with AWS, Azure, or GCP
• SQL, NoSQL, vector databases (Pinecone, Weaviate, Chroma, pgvector)
• CI/CD, Docker, Kubernetes, Git; automated testing
• Banking/fintech experience is a plus

Responsibilities

• Design & Build GenAI Solutions: Architect end-to-end Generative AI pipelines incl. LLMs, RAG, autonomous agents, prompts
• Python Development: Build production-ready Python services and APIs
• Model Integration & Fine-tuning: Evaluate, integrate, and fine-tune LLMs and embeddings
• MLOps & Deployment: Create ML/GenAI deployment pipelines with observability and governance
• Agentic Workflows: Develop multi-agent orchestration for complex workflows
• Enterprise AI Governance: Align with AI Risk, Compliance, and data privacy standards
• Data Engineering: Design data pipelines; work with vector databases and enterprise data platforms
• Technical Leadership: Mentor engineers, review code, define GenAI standards
• Stakeholder Collaboration: Translate business needs into AI solutions with timelines

Skills

Python

LangChain

LangGraph

LlamaIndex

Prompt engineering

RAG architectures

LLM APIs

ML fundamentals

Cloud platforms

SQL

NoSQL

CI/CD

Docker

Kubernetes

Git

Google Cloud AI Platform

Education

Bachelor’s degree

Master’s degree preferred

Tools

Docker

Kubernetes

FastAPI

Flask

Git

MLflow

Job description

Citi in New York seeks a Lead Generative AI Developer to architect and implement GenAI and LLM solutions at scale. You will collaborate with operations, data engineers, product managers, and architects to deliver enterprise-grade AI capabilities across COO Technology.

The role is hands-on and requires building end-to-end GenAI pipelines, MLOps, and multi-agent orchestration with strong governance and data privacy adherence.