Senior GenAI Engineer: End-to-End LLM Systems

Citi; New York (NY); On-site; USD 142,000 - 213,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

401(k)

Life insurance

Disability insurance

Wellness program

Paid time off

Job summary

Citi in New York seeks a Senior Generative AI Developer to architect, build, and operationalize GenAI and LLM solutions for the COO Technology Division. This hands‑on role collaborates with operations leads, data engineers, product managers, and architects to deliver enterprise‑grade AI capabilities at scale.

You will mentor developers, lead code reviews, and shape GenAI standards while ensuring governance and data privacy across deployments.

Qualifications

• 6+ years of software engineering experience with 2+ years in Generative AI/LLM development.
• Expert-level Python with API development (FastAPI, Flask).
• Deep hands-on with LangChain, LangGraph, LlamaIndex and RAG architectures.
• Experience with Google Cloud AI Platform and multiple LLM providers (OpenAI/Azure/Anthropic/AWS/Vertex).
• Strong prompt engineering, few-shot learning, and chain-of-thought techniques.
• Cloud experience on AWS, Azure, or GCP; SQL/NoSQL and vector databases.
• CI/CD, Docker, Kubernetes, Git; testing and production reliability.
• Financial services domain experience is a plus.

Responsibilities

• Design and build end-to-end GenAI pipelines including LLM integrations, RAG, and autonomous agents.
• Develop production-grade Python services and APIs powering AI features across COO platforms.
• Integrate and fine-tune LLMs and embeddings for domain-specific financial use cases.
• Create and maintain ML/GenAI deployment pipelines with robust MLOps practices.
• Develop multi-agent orchestration for complex operational workflows.
• Collaborate with AI Risk and Compliance for governance and privacy standards.
• Design data pipelines with vector databases (Pinecone, Weaviate, pgvector).
• Mentor juniors, lead code reviews, and contribute to GenAI standards.

Skills

Python

GenAI

LLM

Prompt engineering

Few-shot learning

Chain-of-thought

RAG

OpenAI API

Azure OpenAI

AWS Bedrock

Vertex AI

LangChain

LangGraph

LlamaIndex

Pinecone

Kubernetes

Docker

SQL

NoSQL

Vector databases

PostgreSQL

Cloud platforms

Education

Bachelor's degree

Master's degree

Tools

LangChain

LangGraph

LlamaIndex

Google Cloud AI Platform

MLflow

Docker

Kubernetes

GitHub Actions

Job description

Citi in New York seeks a Senior Generative AI Developer to architect, build, and operationalize GenAI and LLM solutions for the COO Technology Division. This hands‑on role collaborates with operations leads, data engineers, product managers, and architects to deliver enterprise‑grade AI capabilities at scale.

You will mentor developers, lead code reviews, and shape GenAI standards while ensuring governance and data privacy across deployments.