Senior ML Engineer — GenAI Platform & LLMs

Citigroup Inc.; Jersey City (NJ); On-site; USD 142,320 - 213,480; Full time

Benefits offered by this job

Medical benefits

401(k)

Paid time off

Job summary

Citi in Jersey City, NJ seeks a skilled Machine Learning Engineer to design, develop, and deploy Generative AI and LLM-powered platforms, emphasizing scalable, reliable, and high-performance services.

You will own end-to-end AI solutions, work with cross-functional teams to implement CI/CD, Docker/Kubernetes, and apply Agentic AI workflows to real Citi use cases such as search, chat agents, and analytics.

Qualifications

• 5+ years of experience in Software Development or a Systems Analysis role with ML focus.
• Proficient Python programming.
• Hands-on with Generative AI technologies and Large Language Models (LLMs).
• Experience implementing LLM-based applications (search, chat, analytics)
• Strong DevOps knowledge: CI/CD, IaC, automation.

Responsibilities

• Architect and Build AI Solutions: design end-to-end platform capabilities with Generative AI.
• Implement RAG Solutions using VectorRAG/GraphRAG with LLMs.
• Develop AI Workflows leveraging Agentic AI frameworks.
• Drive DevOps: CI/CD, automated testing, containerization (Docker, Kubernetes).
• Own projects from conception to deployment, manage risks and timelines.
• Lead rapid POC projects to test GenAI use cases.
• Ensure system integrity and regulatory compliance in decisions.
• Collaborate with cross-functional teams to innovate.

Skills

Python

Langchain

LLMs

CI/CD

Docker

Kubernetes

API design

Data storage

Problem solving

Education

Bachelor's degree in CS/CE/IS

Tools

Jenkins

GitLab

Docker

Kubernetes

Terraform

Job description

Citi in Jersey City, NJ seeks a skilled Machine Learning Engineer to design, develop, and deploy Generative AI and LLM-powered platforms, emphasizing scalable, reliable, and high-performance services.

You will own end-to-end AI solutions, work with cross-functional teams to implement CI/CD, Docker/Kubernetes, and apply Agentic AI workflows to real Citi use cases such as search, chat agents, and analytics.