Machine Learning Engineer Vice President

Citigroup Inc.; Jersey City (NJ); On-site; USD 142,320 - 213,480; Full time

Benefits offered by this job

Medical benefits

401(k)

Paid time off

Job summary

Citi in Jersey City, NJ seeks a skilled Machine Learning Engineer to design, develop, and deploy Generative AI and LLM-powered platforms, emphasizing scalable, reliable, and high-performance services.

You will own end-to-end AI solutions, work with cross-functional teams to implement CI/CD, Docker/Kubernetes, and apply Agentic AI workflows to real Citi use cases such as search, chat agents, and analytics.

Qualifications

• 5+ years of experience in Software Development or a Systems Analysis role with ML focus.
• Proficient Python programming.
• Hands-on with Generative AI technologies and Large Language Models (LLMs).
• Experience implementing LLM-based applications (search, chat, analytics)
• Strong DevOps knowledge: CI/CD, IaC, automation.

Responsibilities

• Architect and Build AI Solutions: design end-to-end platform capabilities with Generative AI.
• Implement RAG Solutions using VectorRAG/GraphRAG with LLMs.
• Develop AI Workflows leveraging Agentic AI frameworks.
• Drive DevOps: CI/CD, automated testing, containerization (Docker, Kubernetes).
• Own projects from conception to deployment, manage risks and timelines.
• Lead rapid POC projects to test GenAI use cases.
• Ensure system integrity and regulatory compliance in decisions.
• Collaborate with cross-functional teams to innovate.

Skills

Python

Langchain

LLMs

CI/CD

Docker

Kubernetes

API design

Data storage

Problem solving

Education

Bachelor's degree in CS/CE/IS

Tools

Jenkins

GitLab

Docker

Kubernetes

Terraform

Job description

We are seeking a highly skilled and motivated Machine Learning Engineer to join our technology team. The ideal candidate will be responsible for designing, developing, and deploying cutting-edge applications that leverage Generative AI and Large Language Models (LLMs). This role involves architecting end-to-end platform services with a focus on scalability, reliability, and performance. You will be a key player in driving the implementation of new AI-driven systems and programs that will impact all business line at Citi globally.

Responsibilities

• Architect and Build AI Solutions: Design and architect end-to-end platform capabilities and services that integrate with Generative AI technologies.

• Implement RAG Solutions: Develop and deploy solutions using VectorRAG and GraphRAG techniques with both open-source and commercial Large Language Models.

• Develop AI Workflows: Apply a strong understanding of Agentic AI workflows and frameworks to build sophisticated, automated systems.

• Drive DevOps Best Practices: Implement robust CI/CD pipelines, automated testing, and containerization (Docker, Kubernetes) to streamline the development and deployment of machine learning models.

• End-to-End Project Ownership: Manage your deliverables from conception to deployment, proactively identifying and mitigating risks to ensure project goals are met.

• Rapid Prototyping: Perform and lead quick proof-of-concept (POC) projects to evaluate and demonstrate the feasibility of new GenAI use cases.

• Ensure System Integrity: Appropriately assess and manage risk in all technical and business decisions, ensuring compliance with applicable laws, rules, and regulations, and maintaining transparency in reporting and managing control issues.

• Collaborate and Innovate: Work closely with cross-functional teams to solve complex problems, adapt quickly to changing priorities, and contribute to a culture of innovation.

Required Qualifications

• Experience: 5+ years of relevant experience in Software Development or a Systems Analysis role, with a strong focus on machine learning.

• Programming Skills: Strong object-oriented programming skills with expert-level proficiency in Python.

• AI/ML Expertise: Deep experience with AI/ML frameworks (e.g., Langchain) and hands-on experience with Generative AI technologies and Large Language Models.

• Application Development: Proven experience building applications that apply LLMs and GenAI to use cases such as search, chat agents, and guided analytics.

• DevOps Knowledge: Strong, working knowledge of DevOps tools (e.g., Jenkins, GitLab, Docker, Kubernetes) and Infrastructure as Code (IaC) practices.

• Architectural Understanding: Solid understanding of modern software development practices, including microservices architecture and API design principles.

• Data Proficiency: Experience with various data storage solutions (e.g., NoSQL, SQL, data lakes) and data pipeline orchestration.

• Problem-Solving: Excellent analytical and problem-solving skills with a proven ability to troubleshoot complex technical issues and provide innovative solutions.

Education

Bachelor's Degree in Computer Science, Computer Engineering, Information Systems or equivalent work experience

Desired Skills

• Cloud Architecture: Experience with various cloud platforms (e.g., AWS, GCP, Azure) and architectures (e.g., single/multi-tenant).

• Large-Scale Systems: Experience designing and implementing microservices-based architectures for large-scale platforms in complex environments.

• Leadership: Demonstrated leadership, project management skills, and a proven track record of self-motivation and continuous learning.

Job Family Group

Technology

Job Family

Applications Development

Time Type

Full time

Primary Location

Jersey City New Jersey United States

Primary Location Full Time Salary Range

$142,320.00 - $213,480.00

• In addition to salary, Citi’s offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards.
• Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs.
• Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

AI Frameworks, Generative AI, Large Language Model (LLM) Fine-Tuning, ML Frameworks, Python (Programming Language).

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.