GenAI & Production ML Engineer (Hybrid NYC)

Atlas Search; United States; Hybrid; USD 150,000 - 210,000; Full time

Job summary

A leading global financial institution is seeking a Machine Learning & AI Engineer for the Production Runtime Experience team in New York, NY (Hybrid). The role involves designing ML solutions to improve system reliability and requires strong Python skills, experience with LLMs, and cloud platforms. Ideal candidates should have at least 3 years of relevant experience in software development and production ML systems.

Qualifications

• 3+ years of software development experience; strong Python experience preferred.
• 3+ years of experience building and maintaining production ML systems.
• Hands-on experience with Large Language Models (LLMs) and prompt engineering.

Responsibilities

• Design and implement tool-calling agents for ML solutions.
• Build evaluation frameworks for open-source and foundational LLMs.
• Integrate agents into observability and incident management systems.
• Collaborate with teams to translate operational challenges into AI-driven solutions.
• Implement safety and compliance measures in systems.
• Optimize model performance and cost through various techniques.

Skills

Software development (Python, C/C++, Go, or Java)

Building and maintaining production ML systems

Experience with Large Language Models (LLMs)

Understanding of commercial and open-source LLMs

Familiarity with applied statistics and core ML concepts

Experience with cloud platforms (AWS preferred)

Strong analytical thinking skills

Strong communication skills

Strong collaboration skills

Tools

AWS

ECS/EKS

Lambda

S3

DynamoDB

SageMaker

Terraform

CloudFormation

Job description

A leading global financial institution is seeking a Machine Learning & AI Engineer for the Production Runtime Experience team in New York, NY (Hybrid). The role involves designing ML solutions to improve system reliability and requires strong Python skills, experience with LLMs, and cloud platforms. Ideal candidates should have at least 3 years of relevant experience in software development and production ML systems.