GenAI & Production ML Engineer (Hybrid NYC)

Atlas Search

United States

Hybrid

USD 150,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A leading global financial institution is seeking a Machine Learning & AI Engineer for the Production Runtime Experience team in New York, NY (Hybrid). The role involves designing ML solutions to improve system reliability and requires strong Python skills, experience with LLMs, and cloud platforms. Ideal candidates should have at least 3 years of relevant experience in software development and production ML systems.

Qualifications

  • 3+ years of software development experience; strong Python experience preferred.
  • 3+ years of experience building and maintaining production ML systems.
  • Hands-on experience with Large Language Models (LLMs) and prompt engineering.

Responsibilities

  • Design and implement tool-calling agents for ML solutions.
  • Build evaluation frameworks for open-source and foundational LLMs.
  • Integrate agents into observability and incident management systems.
  • Collaborate with teams to translate operational challenges into AI-driven solutions.
  • Implement safety and compliance measures in systems.
  • Optimize model performance and cost through various techniques.

Skills

Software development (Python, C/C++, Go, or Java)
Building and maintaining production ML systems
Experience with Large Language Models (LLMs)
Understanding of commercial and open-source LLMs
Familiarity with applied statistics and core ML concepts
Experience with cloud platforms (AWS preferred)
Strong analytical thinking skills
Strong communication skills
Strong collaboration skills

Tools

AWS
ECS/EKS
Lambda
S3
DynamoDB
SageMaker
Terraform
CloudFormation

Job description

A leading global financial institution is seeking a Machine Learning & AI Engineer for the Production Runtime Experience team in New York, NY (Hybrid). The role involves designing ML solutions to improve system reliability and requires strong Python skills, experience with LLMs, and cloud platforms. Ideal candidates should have at least 3 years of relevant experience in software development and production ML systems.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning & AI Engineer
Machine Learning & AI Engineer

Atlas Search • United States

Hybrid
USD 150,000 - 210,000
Senior ML Engineer - Production AI, Hybrid NYC
Senior ML Engineer - Production AI, Hybrid NYC

People in AI • New York (NY)

Hybrid
USD 180,000 - 260,000
ML Engineering Lead – Production AI Solutions
ML Engineering Lead – Production AI Solutions

TWG Global • New York (NY)

Hybrid
USD 275,000 - 375,000
Discretionary bonus
Full range of medical benefits
Senior ML Engineer — GenAI Production Systems
Senior ML Engineer — GenAI Production Systems

Capital Group • Los Angeles (CA)

On-site
USD 201,683 - 322,693
Flexible work options
Health benefits
Matching gifts for charitable contributions
+1
AI/ML Engineer — Production Systems & Hybrid AI
AI/ML Engineer — Production Systems & Hybrid AI

Daice Labs • United States

Remote
USD 100,000 - 140,000
Equity participation
401 participation
Health benefits
Applied AI Engineer — Production ML & LLMs (Hybrid NYC)
Applied AI Engineer — Production ML & LLMs (Hybrid NYC)

Logicbroker • New York (NY)

Hybrid
USD 102,000 - 138,000
Applied AI/NLP Scientist - Production-Ready ML (Hybrid NY)
Applied AI/NLP Scientist - Production-Ready ML (Hybrid NY)

Harnham • New York (NY)

Hybrid
USD 200,000 - 250,000
Competitive Pay
Performance bonus
Equity
+2
Agentic AI Engineer, Core Platforms — Production ML
Agentic AI Engineer, Core Platforms — Production ML

American Express Company • New York (NY)

Hybrid
USD 89,000 - 150,000
Bonus incentives
6% retirement match
Comprehensive benefits
+1
Senior AI Engineer: Generative AI & Production ML (Hybrid)
Senior AI Engineer: Generative AI & Production ML (Hybrid)

Accion Labs • United States

Hybrid
USD 120,000 - 150,000
GenAI/ML Engineer - LLM Apps & Pipelines (Hybrid NJ)
GenAI/ML Engineer - LLM Apps & Pipelines (Hybrid NJ)

Iris Software Inc. • Jersey City (NJ)

Hybrid
USD 100,000 - 140,000