Senior ML Engineer, AI Platform & Products (LLM)

BetterUp

New York (NY)

Hybrid

USD 200,000 - 275,000

Full time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Access to BetterUp coaching
Competitive compensation
Medical, dental, and vision insurance
Flexible paid time off
Volunteer Days
Learning and Development stipend
401(k) self contribution

Job summary

A leading coaching and AI company is seeking an experienced professional to build and ship ML systems, specifically focusing on LLM fine-tuning and prompt engineering. The role involves collaborating closely with engineers and product teams, measuring success through A/B tests, and making data-driven improvements. Candidates should have a strong background in Python and modern ML tools like PyTorch or TensorFlow, along with excellent communication skills. The position supports a hybrid work environment in New York.

Qualifications

  • 4+ years of experience building and shipping ML systems in production.
  • Hands-on experience with LLM fine-tuning, prompt engineering, or RAG pipelines.
  • Solid understanding of deployment basics.

Responsibilities

  • Prototype, evaluate, and fine-tune LLM-powered features.
  • Own the production lifecycle, collaborating with a tight squad.
  • Contribute to technical design and measure success metrics.

Skills

ML system development
Python for AI development
ML tooling knowledge
Communication skills
Curiosity and action bias

Tools

PyTorch
TensorFlow
Jupyter

Job description

A leading coaching and AI company is seeking an experienced professional to build and ship ML systems, specifically focusing on LLM fine-tuning and prompt engineering. The role involves collaborating closely with engineers and product teams, measuring success through A/B tests, and making data-driven improvements. Candidates should have a strong background in Python and modern ML tools like PyTorch or TensorFlow, along with excellent communication skills. The position supports a hybrid work environment in New York.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Engineer: LLMs & AI Platform (Remote)
Senior ML Engineer: LLMs & AI Platform (Remote)

Airbnb • United States

On-site
USD 248,000 - 310,000
Bonus
Equity
Employee Travel Credits
Senior ML Engineer – Enterprise AI & LLM Systems
Senior ML Engineer – Enterprise AI & LLM Systems

Factualiq • Mission (KS)

On-site
USD 110,000 - 130,000
Senior Applied ML Engineer — LLMs & AI Pipelines
Senior Applied ML Engineer — LLMs & AI Pipelines

PermitFlow • New York (NY)

Hybrid
USD 175,000 - 245,000
Competitive salary and equity
100% paid health, dental, and vision coverage
Company laptop and equipment stipend
+2
Principal ML Engineer — GenAI, LLMs & Production
Principal ML Engineer — GenAI, LLMs & Production

Alexander Chapman • Boulder (CO)

Hybrid
USD 120,000 - 160,000
Senior ML Engineer – LLMs & Customer Support AI
Senior ML Engineer – LLMs & Customer Support AI

Compunnel, Inc. • Philadelphia

On-site
USD 100,000 - 130,000
ML Engineer — Production-Grade AI & LLM/VLM Systems
ML Engineer — Production-Grade AI & LLM/VLM Systems

Nace.AI • Palo Alto (CA)

On-site
USD 120,000 - 160,000
Remote ML Engineering Manager: LLM Serving & Infra
Remote ML Engineering Manager: LLM Serving & Infra

Jobgether • United States

Remote
USD 176,166 - 251,666
Competitive salary range
Comprehensive health insurance
Paid parental leave
+4
Staff AI/ML Engineer (LLMs) — Lead & Deploy
Staff AI/ML Engineer (LLMs) — Lead & Deploy

ARKA • King of Prussia (PA)

On-site
USD 120,000 - 160,000
401k retirement plan
Paid vacation and holidays
Tuition assistance
+2
Founding ML Infra Engineer — Production-Grade LLMs
Founding ML Infra Engineer — Production-Grade LLMs

Realmlabs • Sunnyvale (CA)

On-site
USD 210,000 - 350,000
Market aligned compensation
Founding engineer equity
Medical, Dental, Vision, and Life insurance
+2
Staff ML Engineer: LLM Fine-Tuning for RTL/Verilog
Staff ML Engineer: LLM Fine-Tuning for RTL/Verilog

Highbrow Technology Inc • San Jose (CA)

On-site
USD 150,000 - 200,000