Machine Learning Engineering Manager - LLM Serving (Remote - US)

Jobgether

United States

A distancia

USD 176.166 - 251.666

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Competitive salary range
Comprehensive health insurance
Paid parental leave
401(k) retirement plan
Monthly meal allowance
Paid vacation days
Flexible remote/hybrid work options

Descripción de la vacante

A leading company in AI solutions is seeking a Machine Learning Engineering Manager to lead a team in developing high-scale LLM serving infrastructure. The role involves managing projects and collaborating with ML researchers to optimize system performance. Ideal candidates have a strong background in software engineering and experience in managing teams. The position comes with competitive salary and comprehensive benefits, including flexible working options.

Formación

  • 5+ years of experience in software or machine learning engineering.
  • 2+ years managing engineering teams.
  • Hands-on ML engineering background with production-quality systems.

Responsabilidades

  • Lead an engineering team to design and deploy LLM serving infrastructure.
  • Collaborate closely with product and personalization teams.
  • Develop observability and monitoring frameworks for ML systems.

Conocimientos

Software or Machine Learning Engineering experience
Management experience
ML engineering hands-on experience
Technical expertise in LLM infrastructure
Leadership and communication skills

Herramientas

MLFlow

Descripción del empleo

Machine Learning Engineering Manager - LLM Serving (Remote - US)

We are currently looking for a Machine Learning Engineering Manager - LLM Serving & Infrastructure in the United States.

This role offers the opportunity to lead and shape the development of high‑scale, low‑latency LLM serving infrastructure for advanced personalization and recommendation systems. You will manage a talented engineering team while collaborating closely with machine learning researchers, data scientists, and product teams to deliver robust, scalable, and cost‑efficient ML systems. The position focuses on deploying and maintaining LLMs across production environments, optimizing performance and reliability, and driving adoption of innovative AI‑powered features. This is a highly visible role where your technical leadership and strategic vision will directly impact millions of users, improving their experience through intelligent recommendations and interactions.

Accountabilities
  • Lead a high‑performing engineering team to design, build, and deploy large‑scale LLM serving infrastructure.
  • Drive the implementation of a unified serving layer for multiple LLM models, supporting batch, offline evaluation, and real‑time inference.
  • Oversee the development and management of the Model Registry, including deployment, versioning, and monitoring of LLMs across production environments.
  • Collaborate with internal product and personalization teams to integrate LLM‑powered features seamlessly into recommendation systems.
  • Establish standardized technical interfaces, protocols, and best practices for efficient model deployment, scaling, and operational monitoring.
  • Optimize serving infrastructure for latency, cost, and reliability, leveraging techniques like quantization, pruning, and efficient batching.
  • Develop observability and monitoring frameworks, including dashboards, alerting, and SLA tracking for inference traffic and system health.
Requirements
  • 5+ years of software or machine learning engineering experience, including 2+ years managing engineering teams.
  • Hands‑on experience in ML engineering, building and scaling production‑quality ML systems and datasets.
  • Strong technical expertise in LLM infrastructure, recommendation or personalization systems, and high‑volume, high‑velocity ML platforms.
  • Proven ability to lead complex, multi‑partner projects with federated contribution models.
  • Experience designing loosely coupled, scalable systems with clear separation of concerns and robust APIs.
  • Familiarity with CI/CD pipelines, experiment tracking, and results visualization tools (e.g., MLFlow).
  • Excellent leadership, communication, and collaboration skills, with the ability to influence peers and stakeholders.
  • Pragmatic, results‑oriented mindset, balancing speed and production rigor.
Benefits
  • Competitive salary range: $176,166 – $251,666 plus equity.
  • Comprehensive health insurance coverage.
  • Six months paid parental leave.
  • 401(k) retirement plan.
  • Monthly meal allowance.
  • 23 paid vacation days, 13 flexible holidays, and paid sick leave.
  • Flexible remote/hybrid work options with occasional in‑person meetings.
  • Opportunity to work on cutting‑edge ML infrastructure impacting millions of users globally.
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Engineering Manager, Machine Learning (Remote - Namer)
Engineering Manager, Machine Learning (Remote - Namer)

Jobgether • EE. UU.

A distancia
USD 300.000 - 360.000
Competitive total compensation
Remote-first work environment
Comprehensive perks supporting personal and family engagement
+2
Remote ML Engineering Manager: LLM Serving & Infra
Remote ML Engineering Manager: LLM Serving & Infra

Jobgether • EE. UU.

A distancia
USD 176.166 - 251.666
Competitive salary range
Comprehensive health insurance
Paid parental leave
+4
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Syndesus, Inc. • Austin (TX)

Presencial
USD 100.000 - 140.000
100% employer-paid health, vision, and dental insurance
Retirement plans (401(k))
Disability insurance
+1
Senior Machine Learning Engineer (LLMs)
Senior Machine Learning Engineer (LLMs)

Albiware Inc. • Chicago (IL)

Presencial
USD 140.000 - 210.000
Competitive salary
Generous PTO
Medical, dental, and vision coverage
+2
Machine Learning Engineer
Machine Learning Engineer

Job Envoy • EE. UU.

A distancia
USD 120.000 - 160.000
Remote work
Career growth
Collaborative engineering environment
Junior Machine Learning Engineer
Junior Machine Learning Engineer

GCS Recruitment • Philadelphia

A distancia
USD 85.000 - 110.000
Machine Learning Research Engineer
Machine Learning Research Engineer

GCS Recruitment • EE. UU.

A distancia
USD 95.000 - 130.000
Machine Learning & Data Engineer
Machine Learning & Data Engineer

GCS Recruitment • Jersey City (NJ)

A distancia
USD 90.000 - 130.000
Remote work option
Machine Learning Engineer (Mid/Senior)
Machine Learning Engineer (Mid/Senior)

TryHackMe • EE. UU.

A distancia
USD 120.000 - 180.000
Annual training budget
Health insurance
Company retreat
ML Engineer – Generative AI & LLMs (Remote)
ML Engineer – Generative AI & LLMs (Remote)

Ample Insight Inc. • EE. UU.

A distancia
USD 140.000 - 210.000
Competitive salary
Emphasis on accountability without mic
Competitive compensation