Remote ML Engineering Manager: LLM Serving & Infra

Jobgether; United States; Remote; USD 176,166 - 251,666; Full time

Benefits offered by this job

Competitive salary range

Comprehensive health insurance

Paid parental leave

401(k) retirement plan

Monthly meal allowance

Paid vacation days

Flexible remote/hybrid work options

Job summary

A leading company in AI solutions is seeking a Machine Learning Engineering Manager to lead a team in developing high-scale LLM serving infrastructure. The role involves managing projects and collaborating with ML researchers to optimize system performance. Ideal candidates have a strong background in software engineering and experience in managing teams. The position comes with competitive salary and comprehensive benefits, including flexible working options.

Qualifications

• 5+ years of experience in software or machine learning engineering.
• 2+ years managing engineering teams.
• Hands-on ML engineering background with production-quality systems.

Responsibilities

• Lead an engineering team to design and deploy LLM serving infrastructure.
• Collaborate closely with product and personalization teams.
• Develop observability and monitoring frameworks for ML systems.

Skills

Software or Machine Learning Engineering experience

Management experience

ML engineering hands-on experience

Technical expertise in LLM infrastructure

Leadership and communication skills

Tools

MLFlow

Job description

A leading company in AI solutions is seeking a Machine Learning Engineering Manager to lead a team in developing high-scale LLM serving infrastructure. The role involves managing projects and collaborating with ML researchers to optimize system performance. Ideal candidates have a strong background in software engineering and experience in managing teams. The position comes with competitive salary and comprehensive benefits, including flexible working options.