Senior ML Infrastructure Engineer — GenAI Platform

NLP PEOPLE; Seattle (WA); On-site; USD 137,100 - 201,600; Full time

Benefits offered by this job

401(k) plan with employer matching

16 weeks of paid parental leave

Comprehensive medical, dental, and vision benefits

Job summary

NLP PEOPLE is looking for a Senior Engineer to build production infrastructure for Generative AI. The role involves designing scalable systems for model serving and fine-tuning while collaborating with teams across DoorDash, Wolt, and Deliveroo.

The ideal candidate has a strong background in backend engineering, specifically in Python and distributed systems, along with experience in LLM inference. This position offers competitive compensation and opportunities for equity grants.

Qualifications

• 6+ years of industry experience in software engineering.
• Experience operating systems in production.
• Deep hands-on experience with LLM inference and fine-tuning.

Responsibilities

• Lead the design of infrastructure for Generative AI.
• Own and evolve the serving stack for open-weights.
• Architect scalable, high-performance systems for model serving.

Skills

Backend engineering fundamentals

Experience in Python

Experience with LLM inference

Technical leadership

Using AI coding tools

Education

B.S., M.S., or PhD. in Computer Science

Tools

Distributed systems

Kubernetes

AWS/GCP

Job description

NLP PEOPLE is looking for a Senior Engineer to build production infrastructure for Generative AI. The role involves designing scalable systems for model serving and fine-tuning while collaborating with teams across DoorDash, Wolt, and Deliveroo.

The ideal candidate has a strong background in backend engineering, specifically in Python and distributed systems, along with experience in LLM inference. This position offers competitive compensation and opportunities for equity grants.