Senior ML Infrastructure Engineer: Scale & Serve Models

etsy; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Etsy is hiring a Senior Software Engineer, Machine Learning to build and operate the infrastructure that trains, hosts, and serves ML models, including internal serving platforms and open-source LLMs.

You will enable Applied Scientists and Engineers to train, host, and iterate on models at scale, spanning from classic predictors to large language models, in a full-time ML Enablement role.

Qualifications

• Bachelor's degree or equivalent in a quantitative field.
• 5+ years building and troubleshooting complex backend systems.
• Strong software engineering fundamentals; production-grade Python.
• Cloud infrastructure experience (GCP) and Kubernetes.
• Observability tooling (metrics, logs, tracing) for distributed systems.
• ML fundamentals and familiarity with LLM serving infrastructure.

Responsibilities

• Write production-grade Python code; participate in code reviews.
• Build, operate, and improve ML training and serving infrastructure on GCP/Kubernetes.
• Design and maintain serving infra for open-source and internal models.
• Partner with Applied Scientists to translate needs into scalable infrastructure.
• Contribute to system design, balancing performance, cost, and reliability.

Skills

Python

GCP

Kubernetes

Observability

ML basics

Transformer

Backend infra

Education

Bachelor's degree in CS/Math/EE or related field

Tools

Barista

Job description

Etsy is hiring a Senior Software Engineer, Machine Learning to build and operate the infrastructure that trains, hosts, and serves ML models, including internal serving platforms and open-source LLMs.

You will enable Applied Scientists and Engineers to train, host, and iterate on models at scale, spanning from classic predictors to large language models, in a full-time ML Enablement role.