Senior ML Infra Engineer – Scalable Model Serving

Etsy; New York (NY); On-site; USD 182,000 - 246,000; Full time

Job summary

Etsy is seeking a Senior Software Engineer, Machine Learning to architect and operate the infrastructure that trains, hosts, and serves its ML models. You will enable researchers and engineers with scalable, reliable, and observable systems for a wide portfolio of predictors and open-source models.

You will work on a high-impact platform, collaborating across teams to reduce friction in model workflows, deploying on GCP and Kubernetes, and shaping the serving stack for billions of inferences.

Qualifications

• Bachelor's degree in Computer Science, Applied Statistics, Mathematics, Electrical Engineering, or a related quantitative field, or equivalent professional experience.
• 5+ years of professional experience building, iterating on, and troubleshooting complex backend and infrastructure systems.
• Strong software engineering fundamentals, including algorithms and data structures, with production‑ready Python.
• Hands‑on experience with cloud infrastructure (Google Cloud preferred) and Kubernetes, deploying and operating production workloads.
• Familiarity with observability tooling (metrics, logging, tracing) for monitoring and debugging distributed systems.
• Working knowledge of machine learning fundamentals and concepts, with awareness of LLM serving infrastructure and hosting open‑source models.
• Understanding of transformer architectures, predictors, and how model design choices affect serving infrastructure.
• Comfort with system design for large‑scale, high‑availability infrastructure.

Responsibilities

• Write production‑grade Python code; participate in code reviews and pair programming; contribute to architectural decisions.
• Build, operate, and improve infrastructure for training and serving ML models on GCP and Kubernetes.
• Design and maintain serving infrastructure for open‑source and hosted LLMs, including model deployment and resource management.
• Apply ML fundamentals to inform infrastructure decisions for performance and reliability.
• Collaborate with Applied Scientists to translate needs into scalable infrastructure.
• Contribute to system design discussions weighing performance, cost, and reliability for 100M+ users.

Skills

Python

Cloud infrastructure (GCP)

Kubernetes

Observability tooling

ML fundamentals

Transformer architectures

System design

Education

Bachelor's degree in Computer Science or related quantitative field

Tools

Barista

Job description

Etsy is seeking a Senior Software Engineer, Machine Learning to architect and operate the infrastructure that trains, hosts, and serves its ML models. You will enable researchers and engineers with scalable, reliable, and observable systems for a wide portfolio of predictors and open-source models.

You will work on a high-impact platform, collaborating across teams to reduce friction in model workflows, deploying on GCP and Kubernetes, and shaping the serving stack for billions of inferences.