Senior Scala ML Orchestration Engineer

Braintrust; New York (NY); On-site; USD 140,000 - 210,000; Full time

Job summary

Etsy is seeking a Senior Software Engineer to build and operate Etsy's ML orchestration platform. Every ML request at Etsy goes through it, including search, recommendations, ads, trust and safety, and generative AI use cases.

The platform handles online inference and model evaluation, connecting product teams to models and serving infrastructure. This is a high-scale, latency-sensitive system where reliability directly affects the buyer and seller experience.

Qualifications

• 5+ years of software engineering experience building and operating distributed, low-latency production services.
• Experience with Scala or another functional programming language and comfort with functional patterns such as immutability, composition, and effect or concurrency libraries.
• Understanding of ML inference in production: model serving, feature retrieval, batching, latency and throughput trade-offs, and deployment/evaluation of predictive and transformer-based models.
• Hands-on experience operating services on Kubernetes, including deployments, scaling, resource management, and debugging in production.
• Experience designing service APIs and request-routing or orchestration systems (e.g., gRPC, queues).
• Strong operational skills: metrics, tracing, alerting, on-call ownership, and performance profiling.
• A product mindset and strong communication skills. You enjoy working with internal users to understand their needs.

Responsibilities

• Responsible for building and running Etsy's ML orchestration platform used by multiple teams.
• Ensure low-latency, high-availability services for online inference and model evaluation.
• Collaborate with product engineers, data teams, and infrastructure to deliver reliable ML capabilities.

Skills

Distributed systems

Scala

Functional programming

ML inference

Kubernetes

API design

Monitoring & SRE

Communication

Tools

gRPC

KServe

Triton

Job description

Etsy is seeking a Senior Software Engineer to build and operate Etsy's ML orchestration platform. Every ML request at Etsy goes through it, including search, recommendations, ads, trust and safety, and generative AI use cases.

The platform handles online inference and model evaluation, connecting product teams to models and serving infrastructure. This is a high-scale, latency-sensitive system where reliability directly affects the buyer and seller experience.