Senior Scala Engineer - ML Orchestration Platform (Remote)

Braintrust; United States; Remote; USD 110,000 - 116,000; Full time

Job summary

Etsy is seeking a Senior Software Engineer to help build and operate its ML orchestration platform. This role touches every ML request, including search, recommendations, ads, trust and safety, and generative AI use cases.

The platform handles online inference and model evaluation, connecting product teams to models, features, and serving infrastructure in a high-scale, latency-sensitive system that impacts buyer and seller experiences.

Qualifications

• 5+ years of software engineering in distributed, low-latency production services.
• Proficiency in Scala or functional programming and patterns.
• Knowledge of ML inference in production: model serving, batching, latency considerations.
• Hands-on with Kubernetes-based services in production environments.
• Experience designing service APIs and orchestration (gRPC, queues).
• Strong observability: metrics, tracing, on-call ownership, performance profiling.

Skills

Distributed systems

Low-latency

Scala

Functional programming

Kubernetes

APIs design

Observability

Product mindset

Tools

GCP

vLLM

Triton

KServe

Cats Effect

ZIO

Akka/Pekko

http4s

Job description

Etsy is seeking a Senior Software Engineer to help build and operate its ML orchestration platform. This role touches every ML request, including search, recommendations, ads, trust and safety, and generative AI use cases.

The platform handles online inference and model evaluation, connecting product teams to models, features, and serving infrastructure in a high-scale, latency-sensitive system that impacts buyer and seller experiences.