Software Engineer (Scala + ML Systems) REMOTE US ONLY

Braintrust; United States; Remote; USD 110,000 - 116,000; Full time

Job summary

Etsy is seeking a Senior Software Engineer to help build and operate its ML orchestration platform. This role touches every ML request, including search, recommendations, ads, trust and safety, and generative AI use cases.

The platform handles online inference and model evaluation, connecting product teams to models, features, and serving infrastructure in a high-scale, latency-sensitive system that impacts buyer and seller experiences.

Qualifications

• 5+ years of software engineering in distributed, low-latency production services.
• Proficiency in Scala or functional programming and patterns.
• Knowledge of ML inference in production: model serving, batching, latency considerations.
• Hands-on with Kubernetes-based services in production environments.
• Experience designing service APIs and orchestration (gRPC, queues).
• Strong observability: metrics, tracing, on-call ownership, performance profiling.

Skills

Distributed systems

Low-latency

Scala

Functional programming

Kubernetes

APIs design

Observability

Product mindset

Tools

GCP

vLLM

Triton

KServe

Cats Effect

ZIO

Akka/Pekko

http4s

Job description

• Rate: $80 – $84/hr


• Hours: 40 hours / week


• Experience: 5 - 10 years


• Location: Fort Lauderdale, FL, USA + 3 more

About The Team

• We own the single entry point for ML at Etsy. Our design decisions affect every team that ships a model.


• We treat the platform as a product. Our users are Applied Scientists and Software Engineers, and our goal is to make going from experiment to production safe, fast, and self-service.


• We work closely with Applied Scientists, Data Enablement, model serving and LLM hosting teams, and product engineering partners across Etsy.


• We use generative AI and other productivity tools thoughtfully, with a focus on learning and intentional contribution.

About The Role

We’re looking for a Senior Software Engineer to help build and run Etsy’s ML orchestration platform. Every ML request at Etsy goes through it, including search, recommendations, ads, trust and safety, and generative AI use cases. The platform handles online inference and model evaluation, and it connects product teams to the models, features, and serving infrastructure behind them. This is a high-scale, latency-sensitive, high-availability system, and its reliability directly affects the buyer and seller experience.

Requirements

• 5+ years of software engineering experience building and operating distributed, low-latency production services.


• Experience with Scala or another functional programming language and comfort with functional patterns such as immutability, composition, and effect or concurrency libraries.


• A solid understanding of how ML inference works in production: model serving, feature retrieval, batching, latency and throughput trade-offs, and how predictive and transformer-based models are deployed and evaluated.


• Hands‑on experience operating services on Kubernetes, including deployments, scaling, resource management, and debugging in production.


• Experience designing service APIs and request‑routing or orchestration systems (e.g., gRPC, queues).


• Strong operational skills: metrics, tracing, alerting, on‑call ownership, and performance profiling.


• A product mindset and strong communication skills. You enjoy working with internal users to understand their needs.

Must-Haves

• Back-end engineering experience working on ML systems


• Knowledge of how ML works


• Scala language expertise

Nice-to-Haves

• Experience with cloud infrastructure, ideally GCP.


• Experience with model serving frameworks and LLM inference infrastructure (e.g., vLLM, Triton, KServe).


• Experience with experimentation platforms, feature stores, or online evaluation systems.


• Experience with GPU capacity management and cost optimization.


• Experience with Scala libraries and frameworks such as Cats Effect, ZIO, Akka/Pekko, or http4s.

Company: Software Engineer (Scala + ML Systems) REMOTE US ONLY

Rate: $80 – 84/hr

Location: New United States only