Senior Backend Engineer, AI Inference Platform

MongoDB; Seattle (WA); Hybrid; Full time

Job summary

A leading database platform provider is seeking a Software Engineer 3 to design and develop core systems for a multi-tenant inference platform integrated with their database service. The role emphasizes collaboration with AI engineers, optimizing performance in a cloud-native environment, and requires strong software engineering skills in languages like Go, Rust, Python, or C++. This position offers a hybrid work model based in Seattle or Palo Alto.

Qualifications

• 2+ years of experience building backend or infrastructure systems.
• Strong software engineering skills in languages such as Go, Rust, Python, or C++.
• Familiarity with ML model serving and inference runtimes.

Responsibilities

• Design and build components of a multi-tenant inference platform integrated with MongoDB Atlas.
• Collaborate with AI engineers and researchers to productionize inference for embedding models.
• Improve performance, autoscaling, GPU utilization, and resource efficiency.

Skills

Backend infrastructure systems

Software engineering in Go, Rust, Python, C++

Cloud-native architectures

Distributed systems

ML model serving concepts

Vector search systems (e.g., Faiss)

Collaboration across teams

Tools

vLLM

Kubernetes

Job description

A leading database platform provider is seeking a Software Engineer 3 to design and develop core systems for a multi-tenant inference platform integrated with their database service. The role emphasizes collaboration with AI engineers, optimizing performance in a cloud-native environment, and requires strong software engineering skills in languages like Go, Rust, Python, or C++. This position offers a hybrid work model based in Seattle or Palo Alto.