Senior Backend Engineer, Vector AI Inference

Unity Technologies SF; Mountain View (CA); On-site; USD 166,000 - 273,000; Full time

Benefits offered by this job

Health insurance

Stock ownership

Retirement plans

Commuter subsidy

Paid time off

Job summary

Unity Technologies SF is hiring a Senior Backend Engineer to build and operate the infrastructure powering large-scale model inference across billions of daily requests. You will design backend services and distributed systems, focusing on low latency, high throughput, and reliability in production.

You will collaborate with ML engineers to scale online serving infrastructure as models grow, while implementing best practices for DevOps, testing, and monitoring in a high-scale cloud environment.

Qualifications

• Experience designing, deploying, and maintaining distributed systems at scale.
• Expertise in Golang for building high-performance, low-latency backend infrastructure.
• Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes.

Responsibilities

• Design, develop, and deploy production-grade backend services and distributed systems powering large-scale online model inference at billions of daily requests.
• Drive technical direction of our inference platform, with a focus on low-latency, high-throughput serving infrastructure.
• Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput.
• Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana.
• Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high-scale production environment.
• Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE).

Skills

Distributed systems

Golang

GCP

Kubernetes

Prometheus Grafana

CI/CD

Ad tech / real-time personalization

Microservices

ML platforms

Tools

NVIDIA Triton

Job description

Unity Technologies SF is hiring a Senior Backend Engineer to build and operate the infrastructure powering large-scale model inference across billions of daily requests. You will design backend services and distributed systems, focusing on low latency, high throughput, and reliability in production.

You will collaborate with ML engineers to scale online serving infrastructure as models grow, while implementing best practices for DevOps, testing, and monitoring in a high-scale cloud environment.