Senior Backend Engineer - Scalable AI Inference Platform

Unity Technologies; Mountain View (CA); On-site; USD 166,000 - 273,000; Full time

Benefits offered by this job

Health insurance

Stock ownership

Retirement plans

Generous vacation

Commute subsidy

Employee assistance programs

Training and development

Diversity and inclusion programs

Job summary

Unity Technologies in Mountain View, CA is hiring a Senior Backend Engineer to build and operate the infrastructure for large-scale model inference. You will design distributed systems powering billions of daily decisions and focus on low-latency, high-throughput serving infrastructure.

You’ll collaborate with ML engineers, promote DevOps practices, manage cloud workloads on GCP with Kubernetes, and monitor systems with Prometheus and Grafana to ensure reliability and scale.

Qualifications

• Experience designing, deploying, and maintaining distributed systems at scale.
• Expertise in Golang for building high-performance, low-latency backend infrastructure.
• Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes.
• Strong grounding in monitoring and observability tooling, including Prometheus and Grafana.
• Experience in ad tech, recommender systems, real-time personalization, or other performance-critical domains.
• Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices.
• Familiarity with machine learning platforms, workflows, and serving infrastructure.

Responsibilities

• Design, develop, and deploy production-grade backend services powering large-scale online model inference at billions of daily requests.
• Drive technical direction of our inference platform, focusing on low-latency, high-throughput serving infrastructure.
• Partner with ML engineers to ensure online serving scales with model complexity and inference volumes without latency or throughput loss.
• Ensure reliability, scalability, and efficiency using monitoring/observability tools like Prometheus and Grafana.
• Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes in a high-scale production environment.
• Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE).

Skills

Golang

Distributed systems

Observability

CI/CD

Ad tech

Microservices

Tools

Kubernetes

Docker

Prometheus

Grafana

GCP

CI/CD

Job description

Unity Technologies in Mountain View, CA is hiring a Senior Backend Engineer to build and operate the infrastructure for large-scale model inference. You will design distributed systems powering billions of daily decisions and focus on low-latency, high-throughput serving infrastructure.

You’ll collaborate with ML engineers, promote DevOps practices, manage cloud workloads on GCP with Kubernetes, and monitor systems with Prometheus and Grafana to ensure reliability and scale.