Staff Backend Engineer, ML Inference Systems

Unity

Mountain View (CA)

On-site

USD 245,000 - 318,000

Full time

12 hours ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Health insurance
Stock ownership
Commute subsidy
Pension plans
Generous vacation
Parental leave
Wellbeing programs

Job summary

Unity in Mountain View is seeking a Staff Backend Engineer to design and operate the infrastructure powering our large-scale model-inference systems.

You will develop production-grade backend services, drive the platform’s technical direction, and collaborate with ML engineers to scale serving infrastructure while maintaining low latency and high throughput.

Qualifications

  • 5+ years designing, deploying, and maintaining distributed systems at scale.
  • Expertise in Golang for building high-performance, low-latency backend infrastructure.
  • Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes.

Responsibilities

  • Design, develop, and deploy production-grade backend services and distributed systems powering large-scale online model inference
  • Drive technical direction of our inference platform, with a focus on low-latency, high-throughput serving infrastructure
  • Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput
  • Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana
  • Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high-scale production environment
  • Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE)

Skills

Distributed systems design
Golang
GCP
Kubernetes
Prometheus
Grafana
CI/CD
Docker
Machine learning platforms

Tools

Docker
Kubernetes
GCP

Job description

The opportunity

Every day, we connect billions of players with the games and experiences they love.

Our Vector Gamer AI team sits at the heart of that mission, governing ad ranking and bidding decisions across billions of daily impressions, where large-scale machine learning and real-world impact converge at scale.

We're hiring a Staff Backend Engineer to build and operate the infrastructure those models depend on. You'll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference systems.

Join us and help influence how billions of gaming experiences are discovered, monetized, and how creators are rewarded.

What You'll Be Doing
  • Design, develop, and deploy production-grade backend services and distributed systems powering large-scale online model inference at billions of daily requests
  • Drive technical direction of our inference platform, with a focus on low-latency, high-throughput serving infrastructure
  • Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput
  • Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana
  • Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high-scale production environment
  • Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE)
What We're Looking For
  • 5+ years designing, deploying, and maintaining distributed systems at scale
  • Expertise in Golang for building high-performance, low-latency backend infrastructure
  • Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes
  • Strong grounding in monitoring and observability tooling, including Prometheus and Grafana
  • Experience in ad tech, recommender systems, real-time personalization, or other performance-critical domains
  • Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices
  • Familiarity with machine learning platforms, workflows, and serving infrastructure
You might also have
  • Experience with ML inference servers like NVIDIA Triton Inference Server
  • Familiarity with auction mechanics or bidding systems in an ad tech context
Additional Information

Relocation support is not available for this position.

Gross pay annually: USD $244,500 - $317,800.

This range reflects the anticipated base salary for this position. Beyond base salary, this role may be eligible for equity awards and participation in our company incentive plans (such as annual discretionary bonuses or sales commissions). The final offer amount will depend on several factors, including geographic location and the candidate’s relevant experience, professional background, and skill set.

Benefits

At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance.

Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.

While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally:

  • Comprehensive health, life, and disability insurance
  • Commute subsidy
  • Employee stock ownership
  • Competitive retirement/pension plans
  • Generous vacation and personal days
  • Support for new parents through leave and family-care programs
  • Office food snacks
  • Mental Health and Wellbeing programs and support
  • Employee Resource Groups
  • Global Employee Assistance Program
  • Training and development programs
  • Volunteering and donation matching program
Life at Unity

Unity [NYSE: U] is the world’s leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D — closing the gap between ideas and reality. For more information, please visit www.unity.com.

Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators.

If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know.

This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English.

This posting is intended to fill an existing vacancy, and we are committed to providing applicants with updates throughout the hiring process in accordance with applicable law.

Headhunters and recruitment agencies may not submit resumes/CVs through this website or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity.

Your privacy is important to us. Please take a moment to review our Prospect and Applicant Privacy Policies. Should you have any concerns about your privacy, please contact us at DPO@unity.com.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff Software Engineer (Data & ML)
Staff Software Engineer (Data & ML)

Unity • Mountain View (CA)

On-site
USD 245,000 - 318,000
Health insurance
Employee stock ownership
Competitive retirement plans
+1
Sr. Software Engineer
Sr. Software Engineer

Unity • Mountain View (CA)

On-site
USD 210,000 - 273,000
Health insurance
Stock ownership
Generous vacation and personal days
+1
Staff Machine Learning Engineer
Staff Machine Learning Engineer

Unity • United States

Hybrid
USD 218,000 - 284,000
Health insurance
Stock options
Commuter/subsidy
+1
Senior Machine Learning Engineer, ML Infrastructure- Online
Senior Machine Learning Engineer, ML Infrastructure- Online

Unity • Walla Walla (WA)

On-site
USD 187,000 - 243,000
Health insurance
Commuter subsidy
Employee stock ownership
+8
Senior Software Engineer
Senior Software Engineer

Unity • Mountain View (CA)

On-site
USD 210,000 - 273,000
Health insurance
Stock options
Performance bonuses
Director, Machine Learning - User Value
Director, Machine Learning - User Value

Unity • Mountain View (CA)

On-site
USD 250,000 - 325,000
Employee stock ownership
Commuter subsidy
Competitive retirement plans
+2
Staff Backend Engineer, Offerwall
Staff Backend Engineer, Offerwall

Unity • San Francisco (CA)

On-site
USD 200,000 - 261,000
Staff Backend Engineer, Ads
Staff Backend Engineer, Ads

Unity Technologies • San Francisco (CA)

On-site
USD 200,000 - 261,000
Health insurance
Employee stock ownership
Competitive retirement plans
+1
Staff Software Engineer, Feature Platform
Staff Software Engineer, Feature Platform

3M HEALTHCARE • Bellevue (WA)

On-site
USD 192,000 - 289,000
Staff Software Engineer, Feature Platform
Staff Software Engineer, Feature Platform

3M HEALTHCARE • San Francisco (CA)

On-site
USD 173,000 - 289,000
Health insurance
Stock options
Generous vacation and personal days
+1