Staff ML Infra Engineer - Scalable Distributed Systems

tubitv

United States

Hybrid

USD 227,000 - 325,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Annual bonus
Long-term incentives
Health, dental and vision coverage
Insurance
Retirement savings
Paid time off
12 weeks paid parental bonding leave
Monthly wellness reimbursement

Job summary

tubiTV is seeking a senior infrastructure leader to design and evolve a distributed ML inference platform enabling low-latency, high-throughput serving for recommendations, search, and content understanding. You will drive architecture with engineering and product teams across the stack.

You will mentor engineers in system design, incident response, and AI tooling, while collaborating on long-term platform direction with partners and stakeholders in a hybrid work setup.

Qualifications

  • Experience designing and operating distributed systems in a modern backend language; JVM language familiarity is useful.
  • Strong experience with AWS or a comparable cloud platform and large-scale, low-latency online services.
  • Familiarity with SQL and NoSQL databases, message brokers, and caching systems.
  • Experience with containers, such as Docker or Kubernetes.

Responsibilities

  • Design and build scalable distributed services for high-throughput, low-latency ML inference.
  • Develop reusable infrastructure for applications including personalization, search, advertising, and exploration.
  • Collaborate with ML engineers to identify platform constraints and shape scalable solutions.
  • Use operational data to improve latency, cost, and efficiency, and lead refactoring when needed.
  • Help define long-term ML infrastructure architecture with product and engineering partners.
  • Mentor engineers in system design, incident response, interviewing, and AI coding tools.

Skills

Distributed systems design
AWS
SQL/NoSQL
Docker/Kubernetes
Incident response leadership

Tools

Docker
Kubernetes
Akka

Job description

tubiTV is seeking a senior infrastructure leader to design and evolve a distributed ML inference platform enabling low-latency, high-throughput serving for recommendations, search, and content understanding. You will drive architecture with engineering and product teams across the stack.

You will mentor engineers in system design, incident response, and AI tooling, while collaborating on long-term platform direction with partners and stakeholders in a hybrid work setup.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, ML Infra & Distributed Systems (Staff & Principal)
Software Engineer, ML Infra & Distributed Systems (Staff & Principal)

Tubi Tv • San Francisco (CA)

Hybrid
USD 130,000 - 160,000
Staff/Principal ML Infra Engineer - Scalable Inference
Staff/Principal ML Infra Engineer - Scalable Inference

Tubi • New York (NY)

On-site
USD 227,200 - 417,000
Flexible Time Off Policy
Generous Parental Leave Program
Monthly wellness reimbursement
ML Infra Architect - Distributed Systems Lead
ML Infra Architect - Distributed Systems Lead

Tubi • United States

On-site
USD 227,200 - 417,000
Flexible Time Off
Parental Leave Program
Wellness reimbursement
Staff ML Infra Engineer - Low-Latency Distributed Systems
Staff ML Infra Engineer - Low-Latency Distributed Systems

Tubi Tv • San Francisco (CA)

Hybrid
USD 130,000 - 160,000
Senior ML Infra Engineer — Scalable Training & Serving
Senior ML Infra Engineer — Scalable Training & Serving

People Culture Talent • San Francisco (CA)

On-site
USD 190,000 - 230,000
Staff Software Engineer, ML Infra & Distributed Systems
Staff Software Engineer, ML Infra & Distributed Systems

Tubi • United States

On-site
USD 227,200 - 417,000
Flexible Time Off
Parental Leave Program
Wellness reimbursement
Staff Software Engineer, ML Infra & Distributed Systems
Staff Software Engineer, ML Infra & Distributed Systems

Tubi • New York (NY)

On-site
USD 227,200 - 417,000
Flexible Time Off Policy
Generous Parental Leave Program
Monthly wellness reimbursement
Lead ML Infra Architect for Billion-Parameter Systems
Lead ML Infra Architect for Billion-Parameter Systems

TikTok Inc. • Seattle (WA)

On-site
USD 198,000 - 416,000
Staff AI Platform Engineer — Internal Tools & Production
Staff AI Platform Engineer — Internal Tools & Production

Tubi Tv • New York (NY)

Hybrid
USD 227,200 - 324,500
401(k) plan
Medical, dental, and vision insurance
Paid time off
+1
ML Infra Engineer, Real-Time Recommendations (In-Person)
ML Infra Engineer, Real-Time Recommendations (In-Person)

TikTok Economic Impact • Seattle (WA)

On-site
USD 180,000 - 240,000