Staff/Principal ML Infra Engineer - Scalable Inference

Tubi; New York (NY); On-site; USD 227,200 - 417,000; Full time

Benefits offered by this job

Flexible Time Off Policy

Generous Parental Leave Program

Monthly wellness reimbursement

Job summary

Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning and Product teams to enhance their inference platforms. Candidates should have experience with distributed systems, AWS, and modern backend languages like Scala. The position offers a salary range of $227,200–$417,000, inclusive of various benefits such as medical coverage, flexible time off, and a generous parental leave program. Tubi promotes a culture of diversity and inclusion.

Qualifications

• Experience with Scala or JVM-based language is a plus.
• Led the response and resolution efforts for multiple major incidents.

Responsibilities

• Design and build scalable, high-throughput, and low-latency distributed systems using Scala.
• Build reusable components and services that serve various ML applications.
• Partner closely with ML engineers to understand challenges and develop solutions.
• Identify and optimize latency, cost, and efficiency of infrastructure.
• Mentor other engineers on system design and incident management.
• Collaborate with cross-functional teams to define the vision for ML Infrastructure.

Skills

Experience designing and building scalable, distributed systems

Strong experience with AWS or an equivalent cloud platform

Experience building online microservices at scale

Proficient in SQL and NoSQL databases

Experience with containerization technologies like Docker

Data-driven analysis skills

Tools

Scala

Docker

Kubernetes

Cassandra

Kafka

Redis

Job description

Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning and Product teams to enhance their inference platforms. Candidates should have experience with distributed systems, AWS, and modern backend languages like Scala. The position offers a salary range of $227,200–$417,000, inclusive of various benefits such as medical coverage, flexible time off, and a generous parental leave program. Tubi promotes a culture of diversity and inclusion.