Lead ML Inference Platform Architect for Advertising

Roku, Inc.; Austin (TX); Hybrid; USD 150,000 - 200,000; Full time

Benefits offered by this job

Global access to mental health support

401(k)/pension options

Flexible remote work on Fridays

Job summary

Roku, Inc. is seeking a technical leader to architect and design a state-of-the-art inference platform. The role involves leading the development of systems ensuring low latencies and high performance while mentoring engineers.

Candidates should have over 10 years of experience in large-scale systems, strong programming skills, and a deep understanding of ML frameworks. Roku promotes a hybrid work model and offers various employee benefits.

Qualifications

• At least 10 years of experience in developing large-scale distributed systems.
• 5+ years in a leadership or technical lead role.
• Experience with GPU acceleration and HPC techniques.

Responsibilities

• Lead the design and development of an inference platform.
• Ensure system performance, reliability, and scalability of online inference services.
• Identify and resolve performance bottlenecks.

Skills

Experience in developing and deploying large-scale systems

Strong programming skills in high-performance languages

Deep understanding of inference frameworks

Experience optimizing machine learning systems

Excellent communication skills

Experience leading high-throughput ML systems

Collaboration with cross-functional teams

Education

M.S. or above in Computer Science, ECE, or a related field

Job description

Roku, Inc. is seeking a technical leader to architect and design a state-of-the-art inference platform. The role involves leading the development of systems ensuring low latencies and high performance while mentoring engineers.

Candidates should have over 10 years of experience in large-scale systems, strong programming skills, and a deep understanding of ML frameworks. Roku promotes a hybrid work model and offers various employee benefits.