ML Engineer: Distributed Inference & Model Serving

ByteDance; Seattle (WA); On-site; USD 177,688 - 416,100; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) savings plan with company match

Paid parental leave

Wellbeing benefits

10 paid holidays and 10 paid sick days

Job summary

A leading technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will have at least 5 years of experience and strong programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This position offers a competitive salary and benefits in a dynamic work environment.

Qualifications

• At least 5 years of experience in developing large-scale systems.
• Experience with open-sourced machine learning frameworks.
• Ability to work independently and manage projects.

Responsibilities

• Design and implement distributed inference infrastructure.
• Build monitoring and management tools for inference servers.
• Collaborate with product teams to meet requirements.

Skills

C/C++/CUDA

Deep learning frameworks

System performance optimization

Hardware-Software Co-Design

High Performance Computing

Education

Bachelor's degree in Computer Science or related field

Tools

TensorFlow

PyTorch

JAX

Job description

A leading technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will have at least 5 years of experience and strong programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This position offers a competitive salary and benefits in a dynamic work environment.