ML Efficiency Engineer - Optimize Training & Serving

EngineersOfAI; United Kingdom; On-site; GBP 60,000 - 85,000; Full time

Job summary

EngineersOfAI is seeking an experienced software engineer to join the ML Efficiency team. The role involves designing systems that enhance the efficiency of machine learning training and inference workloads. Candidates should possess a strong background in software engineering, particularly with Python and distributed systems.

Successful applicants will have the opportunity to impact performance improvements across the company's ML ecosystem, with a focus on optimizing resource utilization and developer productivity.

Qualifications

• 5+ years of software engineering experience.
• Experience building distributed systems at scale.
• Experience with machine learning infrastructure and model serving platforms.

Responsibilities

• Design and build systems that improve ML training and inference efficiency.
• Develop tooling to help ML engineers debug and optimize model performance.
• Partner with ML researchers to identify bottlenecks and drive performance improvements.
• Optimize distributed training infrastructure and model serving architectures.

Skills

Python

Systems programming (Go, C++, Rust, or Java)

Performance engineering

Debugging and profiling

Education

BS, MS, or PhD in Computer Science or a related field

Tools

PyTorch Distributed

Ray

TensorFlow

Spark

Job description

EngineersOfAI is seeking an experienced software engineer to join the ML Efficiency team. The role involves designing systems that enhance the efficiency of machine learning training and inference workloads. Candidates should possess a strong background in software engineering, particularly with Python and distributed systems.

Successful applicants will have the opportunity to impact performance improvements across the company's ML ecosystem, with a focus on optimizing resource utilization and developer productivity.