Senior Distributed ML Engineer: Large-Scale Training

LawZero; Montreal (administrative region); On-site; CAD 140,000 - 210,000; Full time

Benefits offered by this job

Comprehensive health benefits

20 days of vacation per year

4% employer contribution to retirement savings

Additional compensation for retirement savings or bonuses

Vibrant office in a trendy district

Job summary

A non-profit AI research organization in Montreal seeks a Senior Distributed Machine Learning Research Developer. You will collaborate with researchers and address complex ML challenges while working with large-scale models. Ideal candidates have 3+ years of experience in distributed ML and possess skills across various frameworks and cloud services. What we offer includes comprehensive health benefits, generous vacation days, and a vibrant, inclusive work environment emphasizing diversity and collaboration.

Qualifications

• 3+ years of experience in designing ML training frameworks.
• Ability to document best practices and stay updated with ML advancements.
• Experience with vector databases and data infrastructures.

Responsibilities

• Collaborate with researchers to facilitate large-scale model use.
• Investigate performance bottlenecks and optimize computing resources.
• Develop tools for simplifying distributed computing resources.

Skills

Distributed ML training frameworks

Collaboration with cross-functional teams

Cloud platforms (AWS, GCP, Azure)

GPU profiling tools

Containerization (Docker, Kubernetes)

Education

Degree in computer science or related field

Advanced degree in ML or distributed systems (preferred)

Tools

Megatron

DeepSpeed

HuggingFace Accelerate

Ray

SLURM

Job description

A non-profit AI research organization in Montreal seeks a Senior Distributed Machine Learning Research Developer. You will collaborate with researchers and address complex ML challenges while working with large-scale models. Ideal candidates have 3+ years of experience in distributed ML and possess skills across various frameworks and cloud services. What we offer includes comprehensive health benefits, generous vacation days, and a vibrant, inclusive work environment emphasizing diversity and collaboration.