Staff Training Engineer — Large-Scale Foundation Models

Plus10 Recruitment; Canada; On-site; CAD 120,000 - 180,000; Full time

Job summary

A leading technical recruitment agency is assisting a non-profit client in Canada to fill the role of Member of Technical Staff, Training Engineer. The successful candidate will lead the end-to-end pre-training of large language models and develop complex data pipelines as part of a groundbreaking AI Physicist project. Candidates should have 7-12+ years of experience and a strong proficiency in PyTorch, particularly in training large models. This unique role blends engineering with significant scientific challenges.

Qualifications

• 7-12+ years of total experience in technical roles.
• Experience in training large language models at scale.
• Ability to recover from failures in long training jobs.

Responsibilities

• Develop end-to-end pre-training of large language models.
• Design high-throughput data pipelines for model training.
• Operate distributed training infrastructure.

Skills

Expert-level proficiency in PyTorch

Deep facility with distributed frameworks

Hands-on experience with large Transformers

Strong applied mathematics background

Ability to work cross-functionally

Strong communicator

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related field

Job description

A leading technical recruitment agency is assisting a non-profit client in Canada to fill the role of Member of Technical Staff, Training Engineer. The successful candidate will lead the end-to-end pre-training of large language models and develop complex data pipelines as part of a groundbreaking AI Physicist project. Candidates should have 7-12+ years of experience and a strong proficiency in PyTorch, particularly in training large models. This unique role blends engineering with significant scientific challenges.