Remote Gen AI Engineer - LLM Pretraining Lead

ITCO Solutions; Remote; CAD 120,000 - 160,000; Full time

Job summary

A leading technology firm is seeking an experienced AI/ML Engineer to lead the pre-training of massive LLMs (100B+ parameters) in a fully remote setting. You will be responsible for architecting training pipelines, optimizing distributed training, and managing extensive datasets. The ideal candidate holds an advanced degree and has a proven track record in large-scale model training and distributed frameworks. Join us to work with cutting-edge technology in a high-impact environment that shapes the future of AI.

Qualifications

• Advanced degree from a top-20 global university in CS.
• 3+ years hands-on experience with large-scale model training.
• Proven experience in pretraining models exceeding 10B parameters.
• Deep expertise in distributed training frameworks.
• Experience with large-scale cloud environments.

Responsibilities

• Architect training pipelines for LLMs with 100B+ parameters.
• Optimize distributed training performance.
• Collaborate with research scientists to implement training runs.
• Manage and preprocess petabyte-scale datasets.
• Conduct benchmarking and performance tuning.

Skills

Large-scale deep learning model training

Distributed training frameworks

Python

CUDA

Performance optimization

Education

PhD or Master’s in Computer Science or related field

Tools

AWS

Azure

GCP

Kubernetes

Ray

Job description

A leading technology firm is seeking an experienced AI/ML Engineer to lead the pre-training of massive LLMs (100B+ parameters) in a fully remote setting. You will be responsible for architecting training pipelines, optimizing distributed training, and managing extensive datasets. The ideal candidate holds an advanced degree and has a proven track record in large-scale model training and distributed frameworks. Join us to work with cutting-edge technology in a high-impact environment that shapes the future of AI.