Senior ML Engineer - End-to-End LLMs & Production

Distil Labs GmbH; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Remote work within European time zones

Periodic in-person team offsites

Job summary

Distil Labs seeks a senior ML engineer to own end-to-end language-model pipelines—from traces and synthetic data to distributed training and deployment. This role combines hands-on ML engineering with applied research, turning advances in distillation, data generation, and model improvement into repeatable pipelines.

The position emphasizes production systems, low-latency services, and scalable serving across cloud and on-prem GPU environments.

Qualifications

• At least five years of experience building and shipping machine-learning systems in production.
• Ability to interpret research papers and convert ideas into working experiments and pipelines.
• Experience with Python and modern machine-learning frameworks, distributed training, and GPU infrastructure.

Responsibilities

• Build end-to-end workflows for trace processing, synthetic-data generation, validation, fine-tuning, evaluation, and deployment.
• Partner with research colleagues to test new methods and productionize approaches that improve customer models.
• Create benchmarking and evaluation systems that measure quality, latency, and meaningful model improvement.
• Run and optimize distributed training across cloud and on-premises GPU environments.
• Operate workflow orchestration, container platforms, and secure multi-tenant model-serving systems.
• Help maintain low-latency services that remain reliable under load.

Skills

Python

Distributed training

ML frameworks

GPU infrastructure

Research interpretation

Production systems

Cross-functional collaboration

Tools

PyTorch

TensorFlow

Job description

Distil Labs seeks a senior ML engineer to own end-to-end language-model pipelines—from traces and synthetic data to distributed training and deployment. This role combines hands-on ML engineering with applied research, turning advances in distillation, data generation, and model improvement into repeatable pipelines.

The position emphasizes production systems, low-latency services, and scalable serving across cloud and on-prem GPU environments.