Machine Learning Engineer, Pretraining Data Pipelines

Cohere; Greater London; Remote; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Weekly lunch stipend

Health and dental benefits

RRSP matching / Pension

Parental Leave top-up (6 months)

Education & learning stipend

6 weeks paid vacation

Travel budget to other offices

Home office stipend

Job summary

Cohere, a leading security-first enterprise AI company, is hiring a Machine Learning Engineer focused on pretraining data. You will build and evaluate data pipelines, conduct data ablations, and craft pre-training data mixtures to boost model performance, throughput, and accelerator utilization.

This role blends research and engineering to advance language models. Remote-friendly with offices in multiple cities; open to candidates globally within EST/EU hours.

Qualifications

• Strong software engineering skills with Python and building data pipelines.
• Experience with data quality assessment and experimentation with data mixtures.
• Familiarity with data processing frameworks and large-scale datasets.
• Ability to bridge research and engineering for AI model training.

Responsibilities

• Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance.
• Develop data modeling techniques for structured datasets to improve training efficiency.
• Research and implement innovative data curation methods using Cohere infrastructure.
• Collaborate with researchers and engineers to ensure data pipelines meet model training needs.

Skills

Python

Data pipelines

Data quality

Curriculum learning

Data mixing

Data attribution

Spark

Beam

Pandas

Multilingual data

Tools

Apache Spark

Apache Beam

Pandas

Job description

Cohere, a leading security-first enterprise AI company, is hiring a Machine Learning Engineer focused on pretraining data. You will build and evaluate data pipelines, conduct data ablations, and craft pre-training data mixtures to boost model performance, throughput, and accelerator utilization.

This role blends research and engineering to advance language models. Remote-friendly with offices in multiple cities; open to candidates globally within EST/EU hours.