ML Engineer: Pretraining Data & Pipelines (Remote)

Cohere

United States

Remote

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Lunch stipend
Health and dental benefits
RRSP matching
Parental leave top-up
Enrichment benefits
6 weeks vacation
Travel budget
Home office stipend

Job summary

Cohere is seeking a Machine Learning Engineer specialized in pretraining data to build and optimize data pipelines for language models. You will conduct ablations, design pre-training mixtures, and balance throughput with accelerator utilization to drive model performance.

You will bridge research and engineering, advancing data quality and scalable training practices across multilingual corpora and web data. Remote-friendly with Canada location requirements and global collaboration.

Qualifications

  • Strong software engineering skills and Python experience.
  • Familiarity with curriculum learning, data mixing and data attribution.
  • Experience with data processing frameworks (Spark/Beam/Pandas).
  • Work with large-scale datasets including web, code, multilingual corpora.
  • Knowledge of data quality assessment techniques and data mixtures.
  • Passion for bridging research and engineering in AI model training.

Responsibilities

  • Conduct data ablations to assess data quality and test data mixtures.
  • Develop data modeling techniques for training efficiency.
  • Research data curation methods leveraging Cohere infrastructure.
  • Collaborate with researchers and engineers to meet model demands.

Skills

Python
Curriculum learning
Data mixing
Data attribution
Apache Spark
Apache Beam
Pandas
Large-scale datasets
Web data
Code data
Multilingual corpora
Data quality assessment
Data mixtures
Bridging research
AI model training

Tools

Apache Spark
Apache Beam
Pandas

Job description

Cohere is seeking a Machine Learning Engineer specialized in pretraining data to build and optimize data pipelines for language models. You will conduct ablations, design pre-training mixtures, and balance throughput with accelerator utilization to drive model performance.

You will bridge research and engineering, advancing data quality and scalable training practices across multilingual corpora and web data. Remote-friendly with Canada location requirements and global collaboration.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Data Engineer - Pretraining Pipelines (Remote)
ML Data Engineer - Pretraining Pipelines (Remote)

Cohere • New York (NY)

Remote
USD 140,000 - 190,000
Lunch stipend
Health and dental benefits
Retirement plan matching
+5
Pre-Training Data Engineer — Scalable Pipelines (Remote)
Pre-Training Data Engineer — Scalable Pipelines (Remote)

Cohere • United States

Remote
USD 140,000 - 190,000
Health and dental benefits
Weekly lunch stipend
Remote-friendly
+2
Senior Staff Engineer, Web Data Pipelines
Senior Staff Engineer, Web Data Pipelines

Cohere • United States

Remote
USD 150,000 - 210,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching / 401K
+4
Senior ML Engineer, Synthetic Data Pipelines (Remote)
Senior ML Engineer, Synthetic Data Pipelines (Remote)

Cohere • United States

Remote
USD 160,000 - 210,000
Weekly lunch stipend
Health and dental benefits
RRSP/401K matching
+4
Member of Technical Staff, Pre-Training Data
Member of Technical Staff, Pre-Training Data

Cohere • United States

Remote
USD 120,000 - 180,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
Member of Technical Staff, Pre-Training Data
Member of Technical Staff, Pre-Training Data

Cohere • New York (NY)

Remote
USD 140,000 - 190,000
Lunch stipend
Health and dental benefits
Retirement plan matching
+5
Remote: Senior ML Engineer, Synthetic Data Pipelines
Remote: Senior ML Engineer, Synthetic Data Pipelines

Cohere • New York (NY)

Remote
USD 180,000 - 230,000
Lunch stipend
Health and dental benefits
Pension scheme
+6
Staff Engineer: Multilingual Data & Language ML Pipelines
Staff Engineer: Multilingual Data & Language ML Pipelines

Reflection AI Ltd • New York (NY)

On-site
USD 180,000 - 280,000
Top-tier compensation
Stock options
Health & wellness benefits
+2
Member of Technical Staff, Pre-Training Data
Member of Technical Staff, Pre-Training Data

Jaide Health • San Francisco (CA)

Remote
USD 120,000 - 160,000
Open and inclusive culture
Weekly lunch stipend
Full health and dental benefits
+2
Senior Web Data Engineer for AI Training Pipelines
Senior Web Data Engineer for AI Training Pipelines

Cohere • New York (NY)

Remote
USD 180,000 - 240,000
Lunch stipend
Health and dental benefits
RRSP matching / 401K
+5