ML Engineer, Pretraining Data & Pipelines (Remote)

Cohere; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Cohere, a leading security-first enterprise AI company, is seeking a Machine Learning Engineer focused on pretraining data. You will help build the data pipelines powering Cohere’s language models, conduct data ablations, and craft pre-training data mixtures to improve throughput and model quality.

As a Member of Technical Staff, Pre-Training Data, you will collaborate with researchers and engineers, design robust data models, and apply scalable processing frameworks to large multilingual

Qualifications

• Strong software engineering skills with Python and experience building data pipelines.
• Familiarity with curriculum learning, data mixing, and data attribution.
• Experience with data processing frameworks such as Spark, Beam, or Pandas.
• Experience working with large-scale datasets, including web data, code data, and multilingual corpora.
• Knowledge of data quality assessment techniques.

Responsibilities

• Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance.
• Develop robust data modeling techniques to ensure datasets are structured and formatted for optimal training efficiency.
• Research and implement innovative data curation methods, leveraging Cohere’s infrastructure to drive advancements in NLP.
• Collaborate with cross-functional teams to ensure data pipelines meet the demands of cutting-edge language models.

Skills

Python

Data pipelines

Curriculum learning

Data mixing

Data attribution

Large-scale data

Data quality

Tools

Apache Spark

Apache Beam

Pandas

Job description

Cohere, a leading security-first enterprise AI company, is seeking a Machine Learning Engineer focused on pretraining data. You will help build the data pipelines powering Cohere’s language models, conduct data ablations, and craft pre-training data mixtures to improve throughput and model quality.

As a Member of Technical Staff, Pre-Training Data, you will collaborate with researchers and engineers, design robust data models, and apply scalable processing frameworks to large multilingual