Senior ML Engineer, Synthetic Data Pipelines

Cohere; Greater London; Remote; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Lunch stipend

Health and dental benefits

RRSP matching / Pension

Parental leave

Enrichment benefits stipend

6 weeks paid vacation

Travel budget to other offices

Home office stipend $500

Job summary

Cohere is seeking a Senior Machine Learning Engineer specializing in synthetic data to lead end-to-end management of synthetic data pipelines for advanced language models. You will analyze, generate, and ablate data, transforming diverse web and code data with generative models to improve token efficiency and model quality.

You will bridge research and engineering, collaborating with researchers and engineers to push the boundaries of NLP training metrics while working in a remote-friendly

Qualifications

• Strong software engineering skills, with proficiency in Python and experience building data pipelines.
• Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
• Experience working with LLMs through work projects, open-source contributions or personal experimentation.
• Familiarity with LLM inference frameworks such as vLLM and TensorRT.
• Experience working with large-scale datasets, including web data, code data, and multilingual corpora.
• A passion for bridging research and engineering to solve complex data-related challenges in AI model training.

Responsibilities

• Design and build scalable inference pipelines that run on large GPU clusters.
• Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance.
• Research and implement innovative synthetic data curation methods, leveraging Cohere’s infrastructure to drive advancements in natural language processing.
• Collaborate with cross-functional teams, including researchers and engineers, to ensure data pipelines meet the demands of cutting-edge language models.

Skills

Python

Data pipelines

LLMs

Research & engineering

Multilingual data

Tools

Apache Spark

Apache Beam

Pandas

vLLM

TensorRT

Job description

Cohere is seeking a Senior Machine Learning Engineer specializing in synthetic data to lead end-to-end management of synthetic data pipelines for advanced language models. You will analyze, generate, and ablate data, transforming diverse web and code data with generative models to improve token efficiency and model quality.

You will bridge research and engineering, collaborating with researchers and engineers to push the boundaries of NLP training metrics while working in a remote-friendly