Senior Staff Engineer, Web Data Pipelines

Cohere

United States

Remote

USD 150,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Weekly lunch stipend
Full health and dental benefits
RRSP matching / 401K
Parental leave top-up
Education stipend
6 weeks paid vacation
Home office stipend

Job summary

Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will own major components of the data pipeline, transforming noisy internet data into high-quality training data for large language models.

You will work with researchers and engineers to iteratively improve the training corpus, ensuring data efficiency and model performance. This role is remote-friendly with multiple office locations, and welcomes applicants globally.

Qualifications

  • Strong software engineering skills with Python and building data pipelines.
  • Experience with large-scale web datasets and data quality assessment techniques.
  • Ability to bridge research and engineering to solve data-related AI training challenges.

Responsibilities

  • Maintain large-scale web data pipelines for pre-training.
  • Develop filtering and quality-scoring for web documents.
  • Analyze data composition across domains, languages, and time periods.
  • Develop deduplication pipelines and collaborate with researchers and engineers.

Skills

Python
Data pipelines
Large-scale data
Data quality
Research to Engineering

Tools

Apache Spark
Apache Beam
Pandas

Job description

Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will own major components of the data pipeline, transforming noisy internet data into high-quality training data for large language models.

You will work with researchers and engineers to iteratively improve the training corpus, ensuring data efficiency and model performance. This role is remote-friendly with multiple office locations, and welcomes applicants globally.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Web Data Engineer for AI Training Pipelines
Senior Web Data Engineer for AI Training Pipelines

Cohere • New York (NY)

Remote
USD 180,000 - 240,000
Lunch stipend
Health and dental benefits
RRSP matching / 401K
+5
Pre-Training Data Engineer — Scalable Pipelines (Remote)
Pre-Training Data Engineer — Scalable Pipelines (Remote)

Cohere • United States

Remote
USD 140,000 - 190,000
Health and dental benefits
Weekly lunch stipend
Remote-friendly
+2
ML Engineer: Pretraining Data & Pipelines (Remote)
ML Engineer: Pretraining Data & Pipelines (Remote)

Cohere • United States

Remote
USD 120,000 - 180,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
ML Data Engineer - Pretraining Pipelines (Remote)
ML Data Engineer - Pretraining Pipelines (Remote)

Cohere • New York (NY)

Remote
USD 140,000 - 190,000
Lunch stipend
Health and dental benefits
Retirement plan matching
+5
Senior Member of Technical Staff, Web Data
Senior Member of Technical Staff, Web Data

Cohere • United States

Remote
USD 150,000 - 210,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching / 401K
+4
Staff Engineer, Post-Training Data Pipelines for LLMs
Staff Engineer, Post-Training Data Pipelines for LLMs

Cohere • San Francisco (CA)

Remote
USD 180,000 - 240,000
Weekly lunch stipend
Health and dental benefits
RRSP matching / 401K
+5
Senior ML Engineer, Synthetic Data Pipelines (Remote)
Senior ML Engineer, Synthetic Data Pipelines (Remote)

Cohere • United States

Remote
USD 160,000 - 210,000
Weekly lunch stipend
Health and dental benefits
RRSP/401K matching
+4
Member of Technical Staff, Pre-Training Data
Member of Technical Staff, Pre-Training Data

Cohere • United States

Remote
USD 120,000 - 180,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
Member of Technical Staff, Pre-Training Data
Member of Technical Staff, Pre-Training Data

Cohere • New York (NY)

Remote
USD 140,000 - 190,000
Lunch stipend
Health and dental benefits
Retirement plan matching
+5
Member of Technical Staff - Post-training (Data Infrastructure)
Member of Technical Staff - Post-training (Data Infrastructure)

Cohere Health • United States

Hybrid
USD 175,000 - 325,000
Lunch stipend
Health & dental benefits
RRSP matching / 401K
+5