Senior Staff Engineer, Web Data Pipelines

Cohere; United States; Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Weekly lunch stipend

Full health and dental benefits

RRSP matching / 401K

Parental leave top-up

Education stipend

6 weeks paid vacation

Home office stipend

Job summary

Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will own major components of the data pipeline, transforming noisy internet data into high-quality training data for large language models.

You will work with researchers and engineers to iteratively improve the training corpus, ensuring data efficiency and model performance. This role is remote-friendly with multiple office locations, and welcomes applicants globally.

Qualifications

• Strong software engineering skills with Python and building data pipelines.
• Experience with large-scale web datasets and data quality assessment techniques.
• Ability to bridge research and engineering to solve data-related AI training challenges.

Responsibilities

• Maintain large-scale web data pipelines for pre-training.
• Develop filtering and quality-scoring for web documents.
• Analyze data composition across domains, languages, and time periods.
• Develop deduplication pipelines and collaborate with researchers and engineers.

Skills

Python

Data pipelines

Large-scale data

Data quality

Research to Engineering

Tools

Apache Spark

Apache Beam

Pandas

Job description

Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will own major components of the data pipeline, transforming noisy internet data into high-quality training data for large language models.

You will work with researchers and engineers to iteratively improve the training corpus, ensuring data efficiency and model performance. This role is remote-friendly with multiple office locations, and welcomes applicants globally.