Pre-Training Data Engineer — Scalable Pipelines (Remote)

Cohere; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health and dental benefits

Weekly lunch stipend

Remote-friendly

6 weeks vacation

Parental leave top-up

Job summary

Cohere is seeking a Data Engineer in the Pre-Training team to build and optimize data pipelines for large language model training. You will manage diverse data sources, implement robust data modeling, and drive data quality enhancements to improve throughput and model performance.

You will collaborate across research and engineering to push the boundaries of NLP data processing, with remote-friendly options and offices in major cities.

Qualifications

• Proficient in Python and building scalable data pipelines.
• Experience with large-scale datasets and diverse data sources.
• Familiar with data quality assessment and experimentation with data mixtures.

Responsibilities

• Design and build scalable data pipelines to ingest, clean, filter, and optimize diverse datasets.
• Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance.
• Develop robust data modeling techniques for training efficiency.
• Research and implement innovative data curation methods leveraging Cohere infrastructure.
• Collaborate with researchers and engineers to meet data pipeline demands for language models.

Skills

Python

Data pipelines

Software engineering

Data quality

Research & engineering

Tools

Apache Spark

Apache Beam

Pandas

Job description

Cohere is seeking a Data Engineer in the Pre-Training team to build and optimize data pipelines for large language model training. You will manage diverse data sources, implement robust data modeling, and drive data quality enhancements to improve throughput and model performance.

You will collaborate across research and engineering to push the boundaries of NLP data processing, with remote-friendly options and offices in major cities.