Staff Data Analysis & LLM Evaluation

Cohere; New York (NY); Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Weekly lunch stipend

Full health and dental benefits

401K and RRSP matching

6 weeks of paid vacation

Home office stipend

Job summary

Cohere is seeking a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of our language models. This role involves designing data collection tasks, analyzing dataset quality, and collaborating with cross-functional teams.

The ideal candidate should possess strong software engineering and statistical skills, along with hands-on experience in training large language models. We invite diverse applicants, as we value unique perspectives.

Qualifications

• Extremely strong software engineering skills.
• Strong expertise in designing and conducting data collection tasks.
• Hands-on experience training large language models (LLMs) on distributed infrastructures.

Responsibilities

• Design and oversee data collection tasks, ensuring quality.
• Develop statistical methods to evaluate data quality.
• Conduct experiments to evaluate model performance.

Skills

Software engineering skills

Statistical skills

Experience with ML frameworks

Excellent communication skills

Tools

Python

PyTorch

TensorFlow

Job description

Cohere is seeking a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of our language models. This role involves designing data collection tasks, analyzing dataset quality, and collaborating with cross-functional teams.

The ideal candidate should possess strong software engineering and statistical skills, along with hands-on experience in training large language models. We invite diverse applicants, as we value unique perspectives.