Staff Data Scientist, LLM Data Quality & Evaluation

Cohere; San Francisco (CA); Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Weekly lunch stipend

Full health and dental benefits

401K and pension scheme

6 weeks paid vacation

Home office stipend

Parental leave top-up

Job summary

Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation.

The ideal candidate will have strong software engineering and statistical skills, along with experience in machine learning frameworks. Applicants from diverse backgrounds are encouraged to apply!

Qualifications

• Strong expertise in designing data collection tasks.
• Experience evaluating scientific experiments.
• Familiarity with ML systems' robustness.

Responsibilities

• Design and oversee data collection tasks for quality assurance.
• Develop statistical methods for dataset evaluation.
• Collaborate to improve model performance.

Skills

Software engineering skills

Statistical skills

Data collection tasks

Statistical evaluation

Programming (Python)

Machine Learning frameworks

Job description

Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation.

The ideal candidate will have strong software engineering and statistical skills, along with experience in machine learning frameworks. Applicants from diverse backgrounds are encouraged to apply!