Staff, Data Quality & LLM Evaluation (Remote-friendly)

Cohere; Greater London; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Remote-friendly work environment

Daily lunch program for office workers

Co-working benefit for remote employees

Job summary

Cohere is seeking a Member of Technical Staff for Data Analysis and Evaluation to ensure the quality and performance of large language models (LLMs). This role necessitates expertise in statistical methods, experimental design, and machine learning to enhance our AI systems. The position is remote-friendly, allowing you to work from anywhere while collaborating closely with cross-functional teams.

The ideal candidate will have exceptional software engineering skills and a solid understanding of data evaluation methodologies. Contribute to advancing AI with Cohere's cutting-edge foundation models targeted at real-world problems.

Qualifications

• Experience designing and conducting data collection tasks with human annotators.
• Strong experience in evaluating scientific experiments related to ML models.
• Hands-on experience training large language models on distributed infrastructures.

Responsibilities

• Design and oversee data collection tasks and support human annotators.
• Develop statistical methods to evaluate dataset quality.
• Analyse the generalisability and robustness of ML systems.

Skills

Software engineering skills

Statistical skills

Programming languages (Python)

Experience with ML frameworks (PyTorch, TensorFlow)

Excellent communication skills

Job description

Cohere is seeking a Member of Technical Staff for Data Analysis and Evaluation to ensure the quality and performance of large language models (LLMs). This role necessitates expertise in statistical methods, experimental design, and machine learning to enhance our AI systems. The position is remote-friendly, allowing you to work from anywhere while collaborating closely with cross-functional teams.

The ideal candidate will have exceptional software engineering skills and a solid understanding of data evaluation methodologies. Contribute to advancing AI with Cohere's cutting-edge foundation models targeted at real-world problems.