LLM Evaluation & Post-Training Research Scientist

Centific Global Solutions, Inc.; Seattle (WA); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Centific Global Solutions, Inc. is seeking a Research Scientist for LLM Evaluation & Post-Training in Seattle, WA. This full-time role involves leading research initiatives to improve model evaluation methodologies. Responsibilities include developing evaluation frameworks and collaborating with AI industry stakeholders. Candidates should have a PhD in a relevant field, at least 5 years of experience in applied ML research, and strong proficiency in Python and ML frameworks. This position offers hybrid working options.

Qualifications

• 5+ years of relevant experience in applied ML research.
• Demonstrated experience with LLM evaluation and benchmarking.
• Strong statistical analysis skills and ability to synthesize findings.

Responsibilities

• Define and execute a rigorous research agenda focused on LLM evaluation.
• Develop and validate comprehensive evaluation frameworks.
• Engage with customer technical stakeholders to provide recommendations.

Skills

Evaluation Science & Benchmarking

LLM & Post-Training Methods

Quantitative Analysis & Scientific Rigor

Education

MS or PhD in Computer Science, Machine Learning, Statistics, Applied Mathematics

Tools

Python

PyTorch

Hugging Face

JAX/TensorFlow

Job description

Centific Global Solutions, Inc. is seeking a Research Scientist for LLM Evaluation & Post-Training in Seattle, WA. This full-time role involves leading research initiatives to improve model evaluation methodologies. Responsibilities include developing evaluation frameworks and collaborating with AI industry stakeholders. Candidates should have a PhD in a relevant field, at least 5 years of experience in applied ML research, and strong proficiency in Python and ML frameworks. This position offers hybrid working options.