Senior LLM Evaluation & Post-Training Scientist

Innodata Inc.; United States; On-site; USD 175,000 - 225,000; Full time

Job summary

Innodata Inc. is looking for an Applied Research Scientist specializing in LLM evaluation and post-training methods. This role involves leading research efforts and designing experiments to enhance model performance through novel evaluation methodologies.

Qualified candidates should have a PhD or MS and over 5 years of experience in applied research within ML/AI. Strong coding skills in Python and familiarity with ML frameworks are essential for this position. A competitive salary range of $175,000 to $225,000 USD per year is offered.

Qualifications

• 5+ years of applied research or research science experience in ML/AI.
• Demonstrated experience with LLM evaluation and post-training.
• Strong foundation in statistical analysis for ML systems.

Responsibilities

• Define and execute a research agenda focused on LLM evaluation.
• Design rigorous experiments to study evaluation methodologies.
• Collaborate with AI/ML Research Engineers on evaluation pipelines.

Skills

Applied research in ML/AI

Python for data processing

Experimental design

Collaboration with technical stakeholders

Education

MS/PhD in Computer Science or related field

Tools

PyTorch

Hugging Face

JAX/TensorFlow

Job description

Innodata Inc. is looking for an Applied Research Scientist specializing in LLM evaluation and post-training methods. This role involves leading research efforts and designing experiments to enhance model performance through novel evaluation methodologies.

Qualified candidates should have a PhD or MS and over 5 years of experience in applied research within ML/AI. Strong coding skills in Python and familiarity with ML frameworks are essential for this position. A competitive salary range of $175,000 to $225,000 USD per year is offered.