Remote LLM Evaluation Engineer - AI Research & Benchmarks

Blue Lynx Employment BV; Netherlands; Remote; EUR 60,000 - 80,000; Full time

Benefits offered by this job

25 holidays per annum

Pension plan

Opportunity to work on cutting-edge AI initiatives

Job summary

Blue Lynx Employment BV is seeking a Software Engineer for LLM evaluation to join a remote team in the Netherlands. The role involves analyzing large language models' performance, conducting data-driven analyses, and contributing to innovative AI initiatives.

The ideal candidate will have a strong background in AI, Machine Learning, and programming in Python, with a focus on model evaluation. The position offers opportunities to work with experienced researchers in a collaborative environment.

Qualifications

• 3–5 years of experience working with large language models.
• Strong hands-on programming experience in Python.
• Demonstrated scientific curiosity and problem-solving skills.

Responsibilities

• Analyse and evaluate large language models' performance.
• Execute benchmark evaluations and generate performance metrics.
• Develop and maintain ML/DL systems and tooling.

Skills

Fluent in English

Programming in Python

Experience with large language models

ML/DL systems maintenance

Research in AI

Data analysis

Education

Bachelor's degree in Computer Science or related

Master's or PhD in relevant field

Tools

PyTorch

Job description

Blue Lynx Employment BV is seeking a Software Engineer for LLM evaluation to join a remote team in the Netherlands. The role involves analyzing large language models' performance, conducting data-driven analyses, and contributing to innovative AI initiatives.

The ideal candidate will have a strong background in AI, Machine Learning, and programming in Python, with a focus on model evaluation. The position offers opportunities to work with experienced researchers in a collaborative environment.