AI Quality & Evaluation Engineer - HR Tech

Hailey HR; Stockholms kommun; Presencial; SEK 600 000 - 900 000; Tempo integral

Resumo da oferta

Hailey HR, a Swedish SaaS HR-tech company, is seeking an AI Evaluation Engineer to join our AI development team in Stockholm. You will define how to evaluate AI features, build synthetic data-driven test sets, and develop CI pipelines to ensure reliability and privacy in production.

You will work closely with AI developers, QA engineers, and Product Owners to translate evaluation results into concrete improvements and maintain privacy-friendly monitoring across AI features.

Qualificações

• Master’s degree in CS, DS or engineering physics.
• Around two years of professional experience in software development, data science or test automation with hands-on experience with LLMs.
• Fluency in Swedish and strong English skills, both spoken and written.

Responsabilidades

• Define, with the team, what “good” looks like for each AI feature and turn it into measurable criteria.
• Build and maintain test datasets for AI features using synthetic data and realistic edge cases.
• Develop evaluation pipelines that run in CI.
• Set up privacy-friendly monitoring of AI quality in production.
• Turn evaluation results into concrete improvement suggestions for the team.

Conhecimentos

Python

AI evaluation

Statistics

Analytical thinking

Swedish (fluency)

Team collaboration

Formação académica

Master’s degree in Computer Science, Data Science, Engineering Physics or equivalent

Ferramentas

CI pipelines

Descrição da oferta de emprego

Hailey HR, a Swedish SaaS HR-tech company, is seeking an AI Evaluation Engineer to join our AI development team in Stockholm. You will define how to evaluate AI features, build synthetic data-driven test sets, and develop CI pipelines to ensure reliability and privacy in production.

You will work closely with AI developers, QA engineers, and Product Owners to translate evaluation results into concrete improvements and maintain privacy-friendly monitoring across AI features.