AI Retrieval & Quality Engineer — Production & Evaluation

Redpine; Stockholms kommun; On-site; SEK 600,000 - 800,000; Full time

Benefits offered by this job

Competitive salary

Meaningful equity

Relocation support

Job summary

Redpine in Stockholm is looking for a candidate skilled in designing and operating retrieval systems that serve licensed data to AI models. This role involves building evaluation infrastructures to ensure quality, translating research into practical applications, and defining metrics that prove system effectiveness. The ideal candidate has production experience with retrieval systems and strong opinions on evaluation methods, alongside proficiency in Go, Rust, and Python. Competitive salary and relocation support offered.

Qualifications

• Experience with search, ranking, recommendation systems, or RAG at scale.
• Knowledge of designing test sets and running A/B experiments.
• Familiarity with embeddings, vector and lexical indexes.
• Ability to differentiate between academic methods and those that work in production.

Responsibilities

• Design and operate retrieval pipelines serving licensed data.
• Build evaluation infrastructure to ensure quality.
• Translate research into production systems.
• Define quality metrics and build dashboards to prove them.

Skills

Production experience with retrieval systems

Strong opinions on evaluation

Comfort with the full retrieval stack

Shipped production systems

Adaptability to evolving problems

Tools

Go

Rust

Python

Job description

Redpine in Stockholm is looking for a candidate skilled in designing and operating retrieval systems that serve licensed data to AI models. This role involves building evaluation infrastructures to ensure quality, translating research into practical applications, and defining metrics that prove system effectiveness. The ideal candidate has production experience with retrieval systems and strong opinions on evaluation methods, alongside proficiency in Go, Rust, and Python. Competitive salary and relocation support offered.