Part-Time Hybrid Construction AI Evaluation Engineer

Brickanta; Stockholms kommun; Hybrid; SEK 344,000 - 551,000; Part time

Job summary

Brickanta, an AI-native platform for construction bid analysis, seeks a Construction Evaluation Engineer to define what great looks like for our agents, test them on real workflows, and turn judgments into measurable signals.

Part-time to start (15–20 hours/week), hybrid with meaningful time at the Stockholm office (Linnégatan 89B). You’ll run agents against construction tasks, create eval cases, and help grow the eval tooling.

Qualifications

• Real exposure to construction, engineering, project planning, estimating or surveying.
• Strong quantitative and analytical mindset with interest in modern AI systems.
• Extremely detail-oriented; able to handle hundreds of cases without lowering quality.
• Curious about why systems fail, not just whether they fail.
• Instinct for automation: map manual workflows before building the system.

Responsibilities

• Run our agents against real construction workflows and judge outputs on correctness, completeness and practicality.
• Turn real workflows and failure cases into repeatable eval cases with reference outputs and rubrics.
• Grow the evaluation harnesses, automated graders, regression tests and model comparisons.
• Identify what genuinely needs human judgment, then automate the rest.
• Capture learnings from customers and experts to improve deployments.

Job description

Brickanta, an AI-native platform for construction bid analysis, seeks a Construction Evaluation Engineer to define what great looks like for our agents, test them on real workflows, and turn judgments into measurable signals.

Part-time to start (15–20 hours/week), hybrid with meaningful time at the Stockholm office (Linnégatan 89B). You’ll run agents against construction tasks, create eval cases, and help grow the eval tooling.