Construction Evaluation Engineer - Part-Time

Brickanta; Stockholms kommun; Hybrid; SEK 344,000 - 551,000; Part time

Job summary

Brickanta, an AI-native platform for construction bid analysis, seeks a Construction Evaluation Engineer to define what great looks like for our agents, test them on real workflows, and turn judgments into measurable signals.

Part-time to start (15–20 hours/week), hybrid with meaningful time at the Stockholm office (Linnégatan 89B). You’ll run agents against construction tasks, create eval cases, and help grow the eval tooling.

Qualifications

• Real exposure to construction, engineering, project planning, estimating or surveying.
• Strong quantitative and analytical mindset with interest in modern AI systems.
• Extremely detail-oriented; able to handle hundreds of cases without lowering quality.
• Curious about why systems fail, not just whether they fail.
• Instinct for automation: map manual workflows before building the system.

Responsibilities

• Run our agents against real construction workflows and judge outputs on correctness, completeness and practicality.
• Turn real workflows and failure cases into repeatable eval cases with reference outputs and rubrics.
• Grow the evaluation harnesses, automated graders, regression tests and model comparisons.
• Identify what genuinely needs human judgment, then automate the rest.
• Capture learnings from customers and experts to improve deployments.

Job description

Construction doesn't buy "AI". It buys answers it can act on, and an answer can look completely plausible while being wrong in the way that costs money on a real project. The Construction Evaluation Engineer role exists to catch exactly that: to define what great looks like for our agents, find where they fail, and turn that judgment into something our systems can measure.

What You'll Do

• Run our agents against real construction workflows and judge the outputs on correctness, completeness and practical usefulness
• Turn real workflows, edge cases and production failures into repeatable eval cases: reference outputs, scoring rubrics, failure taxonomies and expert‑reviewed datasets
• Grow into the systems around the work - eval harnesses, automated graders, regression tests, model comparisons
• Work out what genuinely needs human judgment, then engineer the rest away
• Capture what we learn from customers, experts and agent failures so every deployment improves the underlying system

You might be a fit if

• You have real exposure to construction, engineering, project planning, estimating or surveying
• You're strongly quantitative and analytical, with a serious interest in modern AI systems
• You're extremely detail‑oriented - you can work through hundreds of cases without letting the quality bar drift
• You're curious about why systems fail, not just whether they fail
• You have an instinct for automation: understand the manual workflow first, then build the system around it
• You have high ownership
• You speak Swedish and English

You don't need to already be an experienced AI engineer. But you do need the raw ingredients to become one.

The practical details

Part‑time to start, roughly 15–20 hours per week, flexible on how they're distributed. Hybrid with meaningful time at the office at Linnégatan 89B, Stockholm.

About Brickanta

Brickanta (Brickanta.com) is the AI‑native agentic platform for construction bid analysis, cost estimation and procurement. Brickanta's industry know‑how AI raises margins and saves time by leveraging historical estimates, tender documents, and project data - so builders can focus on building. The founding team has been building with AI since 2018 and brings deep experience applying AI in construction and industrial sectors. Brickanta has raised over $8M in external funding from leading investors, including Northzone, Anton Osika and Mario Götze.

Keen on doing your life's work - bringing one of the world's largest and most impactful industries, the $15 trillion construction industry, into the AI era?