AI Platform Engineer - Observability & Guardrails Lead

Milestone Systems; Glostrup Kommune; Hybrid; DKK 900,000 - 1,400,000; Full time

Benefits offered by this job

Development plans

Training resources

Flexible hybrid

Supportive leadership

Cross-functional collaboration

People First culture

Social activities

Job summary

Milestone Systems seeks an AI Harness Engineer (Senior/Principal) to own the AI engineering platform, including gateway, agent loops, context handling, and tool integrations. You’ll define standards and architectures for AI-assisted development and build a robust observability layer across teams.

You will turn existing experiments into scalable internal solutions, establish evaluations and cost-tracking, and guide decisions on build vs buy, while ensuring on-prem and air-gapped deployments.

Qualifications

• Staff engineer or senior IC with distributed production systems experience.
• Hands-on familiarity with AI coding tools (Claude Code, Cursor, Copilot, Codex).
• Experience deploying LLM-based systems in production and managing latency, cost, and reliability.
• Strong fundamentals: diagnosing failures and fixing root causes.
• Budget mindset: manage token and compute spend as a real budget.

Responsibilities

• Own the AI engineering platform: model gateway, agent loops, context handling, tool integrations, caching, guardrails, identity, secrets, and audit trails.
• Define technical standards and reference architectures for AI-assisted development across teams.
• Build the observability layer to trace an agent run end-to-end and diagnose failures.
• Turn internal experiments into scalable solutions for other teams to use.
• Establish evaluations and cost-tracking to assess tool value and performance.
• Inform build-vs-buy decisions, prioritizing product-related components for build.
• Ensure operability in on-prem and air-gapped deployments.
• Collaborate with product teams to extend approach to customer-facing AI features within EU Act and GDPR.
• Mentor engineers and drive adoption across skeptical teams.

Skills

Distributed systems

AI tooling

LLM production

Observability

Security credentials

Cost awareness

Engineering judgment

Tools

Claude Code

Cursor

Copilot

Codex

Job description

Milestone Systems seeks an AI Harness Engineer (Senior/Principal) to own the AI engineering platform, including gateway, agent loops, context handling, and tool integrations. You’ll define standards and architectures for AI-assisted development and build a robust observability layer across teams.

You will turn existing experiments into scalable internal solutions, establish evaluations and cost-tracking, and guide decisions on build vs buy, while ensuring on-prem and air-gapped deployments.