Lead Software Engineer, AI Safety & Evals

Whereby; Greater London; On-site; GBP 110,000 - 150,000; Full time

Job summary

Kraken Technologies is hiring a Lead Software Engineer to head the Agent Safety/Evals team. You will define technical strategy for evaluating models, safety guardrails, and governance across internal platforms, ensuring secure and deterministic AI behavior.

You will lead continuous verification, red teaming, and observability initiatives, partnering with AI Foundations and engineering teams to scale safe AI across Kraken’s internal tools.

Qualifications

• Proven leadership in technical initiatives or teams.
• Strong foundation in secure, end-to-end software design.
• Experience evaluating AI outputs and building reproducible evals.

Responsibilities

• Define the technical strategy for evaluating models, safety guardrails, and governance across internal platforms.
• Lead the Agent Safety/Evals team to ensure secure, deterministic AI usage within Kraken.
• Develop scalable evaluation harnesses and measurement systems for internal workflows.

Skills

Technical leadership

Python (preferred)

AI evaluation & safety

Security & governance

AWS

Communication

Tools

Django

Datadog

Pydantic AI

LiteLLM

LangChain

Job description

Kraken Technologies is hiring a Lead Software Engineer to head the Agent Safety/Evals team. You will define technical strategy for evaluating models, safety guardrails, and governance across internal platforms, ensuring secure and deterministic AI behavior.

You will lead continuous verification, red teaming, and observability initiatives, partnering with AI Foundations and engineering teams to scale safe AI across Kraken’s internal tools.