Senior Software Engineer - Agent Safety / Evals - AI Foundations

Kraken; Berlin; Vor Ort; EUR 110.000 - 160.000; Vollzeit

Zusammenfassung

Kraken in Berlin is seeking a Senior Software Engineer to join the Agent Safety/Evals team. You’ll own substantial parts of the evaluation, safety, and reliability stack, turning technical direction into production systems and mentoring others.

You will design internal agent-safety services, build evaluation harnesses, implement guardrails, and collaborate across AI Foundations to raise engineering standards while delivering secure, observable, scalable software.

Qualifikationen

• Senior software engineer with end-to-end ownership of components
• Production Python experience preferred
• Practical AI evaluation and safety expertise
• Security, governance mindset and data access control
• AWS cloud experience and reliability focus
• Clear communication and collaborative mindset

Aufgaben

• Build internal agent-safety systems and services to improve reliability, security, and determinism of LLMs and autonomous agents
• Develop scalable evaluation harnesses and test cases for internal workflows
• Implement pre- and post-generation guardrails and translate governance into software
• Enhance AI security and observability with authentication, monitoring and playbooks
• Contribute to verification and red-teaming exercises before production
• Operate services in AWS with attention to performance, reliability and cost
• Mentor peers and raise engineering standards across AI Foundations

Jobbeschreibung

Help us use technology to make a big green dent in the universe! Kraken powers some of the most innovative global developments in energy. We create the technology that redefines utilities and unlocks a new energy system of the future. By optimising renewable generation, building a more intelligent grid, and empowering utilities to deliver an exceptional customer experience, our operating system is transforming the industry worldwide. It’s an incredibly exciting time to work in energy. Join us on our mission to improve the lives of ONE BILLION humans within the decade and shape a cleaner, better future for everyone. AI is a key investment area for Kraken Technologies as we look to expand our existing capabilities. A crucial part of this is broadening the foundational infrastructure that enables teams across the organisation to use AI effectively and accelerate our mission. You'll work in the Agent Safety team. We build the shared platforms, harnesses, and guardrails that enable engineering and product teams to safely, reliably, and deterministically use machine learning and generative AI agents for internal systems and workflows across the business. This is a delivery-focused team that sits at the intersection of engineering, security, and internal enablement.

Where you’ll fit in

We're hiring a Senior Software Engineer to join our newly formed Agent Safety / Evals team. As AI agents take on more autonomous tasks across Kraken's internal workflows, you will help ensure they do so securely, predictably, and within clearly defined operational boundaries. This is a hands‑on senior individual‑contributor role. Working with the Lead Software Engineer and the broader AI team, you will own substantial parts of our evaluation, safety, and reliability stack - turning technical direction into production systems, contributing to architecture decisions, and raising engineering standards through thoughtful collaboration and mentoring.

What You’ll Own

• Build internal agent-safety systems: Design and implement services that improve the reliability, security, and determinism of LLMs and autonomous agents, keeping them within expected operational boundaries
• Develop robust evaluation frameworks: Build scalable harnesses and evals for internal workflows and AI skills. Define meaningful test cases, interrogate output quality, and improve the reproducibility of the systems used to measure it
• Implement guardrails and governance controls: Develop pre- and post-generation controls and translate agreed governance requirements into maintainable software across internal tools and platforms
• Strengthen AI security and observability: Engineer authentication and permission patterns for internal agents, improve monitoring and tracing, and contribute to operational playbooks for AI‑specific anomalies
• Support verification and red teaming: Design tests and participate in continuous verification and red‑teaming exercises to identify prompt injection, data‑access, and unpredictable‑behaviour risks before they reach production
• Operate services in AWS: Deploy, run, and support high‑throughput, low‑latency safety services; make sound architecture, reliability, and cost trade‑offs; and work effectively with platform, techops, and security partners
• Raise the engineering bar: Contribute to technical decisions, review designs and code, mentor other engineers, and help establish pragmatic patterns that can be reused across AI Foundations

What You Bring To The Party

• Strong senior‑level software engineering: Proven experience owning complex components or services end to end, from design and implementation through testing, deployment, and operation
• Deep engineering fundamentals: Strong judgement around system design, concurrency, security, testing, and architecture trade‑offs. Production Python experience is preferred
• Practical AI evaluation and safety experience: A critical understanding of LLM behaviour and experience building or using evaluation harnesses to measure output quality and reliability
• Security and governance mindset: Experience with areas such as threat modelling, authentication and authorisation, red teaming, data‑access controls, or guardrails for internal platforms
• Cloud experience: Comfortable running services in AWS, owning reliability and scalability, and collaborating with platform, techops, and security teams
• Clear communication and collaboration: Able to explain technical trade‑offs, challenge constructively, and turn complex safety and evaluation findings into practical action

What Success Looks Like

• Reliable delivery: You ship well‑tested safety and evaluation capabilities that are adopted by internal engineering and product teams
• High‑quality evals: Evaluation harnesses produce meaningful, reproducible signals that reflect the real‑world performance and safety of Kraken's internal AI tooling
• Resilient infrastructure: The services you own are observable, secure, scalable, and supported by clear operational practices
• Strong technical collaboration: You work effectively across AI Foundations and partner teams, improve designs through constructive challenge, and help others deliver safely and confidently

Bonus points

• Evaluation and safety frameworks: Experience with tools such as Inspect AI, Ragas, OpenAI Evals, or NeMo Guardrails
• Backend engineering: Django experience and strong patterns for security, performance, and maintainability
• Observability: Experience using Datadog for tracing, monitoring, and investigating complex AI‑enabled systems
• AI engineering tooling: Familiarity with tools such as Pydantic AI, LiteLLM, or LangChain

Are you ready for a career with us? We want to ensure you have the right tools and environment to unleash your potential. If you have any accommodation requests, please contact us at [e-mail]. We’ll do our best to tailor the experience to your needs so you can feel comfortable, confident and be at your best!

Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we’re looking for! At Kraken, we're creating a team of genuine, honest, empathetic people. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. We consider all applicants without regard to race, colour, religion, national origin, age, sex, gender identity or expression, sexual orientation, marital or veteran status, disability, or any other legally protected status.

• Our (i) Applicant and Candidate Privacy Notice and Artificial Intelligence (AI) Notice, (ii) Website Privacy Notice and (iii) Cookie Notice govern the collection and use of your personal data in connection with your application and use of our website. These policies explain how we handle your data and outline your rights under applicable laws, including, but not limited to, the General Data Protection Regulation (GDPR) and the California Consumer Privacy Act (CCPA). Depending on your location, you may have the right to access, correct, or delete your information, object to processing, or withdraw consent. By applying, you acknowledge that you’ve read, understood and consent to these terms

Please note that, in line with our current recruitment policy, we are unable to offer visa sponsorship for this position; applicants must have the right to work in the country that they're applying to, at the time of application.*