Senior AI Platform Engineer – Developer Experience (d/f/m)

kleinanzeigen.de GmbH; Berlin; Hybrid; EUR 120.000 - 170.000; Vollzeit

Benefits dieser Stelle

Flexible hours

Hybrid work

20 days work from anywhere

Parental leave

Extra days off

Coaching

Annual sports events

Pension and life insurance

Learning opportunities

Corporate discounts

Referral program

Zusammenfassung

Kleinanzeigen.de GmbH in Berlin seeks a Senior AI Platform Engineer – Developer Experience to shape a shared AI platform used by engineering teams. You’ll design, implement and operate platform capabilities for accessing models, running AI workloads, and ensuring governance and observability at scale.

Collaborate with cross-functional teams to build MCP gateways, agent runtimes, and secure integrations. Drive APIs and AWS/Kubernetes architectures in evolving AI patterns.

Qualifikationen

• Hands-on experience building or operating AI platform capabilities used by multiple teams.
• LLM gateways/model abstraction with routing and quotas.
• AI agent development frameworks and tool calling.
• MCP-style tools to APIs and data integration.
• LLM observability: tracing, latency, cost.
• Experience with AWS Bedrock/OpenAI/provider models.
• Identity, auth, guardrails and data auditing.
• Strong backend/software engineering fundamentals.
• Java, Kotlin or Python proficiency.
• API design for distributed services.
• Cloud infra: AWS, containers, networking.
• Kubernetes, Terraform, CI/CD familiarity.
• Willingness to adapt to evolving tech.
• English fluency; German a plus.

Aufgaben

• Design and build shared AI platform capabilities that can be used by engineering teams across Kleinanzeigen.
• Build and evolve a unified way for developers, applications and agents to access approved AI models and providers.
• Develop AI Gateway capabilities such as model routing, rate limiting, caching, fallbacks, quotas, usage attribution and cost controls.
• Evaluate and integrate new models and model providers and help define how they can be introduced into our engineering ecosystem.
• Build and evolve MCP Gateway capabilities that allow agents to securely discover and interact with internal tools and data.
• Contribute to agent runtime and secure execution capabilities for AI-powered workflows.
• Build platform mechanisms for identity, authentication, authorization, delegated access, guardrails, data protection and auditing.
• Develop AI observability and evaluation capabilities, including tracing, quality measurement, latency, usage and cost.
• Build APIs, SDKs, CLIs, templates and golden paths that make AI capabilities easy for engineering teams to adopt.
• Contribute to reusable developer AI workflows and the discovery of approved models, tools and agent capabilities.
• Collaborate with Developer Experience, AI Enablement, Release Engineering, DevOps and product engineering teams to identify gaps, avoid duplicated solutions and evolve a coherent AI platform.
• Participate in agile ceremonies and contribute to shaping the team's ways of working, including optimizing the way we work with AI.

Kenntnisse

AI platform

LLM gateways

Agent frameworks

MCP integration

Observability

Model providers

Backend services

Java/Python

API design

AWS / Cloud

Kubernetes

CI/CD

English comms

Jobbeschreibung

We are looking for a Senior AI Platform Engineer – Developer Experience (d/f/m) to join our Developer Experience team and help shape the shared AI platform capabilities used across engineering at Kleinanzeigen.
Kleinanzeigen is Germany’s No. 1 online classifieds platform, reaching more than 36 million users per month. With around 600 colleagues working across product, technology and business functions, we build and operate the technology behind one of Germany’s most widely used digital platforms.
As AI becomes an increasingly important part of software development, we want to move beyond individual tools and experiments and provide engineers with reliable, reusable and governed AI capabilities.
This role is focused on the platform layer behind AI-enabled engineering: how developers and agents access models, how agents interact with internal tools, how AI workloads are executed, and how these capabilities can be governed and observed at scale.
You will work on areas such as AI & MCP gateways, model-provider integrations, agent runtimes, AI observability and evaluations, governance, and developer-facing AI tooling.

Job requirements

Your profile

• You have hands-on experience building or operating AI platform capabilities used by multiple teams or applications
• You have experience with LLM gateways or model abstraction layers, including concepts such as provider routing, fallbacks, rate limiting, caching, quotas or cost controls
• You have practical experience with AI agent development frameworks, tool calling and agentic workflows
• You have experience with MCP or similar approaches for connecting agents to tools, APIs and internal data
• You understand how to evaluate and observe LLM-powered systems, including tracing, quality evaluation, latency, usage and cost
• You have worked with model providers or platforms such as AWS Bedrock, OpenAI or comparable services
• You understand platform concerns around identity, authentication, authorization, guardrails, data protection and auditing
• You have strong software engineering fundamentals and hands-on experience building backend or platform services
• You are proficient in at least one programming language such as Java, Kotlin or Python
• You are comfortable designing and building APIs, integrations and distributed services
• You have experience with cloud infrastructure, ideally AWS, and understand concepts such as containers, networking, identity and service-to-service communication
• You are familiar with modern infrastructure and delivery practices such as Kubernetes, Terraform and CI/CD
• You are comfortable working in an area where technologies and patterns are still evolving and can make pragmatic technical decisions under uncertainty
• Strong communication skills in English. German is a plus

Nice-to-have

• Experience with agent runtimes or secure sandbox environments
• Experience with context engineering, RAG, embeddings, retrieval or reranking
• Experience building AI SDKs, CLIs, templates or developer workflows
• Experience with internal developer platforms or developer tooling

Job responsibilities

• Design and build shared AI platform capabilities that can be used by engineering teams across Kleinanzeigen
• Build and evolve a unified way for developers, applications and agents to access approved AI models and providers
• Develop AI Gateway capabilities such as model routing, rate limiting, caching, fallbacks, quotas, usage attribution and cost controls
• Evaluate and integrate new models and model providers and help define how they can be introduced into our engineering ecosystem
• Build and evolve MCP Gateway capabilities that allow agents to securely discover and interact with internal tools and data
• Contribute to agent runtime and secure execution capabilities for AI-powered workflows
• Build platform mechanisms for identity, authentication, authorization, delegated access, guardrails, data protection and auditing
• Develop AI observability and evaluation capabilities, including tracing, quality measurement, latency, usage and cost
• Build APIs, SDKs, CLIs, templates and golden paths that make AI capabilities easy for engineering teams to adopt
• Contribute to reusable developer AI workflows and the discovery of approved models, tools and agent capabilities
• Collaborate with Developer Experience, AI Enablement, Release Engineering, DevOps and product engineering teams to identify gaps, avoid duplicated solutions and evolve a coherent AI platform
• Participate in agile ceremonies and contribute to shaping the team's ways of working, including optimizing the way we work with AI

At Kleinanzeigen, we care about our people — their wellbeing, growth, and life beyond work. Our benefits are designed to support you holistically, giving you flexibility and opportunities to thrive.

Flexible working time (hybrid)

20 days “work from anywhere”

Paid additional parental leave for both parents

Extra paid days off for special occasions (e.g. your wedding or a move)

Confidential support & coaching for you and your loved ones

Annual company sports events

Pension and life insurance

Learning opportunities to grow your skills and career

Corporate benefits and exclusive discounts

An attractive referral program

Kleinanzeigen is an equal opportunity employer that values diversity and inclusion. We welcome people of all backgrounds, races, religions, colours, national origins, gender identities, sexual orientation, ages, marital status, or disability.

If this role sparks your interest but you’re not sure you meet every single requirement, we’d still love to hear from you anyway.