AI Platform Engineer (m/f/x)

SmartRecruiters, Inc.; Berlin; Hybrid; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Relocation support

Work from abroad

Deutschland Jobticket 50% subsidy

Prime+ Broker subscription

Urban Sports Club membership

Education Budget

Job summary

Scalable Capital is seeking an AI Platform Engineer to design and maintain the internal AI provisioning platform and governance framework for scalable generative AI applications. You will ensure secure, observable, and cost-effective model access across LLMs and MCP servers, collaborating with Data Science and AI teams.

Responsibilities include building cloud-native infrastructure, integrating observability tools, and enforcing governance policies while supporting agentic workflows and

Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, or related field.
• Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
• Strong experience with cloud infrastructure (AWS preferred) and Terraform.
• Proficiency in Python or Go and experience with CI/CD and Docker.
• Solid understanding of API cost management, rate limiting, and data privacy for AI models.

Responsibilities

• Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e.g., via LiteLLM).
• Implement comprehensive LLM observability, logging, and alerting systems using Datadog and Langfuse.
• Enforce model governance, ensuring security, data privacy, rate limiting, and strict LLM API cost management.
• Collaborate with embedded AI Software Engineers to support cloud-native architectures and agentic workflow integrations.
• Build and maintain infrastructure for monitoring the reliability and performance of production AI systems.

Skills

Python

Go

CI/CD pipelines

Docker

AWS

Terraform

LLM gateways

Observability

Security best practices

Data privacy

Education

Bachelor's or Master's in Computer Science, Software Engineering, or related field

Tools

Datadog

Langfuse

LiteLLM

Job description

Scalable Capital is a leading digital investment and banking platform with a full banking licence, empowering people across Europe to shape their own finances. Scalable Broker makes it easy and affordable for clients to invest professionally in stocks, ETFs, cryptocurrencies, and derivatives, as well as set up savings plans. Scalable Wealth, the digital wealth management service, offers clients professional investment in ETF portfolios, and is also adopted as a white-label solution by banks and other B2B partners. The company's offerings are rounded off by attractive interest rates, loans, and private equity. With the European Investor Exchange, Scalable Capital offers an exchange specifically for retail investors. Over one million clients have already entrusted more than €50 billion to the platform.

Founded in 2014, Scalable Capital now employs over 700 people across Munich, Berlin, Vienna, Milan, and London. Together with the founding and management team, including Erik Podzuweit and Florian Prucker, they are working on a new generation of financial services.

Visit our finance blog or check out our Social Media channels to find out what our Expert Teams have to say.
Our Company Values guide us every day in how we work and collaborate. To learn more about them, you can find our values here (English).

Job Description

As an AI Platform Engineer embedded within our Data Science and AI tribe, you will design and maintain the foundational infrastructure that enables our AI Software Engineers to build and scale generative AI applications.

You will build our internal AI provisioning platform, focusing on seamless model access, observability, and strict governance. In this role, you will ensure our AI integrations are secure, performant, and cost-effective, providing the robust backbone required for our agentic and LLM-driven workflows.

Responsibilities:

• Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e.g., via LiteLLM).
• Implement comprehensive LLM observability, logging, and alerting systems using tools like Datadog and Langfuse.
• Enforce model governance, ensuring security, data privacy, rate limiting, and strict LLM API cost management.
• Collaborate closely with embedded AI Software Engineers to support cloud-native architectures and agentic workflow integrations.
• Build and maintain infrastructure for monitoring the reliability and performance of production AI systems.

Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• Severalyears of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
• Strong experience and confidence working with cloud infrastructure (AWS preferred) and Infrastructure as Code (Terraform).
• Proficiency in at least one programming language (e.g., Python, Go) and experience with CI/CD pipelines and containerization (e.g., Docker).
• Solid understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
• Experience with, or a strong willingness to learn, LLM gateways, observability platforms, and telemetry (e.g., LiteLLM, Langfuse, Datadog).
• Strong problem-solv­ing skills, a sense of humor, and the ability to thrive in an ego‑free environment as an embedded platform expert within a cross‑functional Data Science and AI team.

Additional Information

• Be part of one of the fastest-growing and most visible Fintech startups in Europe, creating innovative services that have a substantial impact on the lives of our customers
• Work with an international, diverse, inclusive, and ever-growing team that loves creating the best products for our clients
• Be productive with the latest hardware and tools
• Learn and grow by joining our in-house knowledge sharing or career development sessions and spending your individual Education Budget
• Learn and experience German culture first hand by joining our free German language classes
• International relocation support is provided if required
• Opportunity to work from abroad
• Benefit from an attractive compensation package and from the company pension scheme
• Monthly contribution of 50% for the 'Deutschland Jobticket'
• Say goodbye to order commissions and say hello to your complimentary subscription of Scalable Capital's PRIME+ Broker
• Enjoy flexible and discounted sports activities with Urban Sports Club

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply