Staff Engineer - Data Platform (m|w|d)

Meyandy LLC; Berlin; Vor Ort; EUR 110.000 - 170.000; Vollzeit

Zusammenfassung

idealo internet GmbH in Berlin is seeking a Staff Engineer for the Data Platform to architect cloud-native components and drive two strategic platform initiatives: Personalization and Data-as-a-Service (DaaS).

You will mentor engineers, shape architecture across Data Engineering, Software Engineering, Cloud and ML teams, and ensure secure, scalable, production-ready platforms used by millions of users.

Qualifikationen

• Experience building cloud-native platforms on AWS.
• Hands-on with PySpark and distributed data pipelines.
• Strong background in CI/CD and infrastructure as code.

Aufgaben

• Architect and develop cloud-native platform components and pipelines.
• Lead technical initiatives across Data Engineering, Software Engineering, Cloud, Platform and ML teams.
• Mentor engineers through architecture discussions and reviews.

Kenntnisse

Distributed systems

CI/CD practices

Security best practices

Architectural leadership

Mentoring

Tools

Terraform

AWS CDK

CloudFormation

GitHub Actions

Docker

Kubernetes

Airflow

Kafka

Kinesis

PySpark

Jobbeschreibung

Reliable pipelines, resilient infrastructure and a scalable data platform are the foundation of every data-driven decision at idealo. As we accelerate toward real-time analytics, personalization and data monetization, the Data Platform is the engine that makes it possible. As a Staff Engineer, you’ll shape the technical foundation of the platform that thousands of daily data workloads depend on—and drive the strategic initiatives that will define what it can do next. This role combines platform engineering, cloud architecture and data engineering. You’ll influence how workloads are orchestrated across the platform, how infrastructure scales with demand and how technical decisions support idealo’s long-term data strategy. You’ll work in a modern engineering environment where state-of-the-art AI tooling—such as Claude Code—is available to accelerate your day-to-day work.

About your new role

Architect and develop cloud-native platform components, infrastructure automation and pipeline frameworks, with a strong focus on performance, security and maintainability. Lead technical initiatives within and across the team to align platform capabilities with business and product needs. Identify technical risks early and keep architecture decisions and technical concepts traceable across project phases. Drive continuous improvements across CI/CD pipelines, infrastructure as code, observability and monitoring. Structure technology choices as clear trade-offs—evaluating performance, cost, maintainability and integration—to inform strategic decisions. You’ll play a key role in shaping two of idealo’s most strategic platform initiatives: Personalization and Data-as-a-Service (DaaS). For Personalization, you’ll define and build a next-generation, privacy-first platform from the ground up, establishing the technical vision, architecture and engineering standards that enable highly relevant experiences across the entire customer journey for millions of users. In parallel, you’ll drive the evolution of our DaaS platform by researching, prototyping and validating new capabilities around real-time data processing, streaming technologies such as Kafka and Kinesis, and ML/AI integration. You’ll build scalable data products that enable data monetization and create new business opportunities. Working across Data Engineering, Software Engineering, Cloud, Platform, Product and Machine Learning teams, you’ll align technical direction, tackle complex cross-functional challenges and turn early concepts into production-ready platforms that will shape idealo’s long-term technology and data strategy. Mentor engineers through technical guidance, architecture discussions and code reviews, fostering a collaborative engineering culture focused on sustainable technical excellence.

Skills & Requirements

You have built and operated cloud-native platforms on AWS, with a strong focus on software and infrastructure engineering, distributed systems and operational excellence. You have hands‑on experience with AWS services including Glue Catalog, Glue ETL with PySpark, S3, Lake Formation, Kafka, Kinesis, Lambda, ECS or EKS, and CloudWatch. You have used infrastructure‑as‑code tooling such as Terraform, AWS CDK or CloudFormation, as well as GitHub and GitHub Actions. Familiarity with SageMaker and Bedrock AgentCore is a plus. You have experience with workflow orchestration and data pipeline frameworks, ideally including Airflow or Astronomer. You have worked with PySpark or comparable distributed processing frameworks in Python. You have experience with containerization and orchestration technologies, including Docker and Kubernetes, as well as modern CI/CD practices and DevOps tooling. You understand software quality, security and reliability practices, including authentication, encryption, automated testing and secure software development. You understand data engineering concepts, including pipeline design, data modelling, ETL patterns, ML Ops, data quality and pipeline observabili…

Staff Engineer - Data Platform (m|w|d) — idealo internet GmbH, Berlin.

Cette offre d'emploi a été agrégée automatiquement depuis arbeitnow. Pour accéder à la description complète du poste, aux missions détaillées, aux compétences précises attendues et à la procédure de candidature, cliquez sur le bouton « Postuler sur arbeitnow » dans la barre latérale. Vous serez redirigé vers la fiche d'origine. Mots-clés : Technology & Data.