Lead Data Platform Engineer - Hybrid, Snowflake & Kafka

DWS Group; Madrid; Híbrido; EUR 90.000 - 150.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare

Retirement plan

Hybrid working

Professional development

Descripción de la vacante

DWS Group is seeking a Lead Engineer – Data Platform in Madrid to architect and evolve enterprise data platform capabilities across hybrid cloud and on-prem environments. You will lead a small, high-impact team, set technical direction and mentor engineers, while contributing to architecture and code.

Ideal candidates have 12+ years in data/platform engineering, deep Snowflake, Airflow and Kafka expertise, and strong Python/SQL skills.

Formación

• 12+ years of experience in data or platform engineering, including designing and operating enterprise-scale data platforms
• Deep hands-on Snowflake expertise across architecture, ingestion, transformation, workload management, and governance
• Strong production experience with Apache Airflow, including reusable DAG patterns and monitoring
• Strong expertise in Apache Kafka and event-driven architectures, including schema management and replay strategies
• Proven ability to integrate batch and streaming pipelines across Snowflake, Airflow and Kafka
• Advanced Python and SQL skills; Java experience for Kafka-based services is beneficial
• Strong experience with Terraform, Git, CI/CD and automated testing; OpenShift or Kubernetes desirable
• Strong understanding of reliability, observability, data quality, security and compliance
• Proven technical leadership, including mentoring engineers and communicating with stakeholders
• Fluent written and spoken English; interest in using AI tools to enhance productivity

Responsabilidades

• Own the end-to-end architecture, design and evolution of enterprise data platform capabilities across hybrid cloud and on-premises environments
• Define the technical roadmap, engineering standards and reusable patterns for workflow orchestration, scheduling, dependency management and data processing
• Lead architectural decisions, proofs of concept and adoption plans based on scalability, interoperability, security and total cost of ownership
• Establish reliability, observability and operational standards for data platform components including monitoring and alerting
• Drive platform automation through infrastructure as code, CI/CD and automated testing
• Partner with architecture, security and governance teams to meet enterprise standards and regulatory requirements
• Remain hands-on in architecture and code, mentor engineers and foster engineering excellence

Conocimientos

Snowflake

Airflow

Kafka

Python

SQL

Java

Terraform

Git

CI/CD

Kubernetes

OpenShift

AI tools

English

Educación

Relevant degree

Herramientas

OpenShift

Kubernetes

Terraform

Git

CI/CD tooling

Airflow

Descripción del empleo

DWS Group is seeking a Lead Engineer – Data Platform in Madrid to architect and evolve enterprise data platform capabilities across hybrid cloud and on-prem environments. You will lead a small, high-impact team, set technical direction and mentor engineers, while contributing to architecture and code.

Ideal candidates have 12+ years in data/platform engineering, deep Snowflake, Airflow and Kafka expertise, and strong Python/SQL skills.