Lead Engineer– Data Platform

DWS Group; Madrid; Presencial; EUR 110 000 - 140 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Hybrid working model

Benefits package

Healthcare & retirement plan

Resumo da oferta

DWS Group in Madrid is seeking a Lead Engineer – Data Platform to design, build and evolve our hybrid data platform. You will guide a small high-impact team, set technical direction, mentor engineers and contribute to architecture and code.

The role requires deep Snowflake, Airflow and Kafka expertise, plus strong Python/SQL, and experience with Terraform, Git and CI/CD. A relevant degree is advantageous and English fluency is essential.

Qualificações

• 12+ years of experience in data or platform engineering, incl. enterprise-scale data platforms.
• Deep hands-on Snowflake expertise across architecture, ingestion, transformation, and governance.
• Strong production experience with Apache Airflow (DAG patterns, scheduling, testing, monitoring).
• Strong expertise in Apache Kafka, including topic design, producers/consumers, schema management, and replay strategies.
• Proven ability to integrate batch and streaming pipelines across Snowflake, Airflow and Kafka.
• Advanced Python and SQL; Java experience beneficial for Kafka-based services.

Responsabilidades

• Own end-to-end architecture and evolution of enterprise data platform capabilities across hybrid cloud and on-prem environments.
• Define technical roadmap, standards and reusable patterns for orchestration, scheduling and data processing.
• Lead architectural decisions, proofs of concept and adoption plans focusing on scalability, security, operability and TCO.
• Establish reliability, observability and operational standards for data platform components including monitoring and SLAs.
• Drive platform automation via infrastructure as code, CI/CD and self-service engineering capabilities.
• Partner with architecture, security and governance teams to ensure regulatory compliance.
• Remain hands-on in architecture and code, mentor engineers and lead code reviews.

Conhecimentos

Snowflake

Apache Airflow

Apache Kafka

Python

SQL

Terraform

Git

CI/CD

Kubernetes

Security & governance

Leadership

English communication

Formação académica

Relevant degree

Ferramentas

OpenShift

Kubernetes

Java

Descrição da oferta de emprego

Job Description:

Employer: DWS Group

Title: Lead Engineer – Data Platform

Location: Madrid

About DWS:

Today, markets face a whole new set of pressures – but also a whole lot of opportunity too. Opportunity to innovate differently. Opportunity to invest responsibly. And opportunity to make change.

Join us at DWS, and you can be part of an industry-leading firm with a global presence. You can lead ambitious opportunities and shape the future of investing. You can support our clients, local communities, and the environment.

We’re looking for creative thinkers and innovators to join us as the world continues to transform. As whole markets change, one thing remains clear; our people always work together to capture the opportunities of tomorrow.

As investors on behalf of our clients, it is our role to find investment solutions. Ensuring the best possible foundation for our clients’ financial future. And in return, we’ll give you the support and platform to develop new skills, make an impact and work alongside some of the industry’s greatest thought leaders. This is your chance to achieve your goals and lead an extraordinary career.

This is your chance to invest in your future.

Read more about DWS and who we are here.

Team / division overview

DWS’s data infrastructure team provides the secure, scalable and trustworthy foundation for storing, processing and distributing critical enterprise data. As Lead Engineer - Data Platform, you drive the design, built, and continuous improvement of our hybrid data platform. You’ll lead a small but high-impact team, setting technical direction, mentoring team members and contributing directly to architecture and code.

Your responsibilities –

As our Lead Engineer – Data Platform, you will:

• Own the end-to-end architecture, design and evolution of enterprise data platform capabilities across hybrid cloud and on-premises environments
• Define the technical roadmap, engineering standards and reusable patterns for workflow orchestration, scheduling, dependency management and data processing
• Lead architectural decisions, proofs of concept and adoption plans based on scalability, interoperability, security, operability and total cost of ownership
• Establish reliability, observability and operational standards for data platform components, including monitoring, alerting, failure recovery, capacity management and service-level objectives
• Drive platform automation through infrastructure as code, CI/CD, automated testing and self-service engineering capabilities
• Partner with architecture, security, governance and application teams to ensure platform solutions meet enterprise standards and regulatory requirements
• Remain hands-on in architecture and code, lead design and code reviews, mentor engineers and foster a culture of engineering excellence and continuous improvement

We are looking for

• 12+ years of experience in data or platform engineering, including designing and operating enterprise-scale data platforms; a relevant degree is advantageous
• Deep hands-on Snowflake expertise across architecture, ingestion, transformation, workload management, performance, cost optimisation, secure data sharing and governance
• Strong production experience with Apache Airflow, including reusable DAG patterns, dependency management, scheduling, testing, monitoring and failure recovery
• Strong expertise in Apache Kafka and event-driven architectures, including topic design, producers and consumers, schema management, Kafka Connect, delivery semantics and replay strategies
• Proven ability to integrate batch and streaming pipelines across Snowflake, Airflow and Kafka
• Advanced Python and SQL skills; Java experience for Kafka-based services and connectors is beneficial
• Strong experience with Terraform, Git, CI/CD and automated testing; OpenShift or Kubernetes experience is desirable
• Strong understanding of reliability, observability, data quality, security, access management and compliance in regulated environments
• Proven technical leadership, including setting engineering direction, reviewing designs and code, mentoring engineers and communicating with technical and business stakeholders
• Strong problem-solving and strategic-thinking skills, with fluent written and spoken English
• Proven ability to leverage AI tools to enhance productivity, optimise workflows to solve business problems, while applying critical judgment to ensure responsible and ethical use of data and AI outputs

What we’ll offer you:

At DWS we’re serious about diversity, equity and creating an inclusive culture where colleagues can be themselves sand it’s important to us that you enjoy coming to work - feeling healthy, happy and rewarded. At DWS, you’ll have access to a range of benefits which you can choose from to create a personalised plan unique to your lifestyle. Whether you’re interested in healthcare, company perks, or are thinking about your retirement plan, there’s something for everyone.

DWS’ Hybrid Working model is designed to find the right balance between in-person collaboration and engagement in the office, which is core to our working culture, and working from home. Each business group varies on the split between time spent in the office and at home, but this will be discussed and made clear as part of your application and interview process. We will continue to review and evolve our working environments and methods to ensure that we are working in the best way possible for our people.

If you require any adjustments or changes to be made to the interview process for any reason including, or related to a disability or long‑term health condition, then please contact your recruiter and let them know what assistance you may need. Examples of adjustments include providing a change to the format of the interview, or providing assistance when at the DWS office. This will not affect your application and your recruitment team will discuss options with you

We at DWS are committed to creating a diverse and inclusive workplace, one that embraces dialogue and diverse views, and treats everyone fairly to drive a high-performance culture. The value we create for our clients and investors is based on our ability to bring together various perspectives from all over the world and from different backgrounds. It is our experience that teams perform better and deliver improved outcomes when they are able to incorporate a wide range of perspectives. We call this #ConnectingTheDots.