(Senior) Data Engineer - Data Platform (m/f/d)

Unzer Group; Berlin; Vor Ort; EUR 85.000 - 115.000; Vollzeit

Benefits dieser Stelle

Remote work up to 60%

Mobility support

Counselling services

Pension scheme

EU workation 15 days

Flexible working hours

Learning budget €1000

Annual company events

Zusammenfassung

Unzer Group is seeking an experienced Data Engineer to own end-to-end data pipelines across orchestration, transformation, lake ingestion, and cloud infrastructure. You will build and maintain Apache Airflow workflows, develop dbt models in a modern warehouse, and coordinate model parameters with orchestration.

The role requires strong SQL, hands-on Redshift experience (or similar), and AWS proficiency. You will also manage containerized workloads with Docker, implement robust CI/CD pipelines,

Qualifikationen

• 5+ years of data engineering or related experience, with production-grade pipeline development primarily in Python.
• Excellent knowledge of SQL and data warehouse concepts, with hands-on experience in Redshift or similar for modeling, ingestion, performance optimisation, and data integrity.
• Hands-on experience with ELT/ETL flows using dbt and workflow orchestration with Apache Airflow, including DAG design, operators, and troubleshooting.
• Solid AWS experience across object storage, containers, managed ETL, serverless, data warehousing, replication (e.g. DMS), IAM, and analytics services such as Athena and Glue.
• Experience with Git, CI/CD, and Docker, and can maintain deployment pipelines and manage container image lifecycle.

Aufgaben

• Own data pipelines end to end: design, build, run, monitor, and troubleshoot across orchestration, transformation, lake ingestion, and cloud infrastructure.
• Build and maintain Apache Airflow workflows to schedule transformation jobs, ingestion tasks, and containerized workloads.
• Develop dbt models in Redshift (or similar), including incremental strategies, data quality tests, and CI validation, and coordinate model selection and run parameters with orchestration.
• Design and build lake-layer pipelines (bronze, silver, gold, or equivalent), including replication, ETL/ELT jobs, and operational workloads for event-driven and near real-time use cases.
• Implement workloads as containerized services or serverless functions, manage batch jobs, platform monitoring workflows, and container image lifecycle.
• Manage cloud infrastructure and configuration: compute clusters, object storage, IAM, the data warehouse, networking, parameter stores, secrets, and access and grant management.
• Maintain CI/CD pipelines (e.g., GitHub Actions) with secure cloud authentication, and own the flow from test to production.
• Investigate and resolve production incidents, including orchestration failures, transformation run issues, serverless errors, replication lag, performance bottlenecks, and data quality problems, using monitoring and alerting effectively.
• Follow the typical new source flow end to end: configure replication or ingestion, land the data in object storage, build the consumer or transformation layer, wire up the compute, orchestrate it, model it in the warehouse, and grant access.

Kenntnisse

Python

SQL

Airflow

dbt

AWS

Data warehousing

ETL/ELT

CI/CD

Git

Problem solving

Independence

Tools

Redshift

Docker

Terraform

Go

Kafka

GitHub Actions

Jobbeschreibung

ABOUT THE TEAM

The Data Team at Unzer is responsible for the end-to-end health and evolution of our data platform. We build and operate a multi-repository, distributed stack spanning orchestration, transformation, lake ingestion, and infrastructure configuration. Our processing patterns range from batch to near real-time, with a strong emphasis on availability, data quality, and operational robustness in a 24/7 production environment. We like having the freedom to pick the right tooling and approach for each use case, and our goal is to make data easy to access and understand across the company, so people can actually make decisions based on it.

What your work will look like

• Own data pipelines end to end: design, build, run, monitor, and troubleshoot across orchestration, transformation, lake ingestion, and cloud infrastructure.
• Build and maintain Apache Airflow workflows to schedule transformation jobs, ingestion tasks, and containerized workloads.
• Develop dbt models in Redshift (or a similar warehouse), including incremental strategies, data quality tests, and CI validation, and coordinate model selection and run parameters with orchestration.
• Design and build lake-layer pipelines (bronze, silver, gold, or your platform's equivalent), including replication, ETL/ELT jobs, and operational workloads for event-driven and near real-time use cases.
• Implement workloads as containerized services or serverless functions depending on what fits best, and manage batch jobs, platform monitoring workflows, and container image lifecycle.
• Manage cloud infrastructure and configuration: compute clusters, object storage, IAM, the data warehouse, networking, parameter stores, secrets, and access and grant management.
• Maintain CI/CD pipelines (for example, GitHub Actions) with secure cloud authentication, and own the flow from test to production.
• Investigate and resolve production incidents, including orchestration failures, transformation run issues, serverless errors, replication lag, performance bottlenecks, and data quality problems, using monitoring and alerting effectively.
• Follow the typical new source flow end to end: configure replication or ingestion, land the data in object storage, build the consumer or transformation layer, wire up the compute, orchestrate it, model it in the warehouse, and grant access.

What you need to be successful in this role

• You have 5+ years of data engineering or related experience, with production-grade pipeline development primarily in Python.
• You have excellent knowledge of SQL and a strong understanding of data warehouse concepts, with hands‑on experience in Redshift (or similar) for modeling, ingestion, performance optimisation, and data integrity.
• You have hands‑on experience with ELT/ETL flows using dbt and workflow orchestration with Apache Airflow, including DAG design, operators, and troubleshooting.
• You have solid AWS experience across object storage, containers, managed ETL, serverless, data warehousing, replication (for example, DMS), IAM, and related analytics services such as Athena and Glue.
• You have experience with Git, CI/CD, and Docker, and can maintain deployment pipelines and manage container image lifecycle.
• You have a proven ability to own projects from requirements gathering through production monitoring and incident response.
• You have a strong operational mindset and can troubleshoot systematically across a distributed, multi‑repository platform.
• You can work independently while also collaborating well with analytics and platform stakeholders.

Nice to have

• Infrastructure as Code (Terraform, CloudFormation).
• Event‑driven architecture (Kafka or similar).
• Additional languages used in ingestion or operational repos, such as Go.
• Financial services or payments data pipelines experience.
• Search or indexing experience, Avro, or schema registries.

Please note that we will not sponsor your visa or relocation, and you must have a valid work permit to be eligible for this position.

What’s next

• Does it sound exciting? - Apply with your CV in English. Please don’t shy away if you don’t meet all the requirements! We’re looking forward to meeting you.
• The interview process includes a 30‑minute call with the Talent Acquisition Manager, a take‑home assignment, an on‑site technical interview with the team, and a 45‑minute call with the Hiring Manager.

WHAT'S IN THERE FOR YOU

Work from home up to 60% of the time. We want you to keep your work‑life balance.

Mobility support, whether you choose Swapfiets, Jobrad, or a Deutschlandticket – we've got you covered.

Explore counselling assistance, be it for professional or personal matters, through our associated platform.

Pension scheme, we want to give back and help you secure your future.

15 days a year of workation from your desired destination within the EU.

Flexible working hours – helping you balance work and life.

Learning budget of 1000 euros per year – you can develop your passions with us.

Enjoy some fun moments with your coworkers – we throw a company party once a year and host several team events!

Unzer is an equal employment opportunities workplace, and we commit to hiring regardless of race, sex, gender identification, sexual orientation, national origin, native language, religion, age, disability, marital status, citizenship, genetic information, pregnancy, or any other characteristic protected by law. Please refrain from including your picture and age with the application.