Senior Data Engineer

rhe; Deutschland; Vor Ort; EUR 70.000 - 110.000; Vollzeit

Zusammenfassung

Rhenus Overland Transport is seeking a skilled Data Platform Engineer to design and operate modern data solutions on Azure. The role emphasizes end-to-end data pipelines, multi-tenant governance, and cost-aware infrastructure practices.

You will work with PySpark-based ETL/ELT pipelines, leverage Databricks, and collaborate with BI teams to optimize data models and reporting solutions. Fluency in English is required, German is a plus, and the position supports remote EU work.

Qualifikationen

• Hands-on experience with Azure data services.
• Strong SQL and data modeling fundamentals.
• Experience building ETL/ELT pipelines.

Aufgaben

• Design, build, and operate end-to-end data solutions on Azure.
• Develop and maintain scalable ETL/ELT pipelines using PySpark.
• Support multi-tenant data platforms across environments.
• Provision and maintain Azure data infrastructure.
• Build and maintain CI/CD pipelines for data workloads.
• Apply Azure best practices for performance and cost.
• Collaborate with BI and data teams.
• Support data governance basics.

Kenntnisse

Azure Data Platform

PySpark & Spark

ETL/ELT concepts

CI/CD for data

SQL queries

Parquet/Avro

Azure infrastructure

Analytical mindset

English proficiency

German language (advantage)

Tools

Databricks

Azure Data Factory

Azure Synapse

Jobbeschreibung

What You Can Expect :

About the Role:

• Develop a Modern Azure Data Platform: Design, build, and operate end-to-end data solutions using Azure Data Factory, Azure Data Lake Storage Gen2, Databricks, and Azure Synapse Analytics.
• Create Data Pipelines: Develop and maintain scalable ETL/ELT pipelines using PySpark and Spark, with a strong focus on data quality, reliability, and performance.
• Multi-Tenant & Environment Support: Support and operate multi-tenant data platforms across multiple environments (development, test, production) with clear separation and governance.
• Infrastructure & Platform Operations: Provision, configure, and maintain Azure data infrastructure, ensuring stability, security, and scalability.
• CI/CD for Data Platforms: Build and maintain CI/CD pipelines for data pipelines and Databricks workloads, enabling automated deployments across environments.
• Cost-Efficient & Best-Practice Azure Usage: Apply Azure best practices to optimize performance and cost, including resource sizing, lifecycle management, and cost monitoring.
• Collaboration with BI & Data Teams: Work closely with BI and data teams to support efficient data models and reporting solutions.
• Data Governance & Security Basics: Support data governance requirements such as access control, secure data handling, and basic metadata management.

What You Bring:

• Azure Data Platform Experience: Several years of hands-on experience with Azure Data Factory, ADLS Gen2, Databricks, and Azure Synapse Analytics.
• PySpark & Spark: Strong experience building distributed data processing pipelines using PySpark and Spark.
• ETL / ELT Knowledge: Solid understanding of ETL/ELT concepts and data modeling practices.
• CI/CD & Automation: Experience with CI/CD pipelines for data workloads and basic automation of deployments.
• SQL Skills: Strong SQL skills and experience optimizing analytical queries.
• Data Formats: Practical experience with Parquet and/or Avro.
• Infrastructure Awareness: Good understanding of Azure resource structure, environments, and operational best practices.
• Analytical & Team-Oriented Mindset: Solution-focused approach with the ability to work independently and collaboratively.
• Language Skills: Fluency in English is required; knowledge of German is an advantage.

Note :

This is a remote role in the European Union. Candidates need to be based in a country where Rhenus Overland Transport is already established.