Data Engineer (Azure Databricks)

Koderia; Wien; Vor Ort; EUR 50.000 - 70.000; Vollzeit

Zusammenfassung

Koderia is seeking an experienced Data Engineer (Azure Databricks) to support a client in the transportation and logistics industry. The role focuses on data integration and quality processes within a centralized Lakehouse environment. Key responsibilities include implementing data flows, managing pipelines, and supporting Power BI models. Strong German language skills are mandatory. The position offers a full-time capacity with occasional on-site meetings, ideal for long-term collaboration based on performance.

Qualifikationen

• Strong hands-on experience with Databricks and PySpark.
• Experience with Power BI and DAX for data models and reports.
• Proven data modeling and architecture design skills.
• Deep understanding of data quality implementation.
• Familiarity with modern data platform architectures.
• Experience with implementing data integration interfaces.
• Proficient use of JIRA for backlog management.

Aufgaben

• Implement data integrations based on specifications.
• Perform data profiling and quality rule implementation.
• Manage data flows according to design.
• Provide data services via defined interfaces.
• Handle deployment and release management of pipelines.
• Prepare operations and ensure stability.
• Implement technical data quality checks.
• Support integration of Power BI models and reports.

Kenntnisse

Databricks

PySpark

Power BI

DAX

Data modeling

Agile methodologies

JIRA

Tools

Azure DevOps

Terraform

DQX Framework

Lakehouse architecture

Jobbeschreibung

We are looking for an experienced Data Engineer (Azure Databricks) to support a client in the transportation & logistics industry, focusing on the technical implementation and stable operation of data integration and data quality processes within a centralized Lakehouse environment. Active German language skills are mandatory for this role.

Key Responsibilities

• Implement data integrations based on defined interface specifications.
• Perform data profiling and implement data quality rules (based on DQX/DBX frameworks).
• Enable and manage data flows from source systems according to data product design.
• Provide data services via interfaces aligned with the defined data architecture.
• Handle versioning, deployment, and release management of data pipelines.
• Prepare operations and ensure stability of production environments.
• Implement additional technical data quality checks to support ongoing operations.
• Support integration and development of Power BI data models, reports, and dashboards.

Requirements

• Strong hands-on experience with Databricks (especially within the Azure ecosystem) and PySpark.
• Experience with Power BI (reports, dashboards, semantic models, DAX, data modeling interfaces).
• Proven experience in data modeling and data architecture design.
• Deep understanding of data quality implementation ( DQX framework preferred).
• Knowledge of modern data platform architectures ( Lakehouse, Data Mesh, APIs).
• Experience in implementing data integration interfaces.
• Familiarity with agile methodologies (Scrum, Kanban, or hybrid approaches).
• Proficient use of JIRA for backlog management and task tracking.
• Tech stack (must-have): Azure Databricks (advanced), PySpark, Azure DevOps (with future transition to GitHub), Terraform (Infrastructure as Code), Power BI (data provisioning, modeling interfaces, semantic models, DAX), DQX Framework, Lakehouse architecture, JIRA.

Capacity

Full-time (100%).

Duration

Short-term (2–3 months) with strong potential for extension.

Location

Mostly remote, with occasional on-site presence required for key meetings.

Language

German (mandatory).

Opportunity to work in a large-scale data environment across multiple teams, with potential for long-term collaboration based on performance.