Senior Data Architect / Senior Data Engineer – Azure Databricks

Consult; Zürich; Hybrid; CHF 124.000 - 193.000; Teilzeit

Zusammenfassung

Consult is seeking a senior data engineer to join a platform team building a new Azure Databricks-based analytics platform for a Swiss media company. You will implement Jira tickets, design and run data pipelines, and maintain infra-as-code with Pulumi, deploying changes through GitHub Actions.

You will advise on architecture, data modelling, and platform costs, with room to grow responsibilities. English is the working language; German is a plus.

Qualifikationen

• Multiple years of hands-on data engineering on Databricks, building and running production pipelines.
• Architecture experience on a Databricks or Azure data platform.
• Experience with streaming or event ingestion (Azure Event Hubs or Kafka).
• Data modelling for analytics and BI.
• Infrastructure as code, preferably Pulumi (Terraform ok).
• Git, GitHub workflows and CI/CD with GitHub Actions.

Aufgaben

• Join the platform team and implement Jira tickets.
• Build and run pipelines from event data through bronze, silver, to gold layers.
• Keep Databricks and Azure infra in code via Pulumi; ship changes via GitHub Actions.

Kenntnisse

Databricks

Spark

PySpark

GitHub Actions

CI/CD

Pipelines

Infrastructure as code

Pulumi

Azure Event Hubs

Data modeling

Team collaboration

Tools

Pulumi

Git

Terraform

GitHub

Jobbeschreibung

Freelance · Remote, occasionally Zurich · 80–100% · Start as soon as possible · Currently planned until end of 2027

About the project

Our client, a large Swiss media company, is building a new platform on Azure Databricks for the usage data of its apps and websites. It will replace the commercial analytics tool they use today. Analysts are starting to work on the new platform now.

Your role

You join the platform team of five developers through Xebia. Most of your time goes into implementing Jira tickets. You build and run the pipelines that take event data from Azure Event Hubs through the bronze, silver and gold layers into the tables analysts and dashboards use. You keep the Databricks and Azure infrastructure in code with Pulumi and ship changes through GitHub Actions. The team creates and refines tickets together and reviews each other's code. You'll also help analysts get started with Databricks and GitHub.

As the senior person in the team, you can advise on anything from implementation details to the overall architecture, while the product owner sets the priorities. Today the role also covers the data model, the infrastructure and the platform costs, and there is room to take on more responsibility over time. The team uses AI coding assistants such as Claude in its daily work.

Must-have

• Several years of hands-on data engineering on Databricks: building and running production pipelines with Spark, PySpark or SQL and Delta Lake, in a medallion architecture
• Architecture experience on a Databricks or Azure data platform
• Streaming or event ingestion, ideally Azure Event Hubs or Kafka
• Data modelling for analytics and BI
• Infrastructure as code, ideally Pulumi (Terraform experience transfers)
• Git, GitHub workflows and CI/CD with GitHub Actions
• Experience in larger projects
• You work well in a team and get productive with little onboarding
• Comfortable using AI coding assistantsFluent English

Nice-to-have

• Unity Catalog, Databricks Asset Bundles, data quality frameworks
• Dashboards in Databricks or Power BI
• Azure experience beyond Databricks
• Web and app usage tracking or digital analytics, including tracking migrations
• Media or broadcasting experience
• German

Details

The current engineer can hand over until the end of January. English is the working language; German is a plus.

We look forward to meeting you!