Data Engineer (Databricks, Snowflake)

PROSTAFF Schweiz GmbH; Zürich; Vor Ort; CHF 120.000 - 180.000; Vollzeit

Zusammenfassung

PROSTAFF Schweiz GmbH is seeking an Advanced Data Engineer to build and maintain data pipelines and data products for clients in Zürich. You will work directly with clients to understand needs and turn diverse data sources into reliable datasets.

You will design, develop and monitor distributed data pipelines for batch and streaming workloads, integrating data and presenting reproducible datasets for data consumers.

Qualifikationen

• Degree in computer science, software engineering, data science or a comparable qualification.
• At least three years of experience in data engineering or software engineering.

Aufgaben

• Design, develop, test and monitor distributed data pipelines for batch and streaming workloads.
• Integrate structured and unstructured data and produce reproducible datasets that meet the needs of data consumers.
• Advise clients on technical options and explain design decisions to technical and business stakeholders.
• Work with architects, software engineers and data scientists to deliver data products iteratively.

Kenntnisse

Python

SQL

Data pipelines

Data engineering

Data lakes/lakehouses

Databricks

Snowflake

Kubernetes

Airflow

Kafka

Terraform

Spark

Delta Lake

DevOps

Cloud platforms

Ausbildung

Degree in computer science / software engineering / data science

Tools

Databricks

Snowflake

Microsoft Fabric

Amazon SageMaker

Spark

Delta Lake

Airflow

Kafka

Kubernetes

Terraform

Jobbeschreibung

For one of our clients, we are looking for an Advanced Data Engineer to build and maintain data pipelines and data products. You will work directly with clients to understand their needs and turn diverse data sources into reliable, reusable datasets.

• Design, develop, test and monitor distributed data pipelines for batch and streaming workloads.
• Integrate structured and unstructured data and produce reproducible datasets that meet the needs of data consumers.
• Advise clients on technical options and explain design decisions to technical and business stakeholders.
• Work with architects, software engineers and data scientists to deliver data products iteratively.
• Degree in computer science, software engineering, data science or a comparable qualification.
• At least three years of experience in data engineering or software engineering.
• Practical Python and SQL skills and hands-on experience with relational and non-relational databases.
• Experience building and maintaining data products, with knowledge of architectures such as data lakes, lakehouses and medallion architectures.
• Experience with cloud data platforms such as Databricks, Snowflake, Microsoft Fabric or Amazon SageMaker.
• Familiarity with large-scale data processing, data analysis and visualisation, as well as agile development and DevOps.
• Hands-on experience with or interest in technologies such as Spark, Delta Lake, Airflow, Kafka, Kubernetes or Terraform.
• Fluent German and English.