Databricks Data Engineer — Build Modern Cloud Platform

Vivid Resourcing Ltd; Antwerpen; Presencial; EUR 56.000 - 67.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Car preferred

Descripción de la vacante

Vivid Resourcing Ltd is seeking a hands-on Databricks Data Engineer to join our Antwerp-based team. You will design and build scalable data pipelines on Databricks and Azure, empowering next-generation analytics and AI initiatives.

You will work with Python, PySpark, and SQL to ingest, transform, and model data, while collaborating with data scientists and analysts to translate business needs into robust data solutions.

Formación

• Strong experience with Databricks and Apache Spark.
• Strong Python/PySpark and SQL skills.
• Proven experience building and maintaining ETL/ELT pipelines at scale.
• Hands-on experience with Delta Lake and Lakehouse architecture.
• Experience working with Azure and/or GCP cloud environments.
• Good understanding of data warehousing, data modelling, and modern data engineering practices.
• Experience with orchestration, CI/CD, and automated data pipelines.
• A solid understanding of data quality, security, and governance.
• Dutch language skills preferred; English required.

Responsabilidades

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks and Azure stack.
• Develop data ingestion and transformation workflows across structured and unstructured data.
• Write Python, PySpark, and SQL for large-scale data processing.
• Build and maintain data models and analytics-ready datasets.
• Work with Databricks Lakehouse, Delta Lake, and modern data architecture patterns.
• Integrate data from multiple sources across cloud and enterprise environments.
• Implement data quality, monitoring, governance, and performance best practices.
• Collaborate with data scientists, analysts, and product teams to translate business requirements into scalable data solutions.
• Optimize workloads for performance, reliability, and cloud cost efficiency.

Conocimientos

Databricks & Spark

Python/PySpark

SQL

ETL/ELT pipelines

Delta Lake

Lakehouse

Azure/GCP

Data warehousing

Data modelling

Orchestration/CI-CD

Data quality & governance

Dutch language

English language

Herramientas

Azure Databricks

Delta Live Tables / Lakeflow

dbt

Airflow

Terraform

Kubernetes

Azure Data Factory

Data Lake Storage

GCP BigQuery

Descripción del empleo

Vivid Resourcing Ltd is seeking a hands-on Databricks Data Engineer to join our Antwerp-based team. You will design and build scalable data pipelines on Databricks and Azure, empowering next-generation analytics and AI initiatives.

You will work with Python, PySpark, and SQL to ingest, transform, and model data, while collaborating with data scientists and analysts to translate business needs into robust data solutions.