Databricks Data Engineer: Lakehouse Pipelines (Antwerp)

Vivid Resourcing; Antwerpen; Sur place; EUR 37 000 - 61 000; Plein temps

Avantages offerts par ce poste

Car preferred

Résumé du poste

Vivid Resourcing in Antwerp is seeking a hands-on Databricks Data Engineer to join our analytics team. You will design and build scalable ETL/ELT pipelines on Databricks and Azure/GCP cloud platforms, using Python, PySpark and SQL to deliver analytics-ready datasets.

You'll collaborate with data scientists and analysts, implement data governance and performance best practices, and help optimize workloads for cost efficiency on modern data platforms.

Qualifications

• Strong experience with Databricks and Apache Spark.
• Strong Python/PySpark and SQL skills.
• Proven experience building and maintaining ETL/ELT pipelines at scale.
• Hands-on experience with Delta Lake and Lakehouse architecture.
• Experience working with Azure and/or GCP cloud environments.
• Good understanding of data warehousing, data modelling, and modern data engineering practices.
• Experience with orchestration, CI/CD, and automated data pipelines.
• A solid understanding of data quality, security, and governance.
• A curious, problem‑solving mindset and appetite to work broadly across the modern data landscape.

Responsabilités

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks and other Azure stack
• Develop robust data ingestion and transformation workflows across structured and unstructured data
• Write clean, efficient Python, PySpark, and SQL for large-scale data processing
• Build and maintain data models and reliable, analytics-ready datasets
• Work with Databricks Lakehouse, Delta Lake, and modern data architecture patterns
• Integrate data from multiple sources across cloud and enterprise environments
• Implement data quality, monitoring, governance, and performance best practices
• Collaborate with data scientists, analysts, and product teams to translate business requirements into scalable data solutions
• Optimize workloads for performance, reliability, and cloud cost efficiency

Connaissances

Databricks & Spark

Python / PySpark / SQL

ETL / ELT pipelines

Delta Lake / Lakehouse

Azure / GCP

Data warehousing & modelling

orchestration / CI/CD

Data quality & governance

Curious problem-solving

Outils

Delta Lake

Lakehouse

Azure Databricks

dbt

Airflow

Terraform

Kubernetes

BigQuery

Data Factory

Data Lake Storage

Description du poste

Vivid Resourcing in Antwerp is seeking a hands-on Databricks Data Engineer to join our analytics team. You will design and build scalable ETL/ELT pipelines on Databricks and Azure/GCP cloud platforms, using Python, PySpark and SQL to deliver analytics-ready datasets.

You'll collaborate with data scientists and analysts, implement data governance and performance best practices, and help optimize workloads for cost efficiency on modern data platforms.