Databricks Data Engineer

Vivid Resourcing Ltd; Antwerpen; In loco; EUR 56.000 - 67.000; Tempo pieno

Vantaggi offerti da questo lavoro

Car preferred

Descrizione del lavoro

Vivid Resourcing Ltd is seeking a hands-on Databricks Data Engineer to join our Antwerp-based team. You will design and build scalable data pipelines on Databricks and Azure, empowering next-generation analytics and AI initiatives.

You will work with Python, PySpark, and SQL to ingest, transform, and model data, while collaborating with data scientists and analysts to translate business needs into robust data solutions.

Competenze

• Strong experience with Databricks and Apache Spark.
• Strong Python/PySpark and SQL skills.
• Proven experience building and maintaining ETL/ELT pipelines at scale.
• Hands-on experience with Delta Lake and Lakehouse architecture.
• Experience working with Azure and/or GCP cloud environments.
• Good understanding of data warehousing, data modelling, and modern data engineering practices.
• Experience with orchestration, CI/CD, and automated data pipelines.
• A solid understanding of data quality, security, and governance.
• Dutch language skills preferred; English required.

Mansioni

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks and Azure stack.
• Develop data ingestion and transformation workflows across structured and unstructured data.
• Write Python, PySpark, and SQL for large-scale data processing.
• Build and maintain data models and analytics-ready datasets.
• Work with Databricks Lakehouse, Delta Lake, and modern data architecture patterns.
• Integrate data from multiple sources across cloud and enterprise environments.
• Implement data quality, monitoring, governance, and performance best practices.
• Collaborate with data scientists, analysts, and product teams to translate business requirements into scalable data solutions.
• Optimize workloads for performance, reliability, and cloud cost efficiency.

Conoscenze

Databricks & Spark

Python/PySpark

SQL

ETL/ELT pipelines

Delta Lake

Lakehouse

Azure/GCP

Data warehousing

Data modelling

Orchestration/CI-CD

Data quality & governance

Dutch language

English language

Strumenti

Azure Databricks

Delta Live Tables / Lakeflow

dbt

Airflow

Terraform

Kubernetes

Azure Data Factory

Data Lake Storage

GCP BigQuery

Descrizione del lavoro

Databricks Data Engineer

Antwerp, Belgium | Up to €5,500 gross/month | Full-time, Payroll Position

Build the data platforms powering next-generation analytics and AI.

We're looking for a hands-on Databricks Data Engineer to join our team in Antwerp. If you enjoy building scalable data pipelines, working with Python and SQL, and want to play a key role in designing modern data platforms on Databricks and cloud infrastructure, this is your role.

What you'll do

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks and other Azure stack
• Develop robust data ingestion and transformation workflows across structured and unstructured data
• Write clean, efficient Python, PySpark, and SQL for large-scale data processing
• Build and maintain data models and reliable, analytics-ready datasets
• Work with Databricks Lakehouse, Delta Lake, and modern data architecture patterns
• Integrate data from multiple sources across cloud and enterprise environments
• Implement data quality, monitoring, governance, and performance best practices
• Collaborate with data scientists, analysts, and product teams to translate business requirements into scalable data solutions
• Optimize workloads for performance, reliability, and cloud cost efficiency

What you bring

• Strong experience with Databricks and Apache Spark
• Strong Python/PySpark and SQL skills
• Proven experience building and maintaining ETL/ELT pipelines at scale
• Hands-on experience with Delta Lake and Lakehouse architecture
• Experience working with Azure and/or GCP cloud environments
• Good understanding of data warehousing, data modelling, and modern data engineering practices
• Experience with orchestration, CI/CD, and automated data pipelines
• A solid understanding of data quality, security, and governance
• Dutch language skills preferred; English required
• A curious, problem-solving mindset and appetite to work broadly across the modern data landscape

Nice to have

• Experience with Azure Databricks
• Databricks certifications
• Experience with Delta Live Tables / Lakeflow
• Knowledge of dbt, Airflow, Terraform, or Kubernetes
• Experience with Azure Data Factory, Data Lake Storage, or GCP BigQuery
• Exposure to MLOps, AI/ML workloads, or LLM-related data pipelines

What's in it for you

• Up to €5,500 gross/month, direct payroll position
• Based in Antwerp
• Work on modern Databricks and cloud data platforms
• Genuine ownership over data architecture and technical decisions
• Opportunity to work closely with AI, analytics, and data science teams
• Full package - car preferred