Databricks Data Engineer

Vivid Resourcing; Antwerpen; On-site; EUR 37,000 - 61,000; Full time

Benefits offered by this job

Car preferred

Job summary

Vivid Resourcing in Antwerp is seeking a hands-on Databricks Data Engineer to join our analytics team. You will design and build scalable ETL/ELT pipelines on Databricks and Azure/GCP cloud platforms, using Python, PySpark and SQL to deliver analytics-ready datasets.

You'll collaborate with data scientists and analysts, implement data governance and performance best practices, and help optimize workloads for cost efficiency on modern data platforms.

Qualifications

• Strong experience with Databricks and Apache Spark.
• Strong Python/PySpark and SQL skills.
• Proven experience building and maintaining ETL/ELT pipelines at scale.
• Hands-on experience with Delta Lake and Lakehouse architecture.
• Experience working with Azure and/or GCP cloud environments.
• Good understanding of data warehousing, data modelling, and modern data engineering practices.
• Experience with orchestration, CI/CD, and automated data pipelines.
• A solid understanding of data quality, security, and governance.
• A curious, problem‑solving mindset and appetite to work broadly across the modern data landscape.

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks and other Azure stack
• Develop robust data ingestion and transformation workflows across structured and unstructured data
• Write clean, efficient Python, PySpark, and SQL for large-scale data processing
• Build and maintain data models and reliable, analytics-ready datasets
• Work with Databricks Lakehouse, Delta Lake, and modern data architecture patterns
• Integrate data from multiple sources across cloud and enterprise environments
• Implement data quality, monitoring, governance, and performance best practices
• Collaborate with data scientists, analysts, and product teams to translate business requirements into scalable data solutions
• Optimize workloads for performance, reliability, and cloud cost efficiency

Skills

Databricks & Spark

Python / PySpark / SQL

ETL / ELT pipelines

Delta Lake / Lakehouse

Azure / GCP

Data warehousing & modelling

orchestration / CI/CD

Data quality & governance

Curious problem-solving

Tools

Delta Lake

Lakehouse

Azure Databricks

dbt

Airflow

Terraform

Kubernetes

BigQuery

Data Factory

Data Lake Storage

Job description

Build the data platforms powering next-generation analytics and AI.

We're looking for a hands-on Databricks Data Engineer to join our team in Antwerp. If you enjoy building scalable data pipelines, working with Python and SQL, and want to play a key role in designing modern data platforms on Databricks and cloud infrastructure, this is your role.

What you'll do

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks and other Azure stack
• Develop robust data ingestion and transformation workflows across structured and unstructured data
• Write clean, efficient Python, PySpark, and SQL for large-scale data processing
• Build and maintain data models and reliable, analytics-ready datasets
• Work with Databricks Lakehouse, Delta Lake, and modern data architecture patterns
• Integrate data from multiple sources across cloud and enterprise environments
• Implement data quality, monitoring, governance, and performance best practices
• Collaborate with data scientists, analysts, and product teams to translate business requirements into scalable data solutions
• Optimize workloads for performance, reliability, and cloud cost efficiency

What you bring

• Strong experience with Databricks and Apache Spark
• Strong Python/PySpark and SQL skills
• Proven experience building and maintaining ETL/ELT pipelines at scale
• Hands‑on experience with Delta Lake and Lakehouse architecture
• Experience working with Azure and/or GCP cloud environments
• Good understanding of data warehousing, data modelling, and modern data engineering practices
• Experience with orchestration, CI/CD, and automated data pipelines
• A solid understanding of data quality, security, and governance
• A curious, problem‑solving mindset and appetite to work broadly across the modern data landscape

Nice to have

• Experience with Azure Databricks
• Databricks certifications
• Experience with Delta Live Tables / Lakeflow
• Knowledge of dbt, Airflow, Terraform, or Kubernetes
• Experience with Azure Data Factory, Data Lake Storage, or GCP BigQuery
• Exposure to MLOps, AI/ML workloads, or LLM-related data pipelines

What's in it for you

• Up to €5,500 gross/month, direct payroll position
• Based in Antwerp
• Work on modern Databricks and cloud data platforms
• Genuine ownership over data architecture and technical decisions
• Opportunity to work closely with AI, analytics, and data science teams
• Full package - car preferred