data engineer data platform transformation

Enfint; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Job summary

Enfint is undergoing a major data platform transformation centered around Databricks. You will design scalable pipelines, develop production-grade workloads, and work with Delta Lake in a Lakehouse architecture to migrate and optimise large-scale data workloads.

The role requires strong PySpark, Python and SQL skills, plus significant experience with cloud platforms (Azure/AWS/GCP) and building robust ETL/ELT processes. This is a six-month freelance contract based in Amsterdam.

Qualifications

• 5+ years of experience in Data Engineering.
• Strong hands-on Databricks experience.
• Excellent PySpark, Python and SQL skills.
• Strong understanding of Delta Lake and Lakehouse architecture.
• Experience building and optimising production data pipelines.
• Experience working with Azure, AWS or GCP.
• Experience working within large-scale data environments.
• Ability to operate independently and hit the ground running.

Responsibilities

• Design and build scalable data pipelines within Databricks.
• Develop production-grade workloads using PySpark, Python and SQL.
• Work with Delta Lake and Lakehouse architecture.
• Migrate existing workloads into Databricks.
• Optimize Spark workloads and pipeline performance.
• Build reliable ETL/ELT processes across large datasets.
• Collaborate with Data Scientists, Analytics Engineers and Cloud Engineers.
• Implement data quality, testing and monitoring.
• Contribute to the wider architecture and technical direction.

Skills

Databricks

PySpark

Python

SQL

Delta Lake

Lakehouse

Data pipelines

Production workloads

Tools

Databricks

Delta Lake

Azure

AWS

GCP

Job description

Описание

The company is a European technology company undergoing a major data platform transformation. Its data platform is being built and modernised with Databricks at the centre of the architecture.

Задачи

• Design and build scalable data pipelines within Databricks
• Develop production-grade workloads using PySpark, Python and SQL
• Work extensively with Delta Lake and Lakehouse architecture
• Support the migration of existing workloads into Databricks
• Optimise Spark workloads and improve pipeline performance
• Build reliable ETL/ELT processes across large datasets
• Work with Data Scientists, Analytics Engineers and Cloud Engineers
• Implement data quality, testing and monitoring
• Contribute to the wider architecture and technical direction of the platform

Требования

• 5+ Years of experience in Data Engineering
• Strong hands-on Databricks experience
• Excellent PySpark, Python and SQL skills
• Strong understanding of Delta Lake and Lakehouse architecture
• Experience building and optimising production data pipelines
• Experience working with Azure, AWS or GCP
• Experience working within large-scale data environments
• Ability to operate independently and hit the ground running

Условия

Initial 6-month freelance contract.