Read more

Ecruit; Deutschland; Remote; EUR 82.000 - 105.000; Vollzeit

Zusammenfassung

7Dxperts is seeking a Senior Data Engineer - Databricks to join our UK team. You will build scalable data pipelines, leverage Databricks and Delta Lake, and collaborate with engineers, analysts and data scientists to deliver reliable data solutions.

You will mentor junior engineers, optimise ETL/ELT workflows, and work across AWS/Azure/GCP cloud environments. A CS or related technical background is required and strong hands-on Databricks expertise is essential.

Qualifikationen

• Minimum 5+ years of data engineering experience.
• Hands-on Databricks, PySpark, Python and SQL skills.
• Experience building and optimizing ETL/ELT data pipelines.
• Knowledge of Delta Lake and data warehousing.
• Experience with at least one cloud provider (AWS/Azure/GCP).

Aufgaben

• Build scalable pipelines using Databricks, Spark and PySpark.
• Develop ETL/ELT and data transformation workflows using Python and SQL.
• Create and maintain Databricks notebooks, jobs, workflows and clusters.
• Work with Delta Lake and lakehouse architectures.
• Monitor, troubleshoot and optimise pipeline performance.
• Maintain high standards of data quality and reliability.
• Automate processes and create reusable engineering solutions.
• Support and mentor junior Data Engineers.

Kenntnisse

Databricks

PySpark

Python

SQL

Delta Lake

AWS/Azure/GCP

CI/CD

Terraform

Mentoring

Ausbildung

Computer Science or related technical field

Tools

Unity Catalog

MLflow

Jobbeschreibung

Senior Data Engineer - Databricks | Competitive Salary | UK (Remote)

Are you an experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands-on experience with Databricks, PySpark, Python and SQL?

The role

7Dxperts is looking for a Senior Data Engineer - Databricks to join our UK team.

You’ll build and improve data pipelines that solve real business problems, working with modern Databricks and cloud technologies. Alongside hands‑on development, you’ll troubleshoot issues, improve performance and work closely with engineers, analysts, data scientists and technical leads.

Key Responsibilities

You will:

• Build scalable pipelines using Databricks, Spark and PySpark.
• Develop ETL/ELT and data transformation workflows using Python and SQL.
• Create and maintain Databricks notebooks, jobs, workflows and clusters.
• Work with Delta Lake and lakehouse architectures.
• Monitor, troubleshoot and optimise pipeline performance.
• Maintain high standards of data quality and reliability.
• Automate processes and create reusable engineering solutions.
• Support and mentor junior Data Engineers.

The person

• 5+ years’ Data Engineering experience.
• Strong hands‑on Databricks, PySpark, Python and SQL skills.
• Experience building and optimising ETL/ELT data pipelines.
• Knowledge of Delta Lake and data warehousing.
• Experience with at least one of AWS, Azure or GCP.
• Strong troubleshooting and problem‑solving skills.
• A Computer Science or related technical background.
• Experience with Unity Catalog, MLflow, CI/CD, Terraform or Databricks certification would be a bonus.

About 7Dxperts

7Dxperts helps organisations solve complex challenges using Data, Spatial and Machine Learning technologies. We focus on building practical, targeted solutions that make a measurable difference.

What we offer

• Databricks training and upskilling.
• Support towards technical certifications.
• Exposure to AWS, Azure and GCP.
• Technical and leadership development.
• Sponsorship may be available depending on circumstances.