Senior Databricks Data Engineer PySpark Delta Lake Remote

Career Choices Dewis Gyrfa Ltd

City Of London

On-site

GBP 70,000 - 110,000

Full time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Sponsorship may be available

Job summary

7Dxperts in the UK is seeking a Senior Data Engineer to design and optimize scalable data pipelines using Databricks, PySpark, Python and SQL, gaining hands-on experience with Delta Lake and lakehouse architectures.

You will build ETL/ELT workflows, monitor performance, mentor juniors and contribute to cloud data platforms across AWS, Azure or GCP, with a focus on reliability, quality data and impactful solutions.

Qualifications

5+ years’ Data Engineering experience.
Strong hands-on Databricks, PySpark, Python and SQL skills.
Experience building and optimisation of ETL/ELT data pipelines.
Knowledge of Delta Lake and data warehousing.
Experience with AWS, Azure or GCP.

Responsibilities

Build scalable pipelines using Databricks, Spark and PySpark.
Develop ETL/ELT and data transformation workflows using Python and SQL. Create and maintain Databricks notebooks, jobs, workflows and clusters.
Work with Delta Lake and lakehouse architectures.
Monitor, troubleshoot and optimise pipeline performance.
Maintain high standards of data quality and reliability.
Automate processes and create reusable engineering solutions.
Support and mentor junior Data Engineers.