DataBricks Data Engineer DPP

Ports North; City Of London; Hybrid; GBP 70,000 - 90,000; Part time

Job summary

A leading technology firm in London is seeking a Senior Databricks Data Engineer to design and build scalable data platforms. The role involves developing data pipelines and delivering high-performance analytics solutions in a hybrid work environment. Strong experience with Databricks, Python, and cloud platforms is essential. The position is contracted for 6 months with potential for extension.

Qualifications

• Strong hands-on experience with Databricks, Python, SQL, and PySpark.
• Solid understanding of Delta Lake, Unity Catalog, and MLflow.
• Experience with DevOps tools (Git, CI/CD, IaC).

Responsibilities

• Develop and optimise data pipelines and lakehouse solutions using Databricks.
• Work across AWS, Azure, or GCP environments.
• Implement best practices in data engineering, CI/CD, and testing.
• Collaborate with partner and client teams on solution design and delivery.
• Mentor junior engineers and contribute to reusable frameworks and accelerators.

Skills

Databricks

Python

SQL

PySpark

DevOps tools

Education

Databricks certification

Job description

Senior Databricks Data Engineer (DPP)
London Based (Hybrid)
6 months initial contract + ext
Outside IR35

We're looking for a Senior Databricks Data Engineer who has DPP Status (Databricks Partner Program). You'll design and build scalable data platforms, develop pipelines, and help deliver high-performance analytics solutions across cloud environments.

Key Responsibilities

• Develop and optimise data pipelines and lakehouse solutions using Databricks.

• Work across AWS, Azure, or GCP environments.

• Implement best practices in data engineering, CI/CD, and testing.

• Collaborate with partner and client teams on solution design and delivery.

• Mentor junior engineers and contribute to reusable frameworks and accelerators.

Skills & Experience

• Strong hands-on experience with Databricks, Python, SQL, and PySpark.

• Solid understanding of Delta Lake, Unity Catalog, and MLflow.

• Experience with DevOps tools (Git, CI/CD, IaC).

• Excellent communication and stakeholder skills.

• Databricks certification and partner or consulting experience are a plus

About Korn Ferry

Korn Ferry unleashes potential in people, teams, and organizations. We work with our clients to design optimal organization structures, roles, and responsibilities. We help them hire the right people and advise them on how to reward and motivate their workforce while developing professionals as they navigate and advance their careers. To learn more, please visit Korn Ferry at www.Kornferry.com