Data Engineer (Databricks, Python, Sql)

TN United Kingdom; London; Remote; GBP 50,000 - 80,000; Full time

Job summary

A leading software consultancy is seeking a Data Engineer with expertise in Databricks, Python, and SQL to join a project for a global reinsurer. The role involves developing data models, optimizing pipelines, and ensuring best practices in data governance. Strong communication skills are essential as you will work directly with clients to deliver high-quality solutions.

Qualifications

• 3 years experience with Databricks (Lakehouse, Delta Lake, PySpark, Spark SQL).
• 5 years strong SQL experience.
• Hands-on experience deploying Databricks pipelines using Terraform.

Responsibilities

• Develop and maintain dbt SQL models and macros.
• Collaborate with stakeholders to refine modelling requirements.
• Design ETL/ELT workflows and data pipelines.

Skills

Databricks

Python

SQL

Tools

Terraform

Azure Databricks

Job description

Social network you want to login/join with:

Client:

Toucanberry Tech

Location:

London, United Kingdom

Job Category:

Other

EU work permit required:

Yes

Job Reference:

21b2ed0dbb49

Job Views:

3

Posted:

23.05.2025

Expiry Date:

07.07.2025

Job Description:

Job Title: Data Engineer (Databricks, Python, SQL)

Location: Remote

Contract Type: Outside IR35

Start Date: ASAP

About Us: Toucanberry Tech is a boutique software consultancy delivering high-impact solutions to the financial sector. We work in agile, cross-functional teams to solve complex challenges with speed, autonomy, and innovation. You’ll be joining a project building a cutting-edge reinsurance platform for a global reinsurer in Bermuda.

The Role: We’re looking for a Data Engineer with recent hands-on experience in Databricks, Python, and SQL. You’ll be working directly with clients to shape data models, troubleshoot pipelines, and deliver production-ready code. Strong communication skills and the ability to explain technical decisions clearly are key.

Key Responsibilities:

• Develop and maintain dbt SQL models and macros
• Collaborate with stakeholders to understand and refine modelling requirements
• Debug and optimize existing models
• Design ETL/ELT workflows and data pipelines
• Implement best practices for data governance, quality, and performance
• Work within Azure Databricks and follow code-based deployment practices

Must-Have Skills:

• 3 years Databricks (Lakehouse, Delta Lake, PySpark, Spark SQL)
• Strong SQL (5 years)
• Deployed Databricks pipelines and jobs using Terraform, CLI, or asset bundles
• Hands-on experience with provisioning Databricks as code

Nice to Have:

• Experience in financial services or insurance
• Familiarity with data governance frameworks