Data Engineer (Databricks, Python, Sql)

Toucanberry Tech; City Of London; Remote; GBP 50,000 - 70,000; Full time

Job summary

A leading software consultancy is seeking a Data Engineer to join their team. The role involves working with clients to develop data models and optimize pipelines using Databricks, Python, and SQL. Ideal candidates will have strong technical skills and excellent communication abilities, contributing to innovative solutions in the financial sector.

Qualifications

• 3 years of experience with Databricks (Lakehouse, Delta Lake, PySpark, Spark SQL).
• 5 years of strong SQL skills.
• Experience deploying Databricks pipelines using Terraform.

Responsibilities

• Develop and maintain dbt SQL models and macros.
• Design ETL/ELT workflows and data pipelines.
• Implement best practices for data governance and performance.

Skills

Databricks

Python

SQL

Client-facing communication

Terraform

Job description

Job Title: Data Engineer (Databricks, Python, SQL)

Location: Remote

Contract Type: Outside IR35

Start Date: ASAP

About Us: Toucanberry Tech is a boutique software consultancy delivering high-impact solutions to the financial sector. We work in agile, cross-functional teams to solve complex challenges with speed, autonomy, and innovation. You’ll be joining a project building a cutting-edge reinsurance platform for a global reinsurer in Bermuda.

The Role: We’re looking for a Data Engineer with recent hands-on experience in Databricks, Python, and SQL. You’ll be working directly with clients to shape data models, troubleshoot pipelines, and deliver production-ready code. Strong communication skills and the ability to explain technical decisions clearly are key.

Key Responsibilities:

• Develop and maintain dbt SQL models and macros
• Collaborate with stakeholders to understand and refine modeling requirements
• Debug and optimize existing models
• Design ETL/ELT workflows and data pipelines
• Implement best practices for data governance, quality, and performance
• Work within Azure Databricks and follow code-based deployment practices

Must-Have Skills:

• 3 years of experience with Databricks (Lakehouse, Delta Lake, PySpark, Spark SQL)
• Strong SQL skills (5 years)
• Experience with Azure, focusing on Databricks
• Excellent client-facing communication skills
• Experience deploying Databricks pipelines and jobs using Terraform, CLI, or asset bundles
• Hands-on experience with provisioning Databricks as code

Nice to Have:

• Experience in financial services or insurance
• Familiarity with data governance frameworks