Senior Data Engineer

Burns Sheehan; Greater London; On-site; GBP 75,000 - 85,000; Full time

Job summary

Burns Sheehan partners with a London-based property data and technology business to recruit a Senior Data Engineer. You will own the architecture and pipelines, building data products and APIs that power valuation, risk and customer insights for major lenders and institutions.

You will collaborate across databases, cloud platforms and APIs, working with software engineers, product managers, analysts and security teams, with three days in the London Bridge office.

Qualifications

• Experience building production data pipelines and platforms.
• AWS or strong transferable cloud experience.
• Commercial exposure to Terraform, CloudFormation or another Infrastructure as Code tool.
• Experience with Databricks, PySpark, Delta Lake, dbt, Snowflake or a comparable platform.
• Understanding of software engineering principles, testing and code quality.
• Evidence that you have improved or transformed systems, rather than simply maintained them.
• An interest in building data products used directly by customers.
• Ability to work from the London Bridge office three days per week.

Responsibilities

• Architecting robust, scalable data pipelines.
• Building maintainable and testable Python services.
• Managing cloud infrastructure through Terraform and IaC.
• Developing customer-facing data products and APIs.
• Improving platform performance, reliability, observability and security.
• Working with Databricks, Delta Lake and Lakehouse architecture.
• Reviewing code and raising engineering standards across the team.
• Identifying opportunities to improve the platform without direction.
• Translating complex technical decisions for product and commercial stakeholders.

Skills

Python

SQL

AWS

Tools

Terraform

Databricks

PySpark

Delta Lake

dbt

Snowflake

CloudFormation

Job description

Location: London Bridge, three days per week in the office

Salary: £75,000 to £85,000 plus up to 10% bonus

Technology: Python, AWS, Terraform, Databricks, PySpark, SQL

I am working with an established property data and technology business that is looking for a Senior Data Engineer to join a product-focused engineering team in London.

The company provides property data, valuation and risk products used by some of the UK’s largest mortgage lenders and organisations across financial services, insurance, housebuilding and property technology.

This is not a traditional internal reporting or dashboard-focused data role.

The Data Services team builds customer-facing products that place trusted property information at the heart of commercially important decisions. The pipelines and infrastructure you work on will directly support products used by hundreds of customers and contribute to a significant revenue stream for the business.

As a Senior Data Engineer, you will take ownership of the architecture, development and ongoing improvement of scalable data products and pipelines.

You will work across the data journey, from databases and processing platforms through to APIs and customer-facing applications, collaborating closely with software engineers, product managers, analysts and security teams.

What you will be working on:

• Architecting and improving robust, scalable data pipelines
• Building maintainable and testable Python services
• Managing cloud infrastructure through Terraform and Infrastructure as Code
• Developing customer-facing data products and APIs
• Improving the performance, reliability, observability and security of the platform
• Working with Databricks, Delta Lake and Lakehouse architecture
• Reviewing code and helping raise engineering standards across the team
• Identifying opportunities to improve the platform without waiting to be directed
• Translating complex technical decisions for product and commercial stakeholders

What they are looking for:

• Experience building production data pipelines and platforms
• AWS or strong transferable cloud experience
• Commercial exposure to Terraform, CloudFormation or another Infrastructure as Code tool
• Experience with Databricks, PySpark, Delta Lake, dbt, Snowflake or a comparable platform
• An understanding of software engineering principles, testing and code quality
• Evidence that you have improved or transformed systems, rather than simply maintained them
• An interest in building data products used directly by customers
• The ability to work from the London Bridge office three days per week

You do not need to be a Terraform specialist, and Databricks experience is desirable rather than an absolute requirement.

They are particularly interested in Python-focused data engineers, data platform engineers and software engineers who have moved into data-intensive platform work.

The strongest candidates will be able to explain what they improved, why it mattered and what measurable impact their work had on customers, colleagues or the wider business.

The role offers a rare opportunity to work on commercially important data products rather than internal reporting, with broad ownership across data pipelines, cloud infrastructure, APIs and product delivery.