Senior Data Engineer: Product Pipelines & APIs (Hybrid)

Burns Sheehan; Greater London; On-site; GBP 75,000 - 85,000; Full time

Job summary

Burns Sheehan partners with a London-based property data and technology business to recruit a Senior Data Engineer. You will own the architecture and pipelines, building data products and APIs that power valuation, risk and customer insights for major lenders and institutions.

You will collaborate across databases, cloud platforms and APIs, working with software engineers, product managers, analysts and security teams, with three days in the London Bridge office.

Qualifications

• Experience building production data pipelines and platforms.
• AWS or strong transferable cloud experience.
• Commercial exposure to Terraform, CloudFormation or another Infrastructure as Code tool.
• Experience with Databricks, PySpark, Delta Lake, dbt, Snowflake or a comparable platform.
• Understanding of software engineering principles, testing and code quality.
• Evidence that you have improved or transformed systems, rather than simply maintained them.
• An interest in building data products used directly by customers.
• Ability to work from the London Bridge office three days per week.

Responsibilities

• Architecting robust, scalable data pipelines.
• Building maintainable and testable Python services.
• Managing cloud infrastructure through Terraform and IaC.
• Developing customer-facing data products and APIs.
• Improving platform performance, reliability, observability and security.
• Working with Databricks, Delta Lake and Lakehouse architecture.
• Reviewing code and raising engineering standards across the team.
• Identifying opportunities to improve the platform without direction.
• Translating complex technical decisions for product and commercial stakeholders.

Skills

Python

SQL

AWS

Tools

Terraform

Databricks

PySpark

Delta Lake

dbt

Snowflake

CloudFormation

Job description

Burns Sheehan partners with a London-based property data and technology business to recruit a Senior Data Engineer. You will own the architecture and pipelines, building data products and APIs that power valuation, risk and customer insights for major lenders and institutions.

You will collaborate across databases, cloud platforms and APIs, working with software engineers, product managers, analysts and security teams, with three days in the London Bridge office.