Data Engineer

Big Red Recruitment; Greater London; On-site; GBP 58,000 - 70,000; Full time

Benefits offered by this job

Bonus up to 20%

25 days holiday

Pension 5%

Discounts on gym memberships

Support for qualifications

Job summary

Big Red Recruitment is partnering with an established, multi-site property owner and operator in London to hire a Data Engineer for its in‑house team.

You'll innovate on an Azure Databricks platform, applying Medallion architecture and expanding data sources while keeping data quality high and usable by the business.

The role offers strong ownership, autonomy and collaboration with system owners, plus a discretionary bonus, 25 days' holiday and a 5% pension.

Qualifications

• Commercial experience building production pipelines in Azure Databricks.
• Strong SQL skills and Medallion architecture understanding.
• Experience with Azure DevOps CI/CD.
• Ability to communicate clearly and document work.

Responsibilities

• Build and optimise pipelines across Bronze, Silver and Gold layers.
• Integrate new data sources via APIs and system extracts.
• Investigate data quality issues and trace to source systems.
• Shape data transformations to meet Power BI needs.
• Ensure Gold layer delivers reliable, trusted data for reporting.
• Collaborate with stakeholders and maintain platform documentation.

Skills

Azure Databricks

Medallion architecture

SQL

Azure DevOps CI/CD

Python

Power BI semantic models

Job description

Fed up with owning just one small piece of the data puzzle? Want a role where you can get involved in everything and actually see the impact of your work?

We're working with an established, multi-site property owner and operator that's investing in its data capabilities and looking for a Data Engineer to join its small, collaborative in-house team.

They've already built a modern Azure Databricks platform using Medallion architecture, with Power BI sitting on top. Now they're moving into an exciting next phase, bringing new data sources onto the platform, improving data quality and helping the business get even more value from its data.

What makes this opportunity stand out is the variety. You'll work with data spanning Finance, HR, CRM, Property and Operations, collaborating directly with system owners and stakeholders to understand challenges, build solutions and shape how information is used across the business.

It's a flat, supportive team where you'll have real ownership, plenty of autonomy and the freedom to suggest better ways of doing things. You won't just be maintaining pipelines, you'll be helping move the platform forward.

What will you be doing?

You’ll be hands‑on with Azure Databricks, building and optimising pipelines across the Bronze, Silver and Gold layers, while integrating new data sources through APIs and system extracts.

You’ll investigate data quality issues, trace anomalies back to source systems and work closely with stakeholders to get things right. You’ll also help shape data transformations, ensure the Gold layer delivers what Power BI needs, and make sure the business can trust the information it’s using.

Alongside this, you’ll work with Azure DevOps, CI/CD and data documentation, helping keep the platform reliable, efficient and easy to understand.

What are they looking for?

You’ll need commercial experience building production pipelines in Azure Databricks, a good understanding of Medallion architecture, strong SQL skills and experience with Azure DevOps CI/CD.

You’ll also be someone who can communicate clearly, document your work effectively and enjoys working with people outside the data team.

Experience with Python, Power BI semantic models or data analysis would be a bonus, as would exposure to property or facilities management data, but industry experience isn't essential.

What's on offer?

• Salary up to £64,000
• Discretionary bonus up to 20%, based on company and individual performance
• 25 days' holiday, with the option to buy five more
• 5% contributory pension
• Discounts on gym memberships, electric cars and shopping
• Support towards professional qualifications and certifications

Why consider it?

This is a great opportunity for a Data Engineer who wants more variety, more ownership and more visibility than you'd typically find in a larger data team.

The foundations are already in place, the technology is modern, and there's plenty of interesting work ahead. You'll have the opportunity to influence how the platform evolves, broaden your experience across different business areas and see the genuine impact of what you deliver.

If you enjoy solving problems, working with modern data technology and having a real say in how things are done, this is definitely worth a conversation.