Data Platform Engineer

Recruit with Purpose; Milton Keynes; Hybrid; GBP 50,000 - 61,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Recruit with Purpose in Milton Keynes is hiring a Data Platform Engineer to join an early-stage data platform launch. This hands-on role focuses on designing robust ingestion pipelines and shaping how data is used across the organisation.

You'll work with Azure Data Factory, ADLS and Databricks, using Python and SQL to land data into Bronze, Silver and Gold layers, collaborating with BI and data teams. The role is hybrid, with one day a week in the office, and offers a salary around £55k plus

Qualifications

• 3–5 years of experience with Databricks and modern cloud data platforms.
• Hands-on experience building and maintaining data ingestion pipelines.
• Strong Python and SQL skills for data processing and analysis.

Responsibilities

• Design, build and maintain robust ETL/ELT ingestion pipelines across the data platform.
• Contribute to developing and refining the Databricks environment and Bronze/Silver/Gold layers.
• Collaborate with BI, data engineering and business teams to ensure data is usable and drives decisions.
• Work with Git and CI/CD to deliver changes across environments with quality controls.

Skills

Databricks

Python

SQL

Git

CI/CD

Tools

Azure Data Factory

Azure Data Lake Storage

Databricks notebooks

Azure DevOps

GitHub

Git

Job description

Are you a Data Platform Engineer wanting to join a business early on in their new data platform launch?

You'll have the genuine ability to make a real impact at this Housing Association, with the opportunity to help shape the direction of its data platform and a clear route to lead and architectural roles. If you're a Data Engineer with good technical grounding and now wanting to grow and learn, then this would be an excellent opportunity for you.

This is a hands-on data engineering role where you'll be building and shaping how data works across the organisation.

As Data Engineer, you'll spend your time designing and developing robust ingestion pipelines across Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), pulling data from multiple source systems and turning it into something joined-up, usable, and genuinely valuable. You'll be working with a range of Dynamics, legacy and bespoke systems, APIs and public-domain data, bringing this information into the data platform and landing it into the Bronze layer within Databricks.

Alongside that, you'll be working in Databricks using Python, SQL and notebooks, supporting the development of a new Databricks environment and helping to build the foundations of a modern data platform. You'll work closely with the wider Data Engineering team, who will take data through the subsequent Silver and Gold layers, so collaboration and good communication will be important.

The business is very proud of its engineering culture and mindset. You'll be working with Git and CI/CD processes to deliver changes across environments, keeping things clean, controlled, and scalable as the platform grows. There will also be scope to get involved in the administration and development of the new Databricks environment, giving you the opportunity to have a genuine influence over how the platform is built.

This role sits right at the centre of how data is used, collaborating closely with BI analysts, Data Engineers and wider business teams to make sure data is accessible and actually drives decisions, not just reports, so you won't be working in isolation.

Ultimately, this is a role for someone who wants to move beyond just building pipelines and start shaping the future state for data in a modern, cloud-based environment. You'll be joining an organisation that wants to use data to make better decisions and ultimately improve the lives of its tenants and communities.

You would be an excellent fit as Data Engineer if you have:

• Designed, built, and managed ETL/ELT data ingestion pipelines using Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS)
• Around 3-5 years' experience working with Databricks, with strong practical and competent experience
• Experience working with Python, SQL and Databricks notebooks
• Experience working with Databricks Bronze layer architecture and modern cloud-based data platforms
• Experience with Git and CI/CD processes such as Azure DevOps or GitHub
• Strong communication skills and the ability to work collaboratively with Data Engineering, BI and wider business teams

This is a hybrid role with one day a week in one of their office across the South East and East Midlands.

The salary is £55,000 with some flexibility depending on experience, alongside a good benefits package.