Data Engineer

Consortia Group; United Kingdom; Remote; GBP 50,000 - 60,000; Full time

Job summary

A leading recruitment agency in the UK is seeking a Data Engineer to develop scalable data pipelines and enhance data quality. You'll work with a modern tech stack, including Python, Databricks, and Azure, in a remote-first environment. The role offers up to £60,000, along with opportunities for professional development and innovative project involvement.

Benefits

Professional development

Innovative projects

Remote-first work policy

Qualifications

• Proficiency in Python with PySpark.
• Experience with advanced SQL.
• Knowledge of CI/CD and data governance practices.

Responsibilities

• Build and maintain data pipelines using Azure Data Factory, Databricks, and Terraform.
• Implement monitoring systems to ensure data reliability.
• Research and deploy innovative solutions to improve platform efficiency.
• Collaborate with analysts, scientists, and engineers on data needs.
• Assist in fixing bugs and optimizing performance.

Skills

Proficiency in Python (including PySpark)

Advanced SQL

Experience with Databricks

Experience with Azure Data Factory (ADF)

Strong knowledge of CI/CD principles

Knowledge of data governance

Experience with Infrastructure-as-Code tools such as Terraform

Job description

Data Engineer – Tech for Good

Are you a data engineer eager to drive meaningful change? This is your chance to join a mission-driven organisation using cutting-edge technology to create measurable social impact across the UK.

As a Data Engineer, you'll work with a modern tech stack, including Databricks, Azure Cloud, and Python, helping deliver innovative projects like Generative AI-driven insights and Data-as-a-Service models. You'll be part of a collaborative, remote-first team, empowered to grow your skills while directly contributing to impactful, community-focused solutions.

This is an urgent requirement, with interviews starting next week, and the ideal candidate available to begin latest in March.

What’s on Offer:

• Salary: Up to £60,000
• Work Policy: Remote-first, with quarterly in-office collaboration (South West UK)
• Innovative Projects: Generative AI and network architecture research.
• Growth Opportunities: Encouragement to learn, innovate, and take ownership.

Your Role

In this role, you will:

• Build and Maintain Pipelines: Develop, enhance, and secure scalable data pipelines using Azure Data Factory (ADF), Databricks, and Terraform.
• Enhance Data Quality: Implement monitoring systems to ensure data reliability and compliance with regulations.
• Innovate and Optimise: Research and deploy innovative solutions to improve platform efficiency, scalability, and security.
• Collaborate Across Teams: Work closely with analysts, scientists, and engineers to address diverse data needs and improve the data platform.
• Support Development and Stability: Assist in fixing bugs, optimising performance, and ensuring smooth platform functionality.

What You’ll Need

• Technical Skills: Proficiency in Python (including PySpark), advanced SQL, and experience with tools like Databricks and Azure Data Factory (ADF).
• Engineering Practices: Strong knowledge of CI/CD principles, data governance, and Infrastructure-as-Code tools such as Terraform.
• Problem-Solving Expertise: A proactive approach to addressing challenges and identifying innovative solutions.
• Growth Mindset: A willingness to learn and work with emerging technologies, including Generative AI.

This is more than a job—it's an opportunity to grow, innovate, and make a tangible difference.

Please note that we are unable to provide visa sponsorship for this opportunity.

Key Information
Job Title: Data Engineer
Location: UK-based (Remote-first with quarterly in-office collaboration)
Work Policy: Remote-first
Salary: Up to £60,000
Benefits: Professional development, innovative projects

We are a specialist recruitment agency. If this Data Engineer job in the UK doesn't align with your preferences but you’re open to exploring other opportunities, please register by applying to this role so we can match you to other requirements.