Data Engineer

RedRock Resourcing; Birmingham; On-site; GBP 40,000 - 60,000; Full time

Job summary

RedRock Resourcing is searching for a Data Engineer to join their team in Birmingham, UK. This role involves designing, building, and maintaining end-to-end data pipelines, ensuring they are robust and scalable.

You will work closely with architecture teams and contribute to a modern Azure-based data platform, leveraging tools like Databricks and PySpark for effective analytics and business insights.

Ideal candidates will have strong experience with Azure, as well as hands-on expertise in CI/CD and data governance.

Qualifications

• Strong experience with Azure Data Platform & Databricks.
• Hands-on with PySpark / Spark-based processing.
• Experience with Terraform & CI/CD pipelines.

Responsibilities

• Build and maintain Azure & Databricks pipelines.
• Develop scalable ELT processes using PySpark.
• Implement data quality, lineage, and security controls.

Skills

Azure Data Platform

Databricks

PySpark

Terraform

CI/CD

Data governance

Communication

Job description

We’re looking for a Data Engineer to join a high-performing data function, playing a key role in building and scaling a modern Azure-based data platform.

This is an opportunity to work on a Databricks lakehouse environment, delivering robust, scalable pipelines that power critical analytics and business insights.

The Role

You’ll be responsible for designing, building, and maintaining end-to-end data pipelines, taking data from source systems through to curated datasets ready for reporting and analytics.

Working closely with architecture and delivery teams, you’ll help shape a high-quality, governed, and observable data platform.

What You’ll Be Doing

• Build and maintain Azure & Databricks pipelines
• Develop scalable ELT processes using PySpark
• Implement data quality, lineage, and security controls
• Own CI/CD pipelines and Infrastructure as Code (Terraform)
• Ensure pipelines are testable, observable, and easy to troubleshoot
• Optimise data services for performance and cost efficiency
• Collaborate with stakeholders to translate requirements into data solutions
• Contribute to Agile delivery with clear documentation and best practices

What We’re Looking For

• Strong experience with Azure Data Platform & Databricks
• Hands‑on with PySpark / Spark-based processing
• Experience with Terraform & CI/CD pipelines
• Solid understanding of data governance, quality, and lineage
• Familiarity with Git-based workflows and DevOps practices
• Strong communication skills and ability to work with cross‑functional teams
• Work on a modern lakehouse architecture
• Be part of a forward-thinking data team
• Influence engineering standards and platform design
• Deliver impactful data solutions at scale