Azure Databricks Data Engineer – Lakehouse & CI/CD

RedRock Resourcing; Birmingham; On-site; GBP 40,000 - 60,000; Full time

Job summary

RedRock Resourcing is searching for a Data Engineer to join their team in Birmingham, UK. This role involves designing, building, and maintaining end-to-end data pipelines, ensuring they are robust and scalable.

You will work closely with architecture teams and contribute to a modern Azure-based data platform, leveraging tools like Databricks and PySpark for effective analytics and business insights.

Ideal candidates will have strong experience with Azure, as well as hands-on expertise in CI/CD and data governance.

Qualifications

• Strong experience with Azure Data Platform & Databricks.
• Hands-on with PySpark / Spark-based processing.
• Experience with Terraform & CI/CD pipelines.

Responsibilities

• Build and maintain Azure & Databricks pipelines.
• Develop scalable ELT processes using PySpark.
• Implement data quality, lineage, and security controls.

Skills

Azure Data Platform

Databricks

PySpark

Terraform

CI/CD

Data governance

Communication

Job description

RedRock Resourcing is searching for a Data Engineer to join their team in Birmingham, UK. This role involves designing, building, and maintaining end-to-end data pipelines, ensuring they are robust and scalable.

You will work closely with architecture teams and contribute to a modern Azure-based data platform, leveraging tools like Databricks and PySpark for effective analytics and business insights.

Ideal candidates will have strong experience with Azure, as well as hands-on expertise in CI/CD and data governance.