Azure Databricks Data Engineer – Lakehouse & CI/CD

RedRock Resourcing; Birmingham; Vor Ort; GBP 40.000 - 60.000; Vollzeit

Zusammenfassung

RedRock Resourcing is searching for a Data Engineer to join their team in Birmingham, UK. This role involves designing, building, and maintaining end-to-end data pipelines, ensuring they are robust and scalable.

You will work closely with architecture teams and contribute to a modern Azure-based data platform, leveraging tools like Databricks and PySpark for effective analytics and business insights.

Ideal candidates will have strong experience with Azure, as well as hands-on expertise in CI/CD and data governance.

Qualifikationen

• Strong experience with Azure Data Platform & Databricks.
• Hands-on with PySpark / Spark-based processing.
• Experience with Terraform & CI/CD pipelines.

Aufgaben

• Build and maintain Azure & Databricks pipelines.
• Develop scalable ELT processes using PySpark.
• Implement data quality, lineage, and security controls.

Kenntnisse

Azure Data Platform

Databricks

PySpark

Terraform

CI/CD

Data governance

Communication

Jobbeschreibung

RedRock Resourcing is searching for a Data Engineer to join their team in Birmingham, UK. This role involves designing, building, and maintaining end-to-end data pipelines, ensuring they are robust and scalable.

You will work closely with architecture teams and contribute to a modern Azure-based data platform, leveraging tools like Databricks and PySpark for effective analytics and business insights.

Ideal candidates will have strong experience with Azure, as well as hands-on expertise in CI/CD and data governance.