Manchester
On-site
GBP 50,000 - 70,000
Full time
Job summary
A leading telecommunications company in Manchester is seeking a skilled Data Engineer to design and maintain Azure infrastructure while optimising CI/CD pipelines. The ideal candidate will have proven expertise in Microsoft Azure, strong proficiency in Databricks, and hands-on experience with Terraform. This role offers excellent growth opportunities in a collaborative environment.
Qualifications
- Proven expertise with Microsoft Azure.
- Strong proficiency in Databricks with Scala and PySpark.
- Deep experience with Terraform for Azure.
Responsibilities
- Design, build, and maintain Azure infrastructure with Terraform.
- Develop and optimise CI/CD pipelines in Azure DevOps.
- Monitor, troubleshoot, and optimise platform reliability.
Skills
Microsoft Azure expertise
Databricks proficiency
Terraform experience
Azure DevOps pipelines
Problem-solving skills
Collaboration skills
Responsibilities
- Design, build, and maintain Azure infrastructure with Terraform (IaC) as the single source of truth.
- Develop and optimise CI/CD pipelines in Azure DevOps to automate deployment of workspaces, Unity Catalog, networking, and security.
- Work with Databricks (Spark/Scala, PySpark) to support ingestion frameworks, data processing, and platform-level libraries.
- Implement secure connectivity (VNET injection, Private Link, firewall, DNS, RBAC).
- Monitor, troubleshoot, and optimise platform reliability and performance.
- Partner with architects, engineers, and product teams to enforce best practices in governance, security, and automation.
- Document infrastructure, processes, and standards for wider engineering adoption.
Qualifications
- Proven expertise with Microsoft Azure (networking, security, storage, compute).
- Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark.
- Deep experience with Terraform for Azure resource deployment and governance.
- Hands-on with Azure DevOps pipelines (YAML, agents, service connections).
- Understanding of Azure Active Directory / Entra ID, RBAC, and service principals.
- Familiarity with monitoring and logging in Azure (Log Analytics, Monitor, Application Insights).
- Excellent problem-solving and collaboration skills.
- Experience in large-scale enterprise environments and agile delivery.
- Data Engineering is a perfect blend of Data Engineers and QA Engineers that are renowned for their forward thinking and trail blazing. Exceptionally talented, supportive and personable, it's an area that's challenging, provides excellent growth opportunities and rewarding.