The Role:
We are seeking a Cloud Infrastructure and DevOps Engineer with a strong background in designing, automating, and maintaining secure, scalable cloud environments on Microsoft Azure. The ideal candidate will have hands-on experience with Azure Data Lake, Azure Data Factory, and Databricks, and will play a key role in supporting data platform operations through infrastructure
as-code, CI/CD automation, and monitoring best practices.
Key Responsibilities:
- Design and implement cloud infrastructure to support data engineering workloads across Azure Data Lake, Azure Data Factory, and Databricks.
- Develop and maintain infrastructure-as-code using tools like Terraform.
- Automate build, release, and deployment pipelines using Azure DevOps or GitHub Actions.
- Set up and maintain monitoring, alerting, and logging for Azure data services to ensure performance and reliability.
- Manage role-based access control (RBAC), service principals, and security configurations for Azure resources.
- Ensure high availability, disaster recovery, and backup configurations are in place across critical workloads.
- Collaborate with data engineers and architects to optimise pipeline orchestration and resource provisioning.
- Implement governance, cost optimization, and compliance across cloud environments.
- Provide ongoing support and enhancements post-deployment.
Qualifications And Experience:
- Strong hands-on experience with Microsoft Azure, especially deploying and managing Azure Data Lake, Azure Data Factory (ADF), and Azure Databricks.
- Proficiency in infrastructure-as-code (IaC) using tools such as Terraform.
- Experience building CI/CD pipelines in Azure DevOps or equivalent tools (GitHub Actions, Jenkins).
- Knowledge of containerization (Docker), and orchestration (Kubernetes or Azure Kubernetes Service - AKS) is advantageous.
- Familiarity with Azure networking, identity and access management, and security best practices.
- Comfortable working with scripting languages like PowerShell, Bash, or Python.
- Proven ability to analyse complex problems and deliver practical solutions
- Strong written and verbal communication skills to interact with both technical and non- technical stakeholders
CERTIFICATIONS:
- Microsoft Certified: Azure Administrator Associate (AZ-104) Highly preferred
- Microsoft Certified: DevOps Engineer Expert (AZ-400) Highly desirable