Azure DevOps & Platform Engineer
We are seeking a highly skilled Azure DevOps & Data Platform Engineer with strong expertise in Azure Cloud, Azure Databricks, Azure Data Factory (ADF), Terraform, and CI/CD automation. The ideal candidate will be responsible for designing, implementing, and supporting scalable DevOps solutions for enterprise data platforms while ensuring secure, automated, and reliable deployments across multiple environments.
The role involves close collaboration with Data Engineering, Infrastructure, and Solution Architecture teams to streamline deployments, improve operational efficiency, and support cloud modernization initiatives.
Key Responsibilities
- Design, implement, and maintain CI/CD pipelines using Azure DevOps and GitHub Actions.
- Automate deployment processes for Azure Databricks, Azure Data Factory, Terraform, and related Azure services.
- Develop reusable deployment frameworks and automation scripts to reduce manual intervention.
- Support release management and deployment validation across Sandbox, Non‑Prod, and Production environments.
- Troubleshoot deployment failures, pipeline issues, and Git merge conflicts.
- Implement infrastructure‑as‑code (IaC) solutions using Terraform.
- Implement and maintain Azure Databricks CI/CD solutions; automate repository synchronization and notebook deployments; support workflow migration and environment onboarding.
- Configure Databricks Access Connectors, networking, and managed identity integrations; collaborate on Service Principal‑based CI/CD approaches; support networking, private endpoints, firewall configurations, and serverless integrations.
- Design and implement custom ADF deployment automation solutions; develop selective deployment frameworks; support ADF CI/CD implementation; perform environment refactoring and migration activities; support deployment validation and production release activities.
- Develop and maintain Terraform modules for Azure infrastructure provisioning; provision and manage Azure networking components; manage resource locks, firewall rules, private endpoints, DNS integrations; perform state management, imports, refactoring, and migrations.
- Work closely with cross‑functional teams; conduct knowledge‑sharing sessions; support environment monitoring, issue resolution, and production deployments; participate in change management and operational support; recommend improvements to platform reliability, security, and deployment maturity.
Technical Skills
- Azure DevOps
- Azure Cloud Services
- Azure Databricks
- Azure Data Factory (ADF)
- Terraform
- GitHub Actions
- CI/CD automation
- GitHub repository management
- Infrastructure as Code (IaC)
- Azure Networking
- PowerShell / Bash scripting
- Git version control
Additional Preferred Skills
- Fabric CI/CD knowledge
- Python scripting
- Linux administration
- Databricks networking and serverless architecture
- Private DNS Zones and Private Endpoints
- Managed Identity and Service Principal integrations
Certifications Preferred
- AZ‑400 : Microsoft Azure DevOps Engineer Expert
- AZ‑104 : Microsoft Azure Administrator
- DP‑203 Certified : Azure Data Engineer Associate
Experience Requirements
- 7+ years of experience in Azure Cloud and DevOps engineering.
- Hands‑on experience implementing enterprise‑grade CI/CD solutions.
- Experience supporting production cloud platforms and deployment operations.
- Strong troubleshooting and problem‑solving skills.
- Experience collaborating with cross‑functional technical teams.
Key Achievements Expected
- Reduce manual deployment effort through automation.
- Improve deployment reliability and environment consistency.
- Enhance security and governance of cloud infrastructure.
- Enable scalable DevOps practices across enterprise data platforms.
- Streamline Databricks and ADF deployment processes.
Soft Skills
- Strong communication and stakeholder management skills.
- Ability to work independently and collaboratively.
- Analytical thinking and proactive problem‑solving.
- Strong documentation and presentation skills.
- Ability to manage multiple priorities in fast‑paced environments.
Tools & Technologies
- Azure DevOps
- GitHub Actions (CI/CD)
- GitHub Repositories
- Terraform
- Azure Databricks
- Azure Data Factory
- Azure Key Vault
- Azure Networking
- Git
- Scripting
- Python