Senior DevOps Engineer with Terraform

Compunnel Inc.; Mississauga; On-site; CAD 100,000 - 130,000; Full time

Job summary

A technology solutions provider in Canada is seeking a Senior DevOps Engineer to design and implement scalable cloud infrastructure using Azure. The candidate will manage CI/CD pipelines, develop Databricks environments, and ensure compliance with security standards. Strong expertise in Terraform and cloud practices is required, along with 10+ years of experience in cloud engineering.

Qualifications

• 10+ years of experience in cloud engineering with a focus on Azure.
• Proven experience with Databricks and data engineering.
• Strong knowledge of Terraform and IaC principles.
• Hands-on experience with DevOps tools and practices.
• Experience with containerization and orchestration tools (Docker, Kubernetes).
• Proficiency in scripting languages (Python, PowerShell, or Bash).
• Solid understanding of networking concepts and cloud security best practices.
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Responsibilities

• Design and implement scalable and secure cloud infrastructure using Azure services.
• Monitor and troubleshoot cloud infrastructure and services for performance and reliability.
• Develop and manage Databricks environments for data processing and analytics.
• Implement ETL pipelines using Databricks and integrate with other data sources.
• Optimize Databricks performance and cost efficiency.
• Write and maintain Terraform scripts to automate infrastructure provisioning.
• Implement Infrastructure as Code (IaC) practices for consistency and reproducibility.
• Collaborate with development teams to integrate Terraform into CI/CD pipelines.
• Implement and manage CI/CD pipelines using tools like Jenkins, GitHub Actions, or Azure DevOps.
• Ensure security and compliance in DevOps workflows.
• Implement and manage Azure Networking (VNETs, VPNs, ExpressRoute).
• Manage Azure Active Directory and role-based access control (RBAC).
• Document infrastructure designs, configurations, and procedures.
• Provide training and support to team members on cloud technologies and best practices.

Skills

Azure

Terraform

Databricks

DevOps practices

CI/CD pipelines

Infrastructure as Code (IaC)

Containerization

Kubernetes

Scripting languages (Python, PowerShell, Bash)

Networking concepts

Tools

Jenkins

GitHub Actions

Azure DevOps

Job description

We are seeking a highly skilled Senior DevOps Engineer with extensive experience in Azure, Terraform, Databricks, and DevOps practices.

This role involves designing, implementing, and managing scalable cloud infrastructure, automating deployments, and ensuring compliance with security standards.

The ideal candidate will have strong expertise in cloud architecture, CI/CD pipelines, and infrastructure as code (IaC).

Key Responsibilities

• Design and implement scalable and secure cloud infrastructure using Azure services.
• Monitor and troubleshoot cloud infrastructure and services for performance and reliability.
• Develop and manage Databricks environments for data processing and analytics.
• Implement ETL pipelines using Databricks and integrate with other data sources.
• Optimize Databricks performance and cost efficiency.
• Write and maintain Terraform scripts to automate infrastructure provisioning.
• Implement Infrastructure as Code (IaC) practices for consistency and reproducibility.
• Collaborate with development teams to integrate Terraform into CI/CD pipelines.
• Implement and manage CI/CD pipelines using tools like Jenkins, GitHub Actions, or Azure DevOps.
• Ensure security and compliance in DevOps workflows.
• Implement and manage Azure Networking (VNETs, VPNs, ExpressRoute).
• Manage Azure Active Directory and role-based access control (RBAC).
• Document infrastructure designs, configurations, and procedures.
• Provide training and support to team members on cloud technologies and best practices.

Required Qualifications

• 10+ years of experience in cloud engineering with a focus on Azure.
• Proven experience with Databricks and data engineering.
• Strong knowledge of Terraform and IaC principles.
• Hands-on experience with DevOps tools and practices.
• Experience with containerization and orchestration tools (Docker, Kubernetes).
• Proficiency in scripting languages (Python, PowerShell, or Bash).
• Solid understanding of networking concepts and cloud security best practices.
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Preferred Qualifications

• Familiarity with Big Data technologies and frameworks.