Cloud DevOps Engineer

Compunnel, Inc.; Quincy (MA); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading technology firm in Quincy is seeking a highly experienced Cloud DevOps Engineer with over 10 years of expertise in cloud infrastructure and automation. The successful candidate will architect and manage scalable data solutions within an Azure Data Lakehouse environment, focusing on Databricks and other Azure services. Responsibilities include optimizing data pipelines and managing Azure infrastructure. Join us to lead innovations in the cloud domain.

Qualifications

• 10 years of hands-on experience in cloud and DevOps technologies.
• Expertise in Azure services including Resource Manager, AKS, and Networking.
• Experience with microservices architecture and container orchestration.

Responsibilities

• Architect and configure Databricks Pipelines for data processing.
• Manage Azure infrastructure components.
• Design monitoring frameworks using Azure Monitor.

Skills

Cloud infrastructure expertise

Automation

Data engineering

Azure Databricks

Infrastructure-as-code

Scripting (Python, Bash)

Tools

Terraform

Azure DevOps

Grafana

Prometheus

Job description

We are seeking a highly experienced Cloud DevOps Engineer with a minimum of 10 years of hands-on expertise in cloud infrastructure, automation, and data engineering.

The ideal candidate will architect and manage scalable data solutions within an Azure Data Lakehouse environment, leveraging Databricks and other Azure services.

Key Responsibilities

• Architect, configure, and optimize Databricks Pipelines for large-scale data processing in Azure Data Lakehouse.
• Set up and manage Azure infrastructure components including Databricks Workspaces, Azure Containers (AKS/ACI), Storage Accounts, and Networking.
• Design and implement monitoring and observability frameworks using Azure Monitor, Log Analytics, Prometheus, and Grafana.
• Collaborate with platform and data engineering teams to support microservices-based architecture for scalable data solutions.
• Drive automation and CI/CD practices using Terraform, ARM templates, GitHub Actions, and Azure DevOps.

Required Qualifications

• Minimum 10 years of hands-on experience in cloud and DevOps technologies.
• Strong expertise in Azure Databricks, Delta Lake, and Apache Spark.
• Deep understanding of Azure services including Resource Manager, AKS, ACR, Key Vault, and Networking.
• Proven experience in microservices architecture and container orchestration.
• Proficiency in infrastructure-as-code, scripting (Python, Bash), and DevOps tooling.
• Familiarity with cloud data governance, security, and cost optimization.

Preferred Qualifications

• Experience with event-driven architectures such as Kafka or Event Grid.
• Knowledge of data mesh principles and distributed data ownership.