DevOps Engineer – Azure Data Platform

Summit Consulting Services; Bengaluru Urban; On-site; INR 1,000,000 - 1,600,000; Full time

Job summary

Summit Consulting Services is seeking an experienced DevOps Engineer to join its DevOps team in Bengaluru. The role emphasizes CI/CD, infrastructure provisioning, environment management, and production readiness for Azure Data Factory, Databricks, and Azure Data Lake Storage.

You will collaborate with Engineering, QA, and Support to ensure secure, scalable deployments and reliable operations. Responsibilities include designing and maintaining YAML pipelines, creating reusable templates,

Qualifications

• 8+ years of relevant engineering experience in DevOps, platform engineering and cloud engineering.
• Strong hands-on experience with Microsoft Azure and production workloads.

Responsibilities

• Design, build, and maintain YAML-based CI/CD pipelines using Azure DevOps and/or GitHub Actions.
• Create reusable pipeline templates and manage build agents, runners, dependencies, and execution environments.
• Automate deployment and configuration of Azure Data Factory, Databricks, and Data Lake Storage.
• Manage environments and promote artifacts across dev, QA, staging, and prod.
• Establish PR checks, branch protection, approvals, automated tests, smoke checks, and rollback procedures.
• Support releases and changes with auditable processes.
• Contribute to DevOps standards, documentation, and continual improvement.

Skills

Azure DevOps

GitHub Actions

YAML pipelines

Kubernetes

AKS

Azure Data Factory

Azure Databricks

Azure Data Lake Storage

Python automation

PowerShell

Bash

Tools

Azure DevOps

GitHub Actions

Kubernetes

AKS

Azure Data Factory

Databricks

Azure Data Lake Storage

Bicep

Python

PowerShell

Bash

Job description

DevOps Engineer to join our DevOps team. The role focuses on CI/CD, infrastructure provisioning, environment management, and production readiness for Databricks, Azure Data Factory, and Azure Data Lake Storage. Working closely with Engineering, QA, and Support teams, you will ensure secure, scalable, and reliable platform Deployments and operations.

Key Responsibilities

• Design, build, and maintain YAML-based CI/CD pipelines using Azure DevOps and/or GitHub Actions.
• Create reusable pipeline templates and manage build agents, runners, dependencies, and execution environments.
• Automate deployment and configuration of:
• Azure Data Factory: pipelines, linked services, datasets, triggers, and environment-specific settings.
• Azure Databricks: jobs, workflows, notebooks or packaged code, dependencies, workspace configuration, and permissions.
• Azure Data Lake Storage: supporting resources, configuration, and access controls.
• Enable controlled deployment of SQL schemas, views, and scripts in partnership with Data Engineering.
• Implement versioned artifacts and controlled promotion across development, QA, staging, and production environments.
• Establish pull-request checks, branch protection, approval gates, automated test integration, post-deployment smoke checks, and rollback procedures.
• Support planned releases and emergency changes through documented, auditable processes.
• Contribute to DevOps standards, documentation, and continuous improvement initiatives

Required Skills & Experience

• 8+ years of relevant engineering experience, including substantial hands-on experience in DevOps, platform engineering and cloud engineering.
• Demonstrated experience supporting and improving production workloads on Microsoft Azure.
• Strong hands-on experience with
• Azure DevOps and/or GitHub Actions, YAML pipelines, reusable templates, and release controls.
• Deploying, managing, and troubleshooting production workloads on Kubernetes and Azure Kubernetes Service (AKS).
• Practical experience deploying and configuring Azure Data Factory, Databricks, and Azure Data Lake Storage through automated delivery processes.
• Proficiency with Bicep for Azure Infrastructure as Code, including reusable modules and multi-environment deployments.
• Strong Python automation skills and proficiency in PowerShell and/or Bash.
• Working knowledge of Azure compute, networking, storage, identity and access management, private connectivity, and secure configuration.
• Experience with Git workflows, pull requests, branch protection, code reviews, artifact management, and controlled releases.
• Intermediate SQL skills for queries, joins, deployment validation, data checks, and production troubleshooting.
• Practical experience with monitoring, logging, alerting, incident investigation, root-cause analysis, and recovery procedures.
• Experience implementing secrets management, least-privilege access, and secure CI/CD practices.
• Ability to work independently, evaluate technical trade-offs, communicate risks, and maintain clear technical documentation.
• Strong communication and collaboration skills across engineering, QA, security, infrastructure, and support teams.

Nice to Have

• Experience with SQL Server, SSIS, and/or Snowflake deployment and operational tooling.
• Familiarity with .NET/C# build and release processes, including collaboration with developers on deployment, configuration, and runtime issues.
• Experience with Azure Monitor, Log Analytics, or related observability tools.
• Experience with Databricks deployment tooling, job orchestration, cluster policies, or dependency management.
• Exposure to policy-as-code, cloud governance, and compliance-oriented change controls.
• Experience with disaster recovery, resilience testing, capacity planning, and cloud cost optimization.
• Experience in financial services or other environments requiring controlled, auditable production changes.