Azure Databricks Administrator

Cognizant; Topeka (KS); Remote; USD 120,000 - 150,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays plus PTO

401(k) plan

Disability insurance

Parental Leave

Employee Stock Purchase Plan

Job summary

Cognizant is seeking an experienced Azure Databricks Administrator to manage and optimize enterprise Azure Databricks environments. This remote SF-based role requires strong Azure administration, Databricks governance, and automation with Terraform and scripting.

Work with data engineers and DevOps to ensure a secure, scalable analytics platform. The position offers up to $150K annually with eligibility for Cognizant's discretionary incentive program, based on performance.

Qualifications

• Bachelor's degree in CS/IT/Engineering.
• 8+ years IT experience with at least 5+ years as Scrum Master in enterprise environments.
• Hands-on experience administering Azure Databricks environments.
• Proven expertise in Azure cloud platform operations and infrastructure management.
• Experience automating cloud environments using Terraform and scripting tools.
• Strong understanding of cloud monitoring, observability, and operational excellence.
• Ability to lead platform support initiatives and drive continuous improvement across cloud environments.

Responsibilities

• Administer and support Azure Databricks workspaces, clusters, notebooks, jobs, libraries, and platform integrations.
• Monitor, troubleshoot, and optimize Databricks cluster performance, workload balancing, auto-scaling, and overall platform efficiency.
• Manage and maintain Azure infrastructure components including VMs, Storage Accounts, VNets, NSGs, Key Vault, and Monitor.
• Implement and enforce Databricks security controls, RBAC, Unity Catalog governance, access management, and data protection policies.
• Monitor cloud infrastructure and platform health using Azure Monitor, Log Analytics, Application Insights, and Databricks monitoring tools.
• Diagnose and resolve Azure infrastructure, networking, connectivity, performance, and platform issues to ensure reliability.
• Develop and maintain backup, disaster recovery, and business continuity strategies for Azure environments.
• Automate deployment, configuration, and tasks using Terraform, ARM/Bicep templates, PowerShell, and Azure CLI.
• Support CI/CD pipelines and DevOps leveraging Azure DevOps, Git repositories, and infrastructure automation best practices.
• Collaborate with cross-functional teams to drive platform optimization, cost management, compliance adherence, security governance, and cloud best practices.

Skills

Azure Databricks

Azure Administration

Terraform

CI/CD

Monitoring

Unity Catalog

PowerShell

Azure DevOps

Education

Bachelor's degree in CS/IT/Engineering

Tools

Azure Databricks

Terraform

ARM/Bicep

PowerShell

Git

Azure CLI

Azure Monitor

Databricks

Azure DevOps

Job description

Job Title: Azure Databricks Administrator

Job Location: Remote- San Francisco, CA, USA

**** Please note, this role is not able to offer visa transfer or sponsorship now or in the future****

Role Overview

We are seeking an experienced Azure Databricks Administrator to manage, optimize, and support enterprise-scale Azure Databricks and Microsoft Azure environments. The ideal candidate will have deep expertise in Azure cloud administration, and Databricks platform management. This role will work closely with Data Engineers, Architects, Data Scientists, and Application teams to ensure a secure, scalable, and high-performing cloud analytics platform.

Salary and Other Compensation

The annual salary for this position is up to $150K depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans.

In this role, you will

• Administer and support Azure Databricks workspaces, clusters, notebooks, jobs, libraries, and platform integrations.

• Monitor, troubleshoot, and optimize Databricks cluster performance, workload balancing, auto-scaling, and overall platform efficiency.

• Manage and maintain Azure infrastructure components including Virtual Machines, Storage Accounts, Virtual Networks, NSGs, Azure Key Vault, and Azure Monitor.

• Implement and enforce Databricks security controls, RBAC, Unity Catalog governance, access management, and data protection policies.

• Monitor cloud infrastructure and platform health using Azure Monitor, Log Analytics, Application Insights, and Databricks monitoring tools.

• Diagnose and resolve Azure infrastructure, networking, connectivity, performance, and platform-related issues to ensure service reliability.

• Develop and maintain backup, disaster recovery, and business continuity strategies for Azure-based environments.

• Automate infrastructure deployment, configuration, and operational tasks using Terraform, ARM/Bicep templates, PowerShell, and Azure CLI.

• Support CI/CD pipelines and DevOps initiatives leveraging Azure DevOps, Git repositories, and infrastructure automation best practices.

• Collaborate with cross-functional teams to drive platform optimization, cost management, compliance adherence, security governance, and cloud best practices

What you'll need to succeed (required skills)

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

• 8+ years of overall IT experience with at least 5+ years serving as a Scrum Master in enterprise environments.

• Strong hands-on experience administering Azure Databricks environments.

• Proven expertise in Azure cloud platform operations and infrastructure management.

• Experience automating cloud environments using Terraform and scripting tools.

• Strong understanding of cloud monitoring, observability, and operational excellence.

• Ability to lead platform support initiatives and drive continuous improvement across cloud environments.

Mandatory Skills

• Azure Databricks Administration

• Microsoft Azure Administration

Technical Expertise

• Azure Databricks workspace and cluster administration

• Microsoft Azure infrastructure services

• Azure networking and security concepts

• Terraform and Infrastructure as Code methodologies

• ARM Templates and Bicep

• Azure Key Vault

• Azure Monitor and Log Analytics

• Application Insights

• Azure CLI and PowerShell scripting

• CI/CD implementation using Azure DevOps

• Git-based source control and deployment practices

• Unity Catalog and Databricks governance frameworks

• Cost optimization and cloud resource management

Benefits:

Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance

• Paid holidays plus Paid Time Off

• 401(k) plan and contributions

• Long-term/Short-term Disability

• Paid Parental Leave

• Employee Stock Purchase Plan

Work model:

At Cognizant, we strive to provide flexibility wherever possible, and we are here to support a healthy work-life balance though our various wellbeing programs. Based on this role's business requirements, this is a remote position in San Francisco, CA, USA.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

"Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.