Azure Databricks Platform Lead — Remote

Cognizant; Atlanta (GA); On-site; USD 110,000 - 160,000; Full time

Benefits offered by this job

Medical Insurance

401(k) Plan

Paid Time Off

Parental Leave

Flexible remote work environment

Job summary

Cognizant in the United States is seeking an Azure Databricks Administrator to join our Cloud, Data & AI practice. You will lead administration, governance, security, and optimization of enterprise Azure Databricks environments, partnering with engineering, security, and operations teams to deliver a scalable data platform.

The ideal candidate has deep expertise in Azure Databricks, Unity Catalog, networking, and data governance, and is comfortable operating in a remote-first US context.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• 5+ years of experience supporting cloud-based data and analytics platforms.
• Hands-on experience administering Azure Databricks in enterprise environments.
• Strong experience with Azure Databricks, Unity Catalog, Azure networking, security, governance.
• Proficiency in Python, SQL, PowerShell, and Azure CLI.
• Experience supporting CI/CD initiatives using Azure DevOps, GitHub Actions, or similar.
• Excellent analytical, troubleshooting, and problem-solving skills.
• Strong verbal and written communication skills.

Responsibilities

• Design, deploy, and administer Azure Databricks workspaces utilizing VNet injection, private endpoints, and secure cluster connectivity.
• Configure and maintain cluster policies, Databricks Runtime versions, autoscaling, and workload management standards.
• Optimize platform performance through cluster tuning, Spark configuration management, and Delta Lake best practices.
• Perform capacity planning and resource forecasting to support enterprise growth.
• Drive cost optimization initiatives including right-sizing, auto-termination policies, reserved instances, and spot instance utilization.
• Troubleshoot and resolve complex platform, cluster, job execution, and connectivity issues.
• Design, implement, and administer Unity Catalog metastores, catalogs, schemas, external locations, and volumes.
• Establish and enforce fine-grained access controls across enterprise data assets.
• Support data lineage tracking, auditing, and governance requirements.
• Govern managed and external data assets while promoting best practices for data management.
• Integrate Azure Databricks with Microsoft Entra ID for authentication and SSO.
• Configure and manage SCIM provisioning for automated user and group lifecycle management.
• Implement secure secret management using Azure Key Vault-backed secret scopes.
• Define and manage access controls across Unity Catalog, Databricks workspaces, and Azure Data Lake Storage Gen2.
• Support security audits, compliance reviews, and governance initiatives.

Skills

Strong analytical skills

Excellent communication

Problem-solving

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Databricks

Azure Data Factory

ADLS Gen2

Microsoft Entra ID

Azure Key Vault

Azure Networking

Azure Monitor

Python

SQL

Azure CLI

Job description

Cognizant in the United States is seeking an Azure Databricks Administrator to join our Cloud, Data & AI practice. You will lead administration, governance, security, and optimization of enterprise Azure Databricks environments, partnering with engineering, security, and operations teams to deliver a scalable data platform.

The ideal candidate has deep expertise in Azure Databricks, Unity Catalog, networking, and data governance, and is comfortable operating in a remote-first US context.