Databricks admin

Infosys; Dadri, Chennai District, Mumbai; Hybrid; INR 1,500,000 - 2,300,000; Full time

Job summary

Infosys is seeking a Databricks Platform Administrator to manage Databricks workspaces across development, testing and production. You will administer clusters, job scheduling, Unity Catalog, RBAC, and security policies to ensure scalable, compliant data platforms.

You will monitor health and performance, troubleshoot issues, perform migrations, and implement governance, cost optimization. Collaboration with Data Engineers and DevOps teams and CI/CD integrations using Azure DevOps, GitHub

Qualifications

• 3-5 years experience in Databricks administration and support.
• Strong knowledge of Databricks workspace management, clusters, jobs, and notebooks.
• Experience with Unity Catalog, Data Governance, and Security Administration.
• Hands-on experience with Azure Databricks, AWS Databricks, or GCP Databricks.
• Knowledge of Spark, PySpark, and SQL.
• Experience with cloud platforms (Azure/AWS/GCP).
• Understanding of IAM, RBAC, SSO, SCIM provisioning, and access management.
• Experience in monitoring and troubleshooting distributed data platforms.
• Familiarity with Git, CI/CD pipelines, and Infrastructure as Code concepts.
• Good understanding of data lake and cloud storage technologies.

Responsibilities

• Administer and maintain Databricks workspaces across development, testing, and production environments.
• Manage Databricks clusters, cluster policies, pools, jobs, and notebooks.
• Configure and maintain user access, RBAC, Unity Catalog, and security policies.
• Monitor platform health, cluster utilization, job performance, and resource consumption.
• Troubleshoot Databricks platform issues and provide timely resolution.
• Implement best practices for governance, security, compliance, and cost optimization.
• Manage integrations with cloud services such as Azure AD, AWS IAM, Key Vault, Secrets Manager, and cloud storage.
• Support CI/CD implementations using Azure DevOps, GitHub Actions, or Jenkins.
• Collaborate with Data Engineers, Data Scientists, and DevOps teams to ensure platform stability and scalability.
• Perform workspace migrations, upgrades, and environment setup activities.
• Create and maintain operational documentation, runbooks, and SOPs.

Skills

Databricks administration

Workspace management

RBAC & Unity Catalog

Cloud Databricks (Azure/AWS/GCP)

Spark / PySpark / SQL

Cloud platforms (Azure/AWS/GCP)

IAM/SSO/SCIM

CI/CD pipelines

Git

Infrastructure as Code

Data governance

Security policies

Tools

Azure DevOps

GitHub Actions

Jenkins

Terraform

Job description

Experience: 3-5 Years

Location: PAN India

Employment Type: Full-Time

• Administer and maintain Databricks workspaces across development, testing, and production environments.
• Manage Databricks clusters, cluster policies, pools, jobs, and notebooks.
• Configure and maintain user access, RBAC, Unity Catalog, and security policies.
• Monitor platform health, cluster utilization, job performance, and resource consumption.
• Troubleshoot Databricks platform issues and provide timely resolution.
• Implement best practices for governance, security, compliance, and cost optimization.
• Manage integrations with cloud services such as Azure AD, AWS IAM, Key Vault, Secrets Manager, and cloud storage.
• Support CI/CD implementations using Azure DevOps, GitHub Actions, or Jenkins.
• Collaborate with Data Engineers, Data Scientists, and DevOps teams to ensure platform stability and scalability.
• Perform workspace migrations, upgrades, and environment setup activities.
• Create and maintain operational documentation, runbooks, and SOPs.

Required Skills

• 35 years of experience in Databricks administration and support.
• Strong knowledge of Databricks workspace management, clusters, jobs, and notebooks.
• Experience with Unity Catalog, Data Governance, and Security Administration.
• Hands-on experience with Azure Databricks, AWS Databricks, or GCP Databricks.
• Knowledge of Spark, PySpark, and SQL.
• Experience with cloud platforms (Azure/AWS/GCP).
• Understanding of IAM, RBAC, SSO, SCIM provisioning, and access management.
• Experience in monitoring and troubleshooting distributed data platforms.
• Familiarity with Git, CI/CD pipelines, and Infrastructure as Code concepts.
• Good understanding of data lake and cloud storage technologies.