Databricks Admin

Black Rock Groups; Branchville (NJ); On-site; USD 100,000 - 115,000; Full time

Job summary

Tech Mahindra is hiring a Databricks Administrator in Branchville, New Jersey for onsite support across development, testing, and production environments. The role manages Databricks workspace, RBAC, and governance, while implementing security controls and automation to streamline operations.

Responsibilities include monitoring platform health, configuring cluster policies, supporting Unity Catalog, and enabling CI/CD practices with IaC.

Qualifications

• Experience with Azure Cloud environments and IAM (SSO, SCIM, RBAC, service principals).
• Proven Databricks cluster management, workspace administration, job orchestration and governance controls.
• Knowledge of networking concepts (VNet/VPC, private endpoints, firewalls, DNS).
• Scripting/automation experience with Python/PowerShell/Bash/Terraform or similar tools.
• Strong monitoring, logging, alerting, and incident response capabilities.

Responsibilities

• Administer and support the Databricks workspace environment across development, test, and production.
• Manage user provisioning, RBAC, service principals, groups, and entitlements.
• Configure and maintain cluster policies, instance pools, job compute, and all-purpose compute resources.
• Monitor platform health, job performance, usage trends, and operational incidents.
• Implement security controls for secrets management, data access, encryption, private connectivity, and audit logging.
• Support Unity Catalog, data governance standards, and workspace-level administration.
• Develop and maintain automation for workspace setup, policy enforcement, monitoring, and administrative tasks.
• Support CI/CD and infrastructure-as-code practices for Databricks deployments and configuration management.
• Troubleshoot platform, connectivity, identity federation, and job execution issues.
• Create and maintain operational documentation, runbooks, standards, and support procedures.
• Understand data engineering workflows using Spark, notebooks, Delta Lake, and job scheduling.

Skills

Databricks admin

RBAC & IAM

Azure Cloud

Scripting & automation

CI/CD

Notebooks & Delta Lake

Security & governance

Observability & incident response

Documentation

Cross-functional collaboration

Tools

Python

PowerShell

Bash

Terraform

Job description

Databricks Admin

Branchville, New Jersey (Onsite)

Key Responsibilities

• Administer and support the Databricks workspace environment across development, test, and production.
• Manage user provisioning, role-based access controls, service principles, groups, and entitlements.
• Configure and maintain cluster policies, instance pools, job compute, and all-purpose compute resources.
• Monitor platform health, job performance, usage trends, and operational incidents.
• Implement security controls for secrets management, data access, encryption, private connectivity, and audit logging.
• Support Unity Catalog, data governance standards, and workspace-level administration.
• Develop and maintain automation for workspace setup, policy enforcement, monitoring, and administrative tasks.
• Support CI/CD and infrastructure-as-code practices for Databricks deployments and configuration management.
• Troubleshoot platform, connectivity, identity federation, and job execution issues.
• Create and maintain operational documentation, runbooks, standards, and support procedures.
• Understanding data engineering workflows using Spark, notebooks, Delta Lake, and job scheduling.

Required Qualifications

• Experience with Azure Cloud.
• Strong understanding of identity and access management, including SSO, SCIM, RBAC, and service principals.
• Experience with Databricks cluster management, workspace administration, job orchestration, and governance controls.
• Knowledge of networking concepts such as VNet/VPC, private endpoints, firewalls, DNS, and secure connectivity.
• Experience with scripting or automation using Python, PowerShell, Bash, Terraform, or similar tools.
• Familiarity with monitoring, logging, alerting, and incident response processes.
• Strong troubleshooting, communication, and cross-functional collaboration skills.

Key Skills

• Databricks Workspace Administration
• Unity Catalog and Governance
• Cluster Policies and Performance Tuning
• Cloud Platform Integration
• Security and Access Management
• Automation and Infrastructure as Code
• Cost Optimization
• Troubleshooting and Operational Support
• Documentation and Cross-Functional Collaboration
• Logic Apps, APIM, App Gateways

The pay range for this role is $100k - $115k per annum including any bonuses or variable pay. Tech Mahindra also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.

Thanks & Regards

Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at [e-mail]."