Databricks Admin

Valiant Technologies LLC; New Jersey; On-site; USD 83,000 - 138,000; Full time

Job summary

Valiant Technologies LLC in Branchville, NJ seeks an experienced Databricks Platform Administrator to manage, secure, and support enterprise Databricks workspaces across dev, test, and production environments. You will handle workspace administration, access control, cluster configuration, security, governance, and automation.

The role covers Unity Catalog, data governance, and CI/CD with IaC for deployments.

Qualifications

• Experience administering Databricks workspaces across development, testing and production.
• Experience with RBAC, service principals, groups and entitlements.

Responsibilities

• Administer and support Databricks workspaces across development, test, and production environments.
• Configure and maintain cluster policies, instance pools, and compute resources.
• Monitor platform health, performance, resource utilization, and incidents.
• Implement security controls for secrets, encryption, private connectivity, and audit logging.
• Manage Unity Catalog and data governance standards.
• Develop automation for workspace provisioning, policy enforcement, monitoring, and admin tasks.
• Support CI/CD pipelines and IaC for Databricks deployments and configuration management.
• Troubleshoot platform connectivity, identity federation, and job execution issues.
• Optimize cluster performance and costs.

Skills

Databricks administration

RBAC management

Automation and IaC

Cloud governance

Tools

Databricks

Azure Cloud

Unity Catalog

Azure Logic Apps

Azure API Management

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title:Databricks Admin
Location:Branchville,NJ
Duration: 11 Months + Extension
Bill Rate: $79/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description

We are seeking an experienced Databricks Platform Administrator to manage, secure, and support enterprise Databricks workspaces across development, testing, and production environments. The candidate will be responsible for workspace administration, access management, cluster configuration, security, automation, governance, and operational support.

Key Responsibilities:

• Administer and support Databricks workspaces across development, test, and production environments.
• Manage user provisioning, role-based access control (RBAC), service principals, groups, and user entitlements.
• Configure and maintain cluster policies, instance pools, job compute, and all-purpose compute resources.
• Monitor platform health, job performance, resource utilization, and operational incidents.
• Implement security controls for secrets management, data access, encryption, private connectivity, and audit logging.
• Manage Unity Catalog, data governance standards, and workspace-level administration.
• Develop automation for workspace provisioning, policy enforcement, monitoring, and administrative tasks.
• Support CI/CD pipelines and Infrastructure as Code (IaC) for Databricks deployments and configuration management.
• Troubleshoot platform, connectivity, identity federation, and job execution issues.
• Optimize cluster performance, resource utilization, and platform costs.
• Work with data engineering workflows involving Apache Spark, notebooks, Delta Lake, and job scheduling.
• Manage and support cloud platform integrations.
• Work with Logic Apps, Azure API Management (APIM), and Application Gateways.
• Create and maintain operational documentation, runbooks, standards, and support procedures.
• Collaborate with data engineering, cloud infrastructure, security, and application teams.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.