Databricks Admin

Machine Learning Technologies, LLC; New Jersey; On-site; USD 90,000 - 128,000; Full time

Job summary

Machine Learning Technologies, LLC in Branchville, NJ is seeking an experienced Databricks Platform Administrator to manage, secure, and support enterprise Databricks workspaces across development, testing, and production environments.

Responsibilities include workspace administration, RBAC, cluster policy management, Unity Catalog, automation, IaC, and CI/CD support, with collaboration across data engineering, security, and cloud teams.

Qualifications

• Experience administering Databricks platforms across development, testing and production environments.
• Strong knowledge of workspace administration, RBAC, Unity Catalog, and security controls.

Responsibilities

• Administer and support Databricks workspaces across development, test, and production environments.
• Manage user provisioning, RBAC, service principals, groups, and entitlements.
• Configure and maintain cluster policies, instance pools, job compute, and all-purpose compute resources.
• Monitor platform health, job performance, resource utilization, and incidents.
• Implement security controls for secrets, data access, encryption, private connectivity, and audit logging.
• Manage Unity Catalog and data governance standards.
• Develop automation for workspace provisioning, policy enforcement, monitoring, and admin tasks.
• Support CI/CD pipelines and IaC for Databricks deployments and config management.
• Troubleshoot platform, connectivity, identity federation, and job execution issues.
• Optimize cluster performance, resource utilization, and platform costs.
• Work with data engineering workflows involving Spark, notebooks, Delta Lake, and job scheduling.
• Collaborate with data engineering, cloud infrastructure, security, and application teams.

Tools

Databricks

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title:Databricks Admin
Location:Branchville,NJ
Duration: 11 Months + Extension
Bill Rate: $79/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description

We are seeking an experienced Databricks Platform Administrator to manage, secure, and support enterprise Databricks workspaces across development, testing, and production environments. The candidate will be responsible for workspace administration, access management, cluster configuration, security, automation, governance, and operational support.

Key Responsibilities:

• Administer and support Databricks workspaces across development, test, and production environments.
• Manage user provisioning, role-based access control (RBAC), service principals, groups, and user entitlements.
• Configure and maintain cluster policies, instance pools, job compute, and all-purpose compute resources.
• Monitor platform health, job performance, resource utilization, and operational incidents.
• Implement security controls for secrets management, data access, encryption, private connectivity, and audit logging.
• Manage Unity Catalog, data governance standards, and workspace-level administration.
• Develop automation for workspace provisioning, policy enforcement, monitoring, and administrative tasks.
• Support CI/CD pipelines and Infrastructure as Code (IaC) for Databricks deployments and configuration management.
• Troubleshoot platform, connectivity, identity federation, and job execution issues.
• Optimize cluster performance, resource utilization, and platform costs.
• Work with data engineering workflows involving Apache Spark, notebooks, Delta Lake, and job scheduling.
• Manage and support cloud platform integrations.
• Work with Logic Apps, Azure API Management (APIM), and Application Gateways.
• Create and maintain operational documentation, runbooks, standards, and support procedures.
• Collaborate with data engineering, cloud infrastructure, security, and application teams.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.