Databricks Administrator

CloudIngest; United States; Remote; USD 140,000 - 180,000; Full time

Job summary

CloudIngest is seeking a hands-on Senior Databricks Platform Administrator to manage and support enterprise Databricks environments, including Unity Catalog, clusters, and security controls. You will automate administrative tasks with Python, SQL, APIs, Terraform, and CI/CD, optimize performance and cost, and integrate Databricks with cloud services.

The role is remote within the United States and requires 5+ years of platform administration and 3+ years in Databricks.

Qualifications

• 5+ years of platform administration or cloud engineering experience.
• 3+ years of hands-on Databricks administration experience.
• Strong expertise with Unity Catalog, Databricks Compute & SQL Warehouses, IAM/RBAC and security controls.
• Proficiency in Python, SQL, REST APIs and working with Azure or AWS.
• Experience with Terraform and CI/CD pipelines.
• Familiarity with Apache Spark and Delta Lake.
• Networking, SSO and identity integrations.

Responsibilities

• Administer Databricks workspaces, clusters, Unity Catalog, permissions, and access controls.
• Manage storage credentials, external locations, catalogs, and data security policies.
• Support Databricks compute, SQL Warehouses, and serverless environments.
• Perform platform upgrades, patching, and environment maintenance.
• Troubleshoot platform, networking, authentication, and performance issues.
• Integrate Databricks with Azure/AWS services, databases, APIs, and external systems.
• Automate administrative processes using Python, SQL, APIs, Terraform, and CI/CD tools.
• Monitor platform health, utilization, performance, and cost optimization.

Skills

Databricks admin

Unity Catalog

SQL Warehouses

IAM RBAC

Python

SQL

REST APIs

Azure AWS

Terraform

CI/CD pipelines

Apache Spark

Delta Lake

Networking

SSO OAuth

Cloud platforms

Tools

Jenkins

GitHub

Infrastructure as Code

Job description

Senior Databricks Platform Administrator

Location : Remote,United States

Job Summary

We are seeking a hands-on Senior Databricks Platform Administrator to manage and support enterprise Databricks environments. The ideal candidate will have strong experience in platform administration, security, governance, automation, performance optimisation, and cloud infrastructure.

Key Responsibilities

• Administer Databricks workspaces, clusters, Unity Catalog, permissions, and access controls.
• Manage storage credentials, external locations, catalogs, and data security policies.
• Support Databricks compute, SQL Warehouses, and serverless environments.
• Perform platform upgrades, patching, and environment maintenance.
• Troubleshoot platform, networking, authentication, and performance issues.
• Integrate Databricks with Azure/AWS services, databases, APIs, and external systems.
• Automate administrative processes using Python, SQL, APIs, Terraform, and CI/CD tools.
• Monitor platform health, utilization, performance, and cost optimization.

Required Skills

• 5+ years of platform administration or cloud engineering experience.
• 3+ years of hands-on Databricks administration experience.
• Strong expertise with:
• Unity Catalog
• Databricks Compute & SQL Warehouses
• IAM / RBAC and security controls
• Python, SQL, REST APIs
• Azure or AWS cloud platforms
• Terraform and CI/CD pipelines
• Apache Spark and Delta Lake
• Networking, SSO, OAuth and identity integrations

Preferred Qualifications

• Databricks certification(s)
• Experience with Jenkins, GitHub, and Infrastructure as Code
• Strong troubleshooting and stakeholder communication skills