Remote Databricks Administrator & Platform Security Lead

Changeis, Inc.; United States; On-site; USD 120,000 - 170,000; Full time

Job summary

Changeis, Inc. is seeking an experienced Databricks Administrator to manage and optimize a large enterprise Databricks environment.

The role collaborates with data engineers, data scientists, developers, and security teams to ensure a secure, reliable, scalable platform. The candidate will monitor performance, implement cost controls, and drive CI/CD and IaC practices across development, testing, staging, and production environments.

Qualifications

• At least six years of experience in cloud infrastructure, data platform administration, or a related technical field.
• Hands-on experience administering Databricks in an enterprise environment.
• Experience with Microsoft Azure Databricks, AWS Databricks, or Databricks on Google Cloud.
• Strong understanding of Databricks workspaces, clusters, jobs, notebooks, SQL warehouses, instance pools, and compute policies.
• Experience with Unity Catalog, access controls, identity management, service principals, secrets, and data governance.
• Experience monitoring and troubleshooting Databricks jobs, clusters, integrations, and platform performance.
• Working knowledge of Apache Spark and distributed data-processing concepts.
• Experience with cloud storage, networking, security, and identity-management services.
• Knowledge of SQL and at least one scripting language, such as Python, PowerShell, Bash, or Scala.
• Experience with Git, CI/CD pipelines, and automated deployment processes.
• Experience with Infrastructure as Code tools such as Terraform, ARM templates, Bicep, or CloudFormation.
• Strong troubleshooting, documentation, communication, and stakeholder-management skills.
• Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.

Responsibilities

• Administer and support Databricks workspaces, clusters, jobs, notebooks, pools, SQL warehouses, and related platform services.
• Configure and manage user accounts, groups, roles, permissions, service principals, and access controls.
• Implement and maintain security standards using Unity Catalog, role-based access controls, credential management, and data-governance policies.
• Monitor platform availability, cluster performance, job execution, resource utilization, and system health.
• Troubleshoot failed jobs, cluster issues, connectivity problems, performance bottlenecks, and access-related incidents.
• Configure and optimize clusters, instance pools, autoscaling, and compute policies to improve performance and control costs.
• Support Databricks integrations with cloud storage, databases, business intelligence platforms, APIs, and enterprise applications.
• Manage platform configurations across development, testing, staging, and production environments.
• Support automated deployment and infrastructure-management processes using CI/CD and Infrastructure as Code.
• Develop monitoring dashboards, alerts, audit reports, and operational documentation.
• Conduct platform upgrades, configuration changes, testing, and release activities.
• Partner with cybersecurity and governance teams to support auditing, compliance, logging, and data-protection requirements.
• Establish platform standards, administrative procedures, naming conventions, and operational best practices.
• Provide technical support and guidance to data engineers, analysts, data scientists, and application teams.
• Evaluate platform usage and recommend improvements related to scalability, reliability, performance, and cost optimization.

Skills

Databricks administration

Unity Catalog

Apache Spark

Cloud infrastructure

Cluster management

Performance optimization

Cost management

Platform security

Identity and access management

CI/CD

Infrastructure as Code

Python

SQL

Terraform

Monitoring

Troubleshooting

Data governance

Technical documentation

Education

Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field

Tools

Git

Azure DevOps

GitHub Actions

Jenkins

Terraform

CloudFormation

Bicep

ARM templates

PowerShell

Job description

Changeis, Inc. is seeking an experienced Databricks Administrator to manage and optimize a large enterprise Databricks environment.

The role collaborates with data engineers, data scientists, developers, and security teams to ensure a secure, reliable, scalable platform. The candidate will monitor performance, implement cost controls, and drive CI/CD and IaC practices across development, testing, staging, and production environments.