Databricks Platform Engineer - Changeis, Inc.

OpenTalent; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

OpenTalent is seeking an experienced Databricks Platform Engineer to manage, secure, and optimize an enterprise Databricks environment in a remote setting. You will collaborate with data engineers, data scientists, and security teams to ensure the platform is secure, reliable, scalable, and cost-effective.

You will lead platform upgrades, monitor performance, and drive CI/CD-, IaC-driven deployments across development, testing, staging, and production environments.

Qualifications

• Six years of experience in cloud data platforms, platform administration, or related field.
• Hands-on administering Databricks in an enterprise environment.
• Experience with Azure Databricks, AWS Databricks, or Databricks on Google Cloud.

Responsibilities

• Administer and support Databricks workspaces and clusters.
• Configure user accounts, groups, roles, permissions, and access controls.
• Implement security standards using Unity Catalog and RBAC.

Skills

Databricks

Cloud data platforms

Platform administration

CI/CD

Security & governance

Tools

Azure Databricks

AWS Databricks

Databricks on GCP

CI/CD tooling

Job description

Databricks Platform Engineer

Location: Remote

Position Overview

We are seeking an experienced candidate to manage, maintain, secure, and optimize our enterprise Databricks environment. The ideal candidate will have at least six years of experience in cloud data platforms, data engineering infrastructure, or platform administration, including strong hands-on experience supporting Databricks.

The Databricks Administrator will work closely with data engineers, data scientists, developers, security teams, and cloud infrastructure teams to ensure the platform is secure, reliable, scalable, and cost-effective.

Key Responsibilities

• Administer and support Databricks workspaces, clusters, jobs, notebooks, pools, SQL warehouses, and related platform services.
• Configure and manage user accounts, groups, roles, permissions, service principals, and access controls.
• Implement and maintain security standards using Unity Catalog, role‑based access controls, credential management, and data‑governance policies.
• Monitor platform availability, cluster performance, job execution, resource utilization, and system health.
• Troubleshoot failed jobs, cluster issues, connectivity problems, performance bottlenecks, and access‑related incidents.
• Configure and optimize clusters, instance pools, autoscaling, and compute policies to improve performance and control costs.
• Support Databricks integrations with cloud storage, databases, business intelligence platforms, APIs, and enterprise applications.
• Manage platform configurations across development, testing, staging, and production environments.
• Support automated deployment and infrastructure‑management processes using CI/CD and Infrastructure as Code.
• Develop monitoring dashboards, alerts, audit reports, and operational documentation.
• Conduct platform upgrades, configuration changes, testing, and release activities.
• Partner with cybersecurity and governance teams to support auditing, compliance, logging, and data‑protection requirements.
• Establish platform standards, administrative procedures, naming conventions, and operational best practices.
• Provide technical support and guidance to data engineers, analysts, data scientists, and application teams.
• Evaluate platform usage and recommend improvements related to scalability, reliability, performance, and cost optimization.

Required Qualifications

• At least six years of experience in cloud infrastructure, data platform administration, database administration, DevOps, data engineering, or a related technical field.
• Hands‑on experience administering Databricks in an enterprise environment.
• Experience with Microsoft Azure Databricks, AWS Databricks, or Databricks on Google Cloud.