Remote Databricks Platform Engineer - Scale & Secure Ops

Changeis; United States; Remote; USD 130.000 - 190.000; Vollzeit

Zusammenfassung

Changeis is seeking an experienced Databricks administrator to manage and optimize a large-scale enterprise Databricks environment remotely in the United States. You will collaborate with data engineers, scientists, developers, and security teams to ensure a secure, reliable, scalable, and cost-efficient platform.

The role requires hands-on administration of workspaces, clusters, jobs, notebooks, and SQL warehouses, plus strong skills in Unity Catalog, RBAC, and IaC tooling.

Qualifikationen

• Six years of experience in cloud data platforms or related field.
• Hands-on administering Databricks in an enterprise environment.
• Experience with Azure Databricks, AWS Databricks, or Databricks on Google Cloud.

Aufgaben

• Administer Databricks workspaces, clusters, jobs, notebooks, pools, SQL warehouses, and related platform services.
• Configure and manage user accounts, groups, roles, permissions, service principals, and access controls.
• Implement and maintain security standards using Unity Catalog, RBAC, credential management, and data governance policies.
• Monitor platform availability, cluster performance, job execution, resource utilization, and system health.
• Troubleshoot failed jobs, cluster issues, connectivity problems, performance bottlenecks, and access-related incidents.
• Configure and optimize clusters, instance pools, autoscaling, and compute policies to improve performance and cost control.
• Support Databricks integrations with cloud storage, databases, BI platforms, APIs, and enterprise apps.
• Manage platform configurations across development, testing, staging, and production environments.
• Support automated deployment and infrastructure-management processes using CI/CD and IaC.
• Develop monitoring dashboards, alerts, audit reports, and operational documentation.
• Conduct platform upgrades, configuration changes, testing, and release activities.
• Partner with cybersecurity and governance teams to support auditing, logging, and data-protection requirements.
• Establish platform standards, administrative procedures, naming conventions, and operational best practices.
• Provide technical support and guidance to data engineers, analysts, data scientists, and application teams.
• Evaluate platform usage and recommend improvements related to scalability, reliability, performance, and cost optimization.

Kenntnisse

Databricks administration

Unity Catalog

Apache Spark

CI/CD pipelines

Infrastructure as Code

Python

SQL

Terraform

Git

Ausbildung

Bachelor's degree

Tools

Terraform

ARM templates

Bicep

CloudFormation

Git

PowerShell

Jobbeschreibung

Changeis is seeking an experienced Databricks administrator to manage and optimize a large-scale enterprise Databricks environment remotely in the United States. You will collaborate with data engineers, scientists, developers, and security teams to ensure a secure, reliable, scalable, and cost-efficient platform.

The role requires hands-on administration of workspaces, clusters, jobs, notebooks, and SQL warehouses, plus strong skills in Unity Catalog, RBAC, and IaC tooling.