Remote Databricks Platform Engineer

Agility Technologies Inc; United States; Remote; USD 140,000 - 210,000; Full time

Benefits offered by this job

401(k) matching

Dental insurance

Health insurance

Paid time off

Parental leave

Vision insurance

Job summary

Agility Technologies Inc. is seeking a Databricks Platform Engineer to build, maintain, and optimize our enterprise data lakehouse infrastructure in a remote role.

You will automate platform provisioning, manage Databricks clusters, and collaborate with DevOps to ensure reliability and cost-efficiency across development, staging, and production environments. The ideal candidate has 5+ years in platform engineering or IT operations, strong Databricks administration, Spark expertise, and

Qualifications

• 5+ years in platform engineering or IT ops with Databricks experience.
• Strong Databricks administration and job orchestration knowledge.

Responsibilities

• Build and maintain Databricks workspace infrastructure across dev, staging, and production.
• Design and maintain Databricks platforms in cloud environments (Azure, AWS, GCP) for scalability and cost‑efficiency.
• Manage and optimize Databricks clusters, including autoscaling, resource allocation, monitoring, and troubleshooting.
• Implement CI/CD pipelines for deploying Databricks workflows and notebooks; monitor performance, logging, and health.
• Implement robust data security and governance per org policies; troubleshoot platform issues with cross‑functional teams.
• Automate provisioning, upgrades, and scaling using IaC tools (Terraform, CloudFormation).
• Enable data engineers/scientists with Databricks integrations to various data sources and tools.
• Stay updated with Databricks features and best practices to meet evolving business needs.

Skills

Databricks admin

Cluster management

Cloud platforms

Python scripting

Terraform

CI/CD pipelines

Security & auditing

Monitoring tools

Data governance

Spark tech

Tools

Terraform

CloudFormation

ARM templates

Databricks

Job description

Agility Technologies Inc. is seeking a Databricks Platform Engineer to build, maintain, and optimize our enterprise data lakehouse infrastructure in a remote role.

You will automate platform provisioning, manage Databricks clusters, and collaborate with DevOps to ensure reliability and cost-efficiency across development, staging, and production environments. The ideal candidate has 5+ years in platform engineering or IT operations, strong Databricks administration, Spark expertise, and