Databricks Platform Engineer - Remote

Agility Technologies Inc; Reston (VA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

401(k) matching

Dental insurance

Health insurance

Paid time off

Parental leave

Vision insurance

Job summary

Agility Technologies Inc. is seeking a Databricks Platform Engineer to build and optimize our enterprise data lakehouse infrastructure.

You will automate Databricks platform operations, manage provisioning, scaling, and cost optimization, and partner with data teams to enable reliable workloads across cloud environments. Responsibilities include designing scalable Databricks architectures, implementing CI/CD for notebooks, enforcing security and governance, and integrating with data sources

Qualifications

• Requires 5+ years in platform engineering or IT operations with Databricks experience.
• Strong Databricks administration and cluster management skills.
• Proficient in Python, Bash, or PowerShell and IaC tooling.
• Experience with cloud providers (Azure, AWS, or GCP) and security/compliance controls.

Responsibilities

• Build and maintain Databricks workspace infrastructure across dev, staging, and prod.
• Design and operate scalable Databricks platforms in cloud environments with cost-efficiency.
• Manage Databricks clusters, autoscaling, monitoring, and troubleshooting.
• Implement CI/CD pipelines for Databricks workflows and notebooks.
• Enforce data security, governance, and compliance per FedRAMP/NIST.
• Collaborate with DevOps to ensure platform reliability and incident response.
• Automate provisioning, upgrades, and scaling with IaC tools.
• Provide cross-team support for integrating Databricks with data sources and tools.

Skills

Platform engineering

Databricks administration

Apache Spark

Python scripting

Infrastructure as Code

CI/CD automation

Cloud networking

Monitoring & logging

Security & compliance (FedRAMP, NIST)

Tools

Terraform

CloudFormation

ARM templates

Databricks

Datadog

CloudWatch

Azure Monitor

Kubernetes

Job description

Agility Technologies Inc. is seeking a Databricks Platform Engineer to build and optimize our enterprise data lakehouse infrastructure.

You will automate Databricks platform operations, manage provisioning, scaling, and cost optimization, and partner with data teams to enable reliable workloads across cloud environments. Responsibilities include designing scalable Databricks architectures, implementing CI/CD for notebooks, enforcing security and governance, and integrating with data sources