Databricks Platform Engineer — DataOps & CI/CD

OpenTalent; McLean (VA); On-site; USD 120,000 - 160,000; Full time

Job summary

OpenTalent in McLean is seeking a Databricks Platform Engineer to design, build, and optimize the infrastructure and DataOps workflows powering a high-impact Fortune 500 client program.

You will leverage Databricks, Terraform/Terragrunt, Python, and SQL to scale data environments, implement CI/CD, observability, budget governance, and secure AI integrations within a 70+ person cross-functional team. U.S. citizenship is required.

Qualifications

• 2+ years of experience with Python and SQL, and interacting with REST APIs and CLI tools to manage infrastructure.
• 2+ years of experience with Databricks platform architecture, administration, and distributed processing environments.
• 2+ years of experience implementing Infrastructure as Code (IaC) utilizing Terraform and Terragrunt
• Experience designing CI/CD pipelines and DataOps workflows utilizing GitHub and GitHub Actions
• Experience implementing platform observability, logging, and operational monitoring utilizing Splunk or Dynatrace
• Experience navigating enterprise governance, managing change requests, and supporting auditable applications
• Bachelor's degree

Responsibilities

• Design, build, and optimize data infrastructure and DataOps workflows for a Fortune 500 client program.
• Scale and govern data environments with Databricks, IaC, and cloud resources.
• Drive CI/CD automation, platform observability, and cost governance within a cross-functional team.

Skills

Python

SQL

REST APIs

CLI Tools

Databricks

Terraform

Terragrunt

GitHub Actions

Observability

Dynatrace

Splunk

Governance

Education

Bachelor's degree

Tools

GitHub

Terraform

Terragrunt

Job description

OpenTalent in McLean is seeking a Databricks Platform Engineer to design, build, and optimize the infrastructure and DataOps workflows powering a high-impact Fortune 500 client program.

You will leverage Databricks, Terraform/Terragrunt, Python, and SQL to scale data environments, implement CI/CD, observability, budget governance, and secure AI integrations within a 70+ person cross-functional team. U.S. citizenship is required.