Senior Databricks Platform Engineer - Remote

ICF; Reston (VA); Remote; USD 99,000 - 203,000; Full time

Job summary

ICF is seeking a Senior Databricks Platform Engineer to design, build, secure, and operate governed Azure Databricks Lakehouse capabilities for a US Government Agency. You will support a cloud-based analytics platform, enterprise AI operations, and data initiatives in a remote-capable role.

Your work will include building scalable ETL/ELT pipelines, implementing medallion and governance architectures, and automating deployments with Terraform and DevOps tools.

Qualifications

• Minimum 5 years data engineering experience.
• At least 3 years supporting Azure Databricks and related Azure data services.
• Experience with large-scale ETL/ELT pipelines.

Responsibilities

• Design, configure and operate Azure Databricks workspaces, clusters, and governance.
• Build and optimize batch and streaming data pipelines using Python, Spark, SQL.
• Implement medallion architecture, data quality checks, and schema evolution.
• Configure Unity Catalog governance and secure access to storage and data assets.
• Automate deployments with Terraform, GitHub Actions, or Azure DevOps.

Skills

Azure Databricks

Python

SQL

Delta Lake

Scala

Spark

CI/CD

Terraform

GitHub Actions

Azure DevOps

Security governance

Education

BA/BS/MS in Computer Science or related field

Tools

Databricks

Azure Data Factory

Azure Data Lake Storage

Azure Synapse Analytics

Delta Live Tables

PowerShell

Job description

ICF is seeking a Senior Databricks Platform Engineer to design, build, secure, and operate governed Azure Databricks Lakehouse capabilities for a US Government Agency. You will support a cloud-based analytics platform, enterprise AI operations, and data initiatives in a remote-capable role.

Your work will include building scalable ETL/ELT pipelines, implementing medallion and governance architectures, and automating deployments with Terraform and DevOps tools.