Senior Azure Databricks Platform Engineer - Remote

IIIIIIUS; Virginia; Remoto; USD 99.000 - 203.000; Tempo pieno

Descrizione del lavoro

ICF seeks a Senior Databricks Platform Engineer to design, build, secure, and operate governed Azure Databricks Lakehouse capabilities supporting a cloud-based analytics platform and enterprise AI operations. You will develop reliable batch and streaming pipelines, administer workspaces and access, and automate delivery through infrastructure as code and CI/CD.

Remote work is available for this federal contract, with collaboration across data engineers, cloud architects, security analysts, and

Competenze

• More than 5 years of data engineering experience.
• At least 3 years supporting Azure Databricks and related Azure data services.
• Experience with CI/CD or infrastructure as code.

Mansioni

• Design, configure, and operate Azure Databricks workspaces and governance.
• Build and optimize batch and real-time pipelines using PySpark, SQL, and Delta Lake.
• Implement medallion architecture, data quality checks, and reproducible processing patterns.
• Automate Databricks deployments with Terraform, GitHub Actions, or Azure DevOps.
• Monitor health and security; support deployment and operational readiness.

Conoscenze

Azure Databricks

Python

SQL

CI/CD

Terraform

Formazione

BA/BS/MS in Computer Science, Engineering, Data Science

Strumenti

Terraform

Databricks Asset Bundles

GitHub Actions

Azure DevOps

ADLS Gen2

Descrizione del lavoro

ICF seeks a Senior Databricks Platform Engineer to design, build, secure, and operate governed Azure Databricks Lakehouse capabilities supporting a cloud-based analytics platform and enterprise AI operations. You will develop reliable batch and streaming pipelines, administer workspaces and access, and automate delivery through infrastructure as code and CI/CD.

Remote work is available for this federal contract, with collaboration across data engineers, cloud architects, security analysts, and