Hybrid Lakehouse Architect & Databricks SME (Azure)

CACI International Inc; Washington (District of Columbia); Hybrid; USD 104,000 - 218,000; Full time

Benefits offered by this job

Flexible time off

Job summary

CACI International Inc seeks a Lakehouse Architect/Databricks SME to design a secure, scalable data lakehouse in Azure for DHS/OIG mission analytics. Lead architecture across Databricks, Delta Lake, and Unity Catalog, enabling ML, graph, and geospatial analytics in government cloud environments.

You will implement tiered storage, data cataloging, and governance while supporting analyst workflows from local to cloud-based notebooks and SQL analytics.

Qualifications

• Bachelor's degree + significant experience in data architecture/engineering or related field.
• US Citizenship with ability to obtain a Public Trust clearance.
• Proven expertise in Azure Databricks and lakehouse architectures using Delta Lake and Unity Catalog.
• Experience with Azure Data Lake Storage, PySpark, SQL, and cost optimization for cloud analytics.
• Background in federated, secure government cloud environments is a plus.

Responsibilities

• Lead design and implementation of a secure, scalable enterprise lakehouse platform using Azure Databricks, Delta Lake, and Unity Catalog.
• Architect tiered storage zones (raw/bronze, curated/silver, analytics-ready/gold) with quality and governance controls.
• Configure workspace architecture, compute clusters, autoscaling, job orchestration, and cost management.
• Design data catalog integration, metadata management, and SQL-accessible tables/views for governance and self-service analytics.
• Support ML/AI workloads, feature engineering, and MLflow integration; enable MLOps pipelines.
• Collaborate with stakeholders to align architecture with mission analytics, data governance, and Agile delivery.

Skills

Azure Databricks

Delta Lake

Unity Catalog

Lakehouse architecture

SQL analytics

Python (PySpark)

MLOps

Data governance

Education

Bachelor's degree

Tools

Azure Data Lake Storage

Databricks

MLflow

Unity Catalog

Job description

CACI International Inc seeks a Lakehouse Architect/Databricks SME to design a secure, scalable data lakehouse in Azure for DHS/OIG mission analytics. Lead architecture across Databricks, Delta Lake, and Unity Catalog, enabling ML, graph, and geospatial analytics in government cloud environments.

You will implement tiered storage, data cataloging, and governance while supporting analyst workflows from local to cloud-based notebooks and SQL analytics.