Lakehouse Architect & Databricks SME | Enterprise Data Lead

CACI International Inc; Washington (District of Columbia); On-site; USD 140,000 - 190,000; Full time

Job summary

CACI International Inc. is seeking a Lakehouse Architect / Databricks SME to lead the design and deployment of a secure, scalable data lakehouse on Azure for DHS/OIG in a government cloud environment.

You will shape the data foundation for AI, analytics, and investigative workflows, integrating Delta Lake, Unity Catalog, and medallion architecture. You will guide data cataloging, tiered storage, and compute configurations, while enabling governance, lineage, and self-service analytics across

Qualifications

• Bachelor's degree in a data/ IT field with 15+ years of relevant experience (equivalencies considered).
• Ability to obtain DHS/EOD clearance as required.
• Deep expertise in Azure Databricks for lakehouse solutions using Delta Lake, Unity Catalog, and medallion patterns.
• Experience designing enterprise data platforms supporting SQL analytics, notebooks (Python/R/Scala), ML, and visualization.
• Strong data modeling across dimensional, relational, graph, and lakehouse architectures.
• Hands-on experience with Azure Data Lake Storage, PySpark, SQL, compute configuration, and cloud cost management.

Responsibilities

• Lead design and implementation of a secure, scalable enterprise data lakehouse platform using Azure Databricks, ADLS, Delta Lake, Unity Catalog.
• Architect lakehouse storage zones with raw/bronze, curated/silver, analytics-ready/gold layers and governance at each layer.
• Configure environments including workspace architecture, cluster strategies, autoscaling, job orchestration, and cost optimization.
• Implement data catalog integration, metadata management, and SQL-accessible tables/views for governed discovery and lineage.
• Support analytical models including relational warehousing, graph analyses, geospatial analytics, and ML feature engineering.
• Modernize analyst workflows from desktop tools to cloud-based notebooks, SQL analytics, and platform-native tools.
• Provide expertise and surge support for complex data architecture, performance optimization, and specialized analytics needs.
• Develop ML engineering infra including MLflow, feature stores, training environments, and Databricks-AI integration.

Skills

Azure Databricks

Delta Lake

Unity Catalog

Medallion Architecture

SQL Analytics

Python

R

Scala

Data Modeling

Data Governance

Education

Bachelor's degree

Tools

Azure Data Lake Storage

PySpark

Azure Databricks

SQL

Job description

CACI International Inc. is seeking a Lakehouse Architect / Databricks SME to lead the design and deployment of a secure, scalable data lakehouse on Azure for DHS/OIG in a government cloud environment.

You will shape the data foundation for AI, analytics, and investigative workflows, integrating Delta Lake, Unity Catalog, and medallion architecture. You will guide data cataloging, tiered storage, and compute configurations, while enabling governance, lineage, and self-service analytics across