Databricks Lakehouse Architect — DoD Data Modernization

CSCI Consulting, Inc.; Indianapolis (IN); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

PTO

Federal holidays

Health benefits

Team building

Job summary

CSCI Consulting, Inc. seeks a Databricks Subject Matter Expert to lead data modernization efforts for a Department of War client. You will architect and implement lakehouse data platforms, governance, and analytics pipelines across Azure/AWS, with emphasis on Delta Lake, Unity Catalog, and CI/CD practices.

The role requires hands-on Databricks and Spark experience, strong SQL/Python skills, and the ability to collaborate with stakeholders, architects, and engineers in a multi-cloud environment.

Qualifications

• Minimum 7+ years in data engineering and data platform initiatives.
• Strong expertise with Databricks Lakehouse Platform and Delta Lake.
• Proficient in SQL, Python, and PySpark; experience with large-scale data processing.
• U.S. Citizenship and ability to obtain security clearance is required where mandated.

Responsibilities

• Serve as the primary Databricks SME for enterprise data and analytics initiatives.
• Design, develop, and optimize scalable data platforms using Databricks Lakehouse architecture.
• Lead data engineering, integration, and transformation using Databricks and Spark.
• Implement Medallion Architecture bronze-silver-gold data layers.
• Develop and maintain ETL/ELT pipelines for structured and unstructured data.

Skills

Databricks

Apache Spark

SQL

Python

Cloud (Azure/AWS)

Data governance

CI/CD

Delta Lake

Tools

Delta Lake

Unity Catalog

Databricks Workflows

Delta Live Tables

SQL tooling

Job description

CSCI Consulting, Inc. seeks a Databricks Subject Matter Expert to lead data modernization efforts for a Department of War client. You will architect and implement lakehouse data platforms, governance, and analytics pipelines across Azure/AWS, with emphasis on Delta Lake, Unity Catalog, and CI/CD practices.

The role requires hands-on Databricks and Spark experience, strong SQL/Python skills, and the ability to collaborate with stakeholders, architects, and engineers in a multi-cloud environment.