Remote Databricks Data Engineer — DoD-Cleared

Peraton; Milford Mill (MD); Remote; USD 120,000 - 160,000; Full time

Job summary

Peraton is seeking a Databricks Data Engineer for a Government-owned Databricks workspace. You will design and implement data pipelines from core agency systems, enable Unity Catalog governance, and configure MLflow for ML workflows.

You will document architectures, data dictionaries, and sustainment procedures, while ensuring secure handling of CUI/PII and compliance with DoD requirements. This is a 100% remote position supporting national initiatives.

Qualifications

• 5 years work experience with BS/BA; 3 years with MS/MA
• US Citizenship and active DoD Secret clearance
• 2 years working on the Databricks platform
• Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing and pipeline development
• Hands-on experience with Unity Catalog administration, including metastore management, access policies, and data lineage
• Experience with pipeline orchestration tools (Airflow, Databricks Workflows)
• Experience with Delta Lake, schema evolution, time travel, and optimization techniques
• Experience integrating heterogeneous enterprise systems, including legacy/custom integrations
• Familiarity with cloud platforms (Azure/AWS) and infrastructure-as-code practices
• Understanding of data governance principles, compliance frameworks, and CUI/PII handling practices
• Familiarity with financial, HR, CRM, or ITSM data structures
• Git/CI-CD pipeline experience
• DoD 8570 certification

Responsibilities

• Build out a dedicated Government Databricks workspace and oversee data ingestion from core agency systems
• Design and implement data pipelines from financial, HR, CRM, and ITSM sources
• Leverage connectors or create custom integrations for legacy systems
• Normalize and prepare ingested data for downstream visualization and reporting
• Implement Unity Catalog for centralized governance, metadata, and lineage tracking
• Review security controls for CUI/PII/PHI/financial data and implement improvements
• Develop comprehensive as-built documentation including architecture diagrams and SOPs
• Document data sources, integration methods, and lake-architecture decisions for sustainment

Skills

PySpark

Spark SQL

Python

Unity Catalog

Airflow

Databricks Workflows

Delta Lake

Schema evolution

Time travel

Data governance

Cloud platforms

IaC

DoD 8570 certification

Git/CI-CD

Education

BS/BA in Computer Science/Engineering

MS/MA in related field

Tools

Databricks

MLflow

Job description

Peraton is seeking a Databricks Data Engineer for a Government-owned Databricks workspace. You will design and implement data pipelines from core agency systems, enable Unity Catalog governance, and configure MLflow for ML workflows.

You will document architectures, data dictionaries, and sustainment procedures, while ensuring secure handling of CUI/PII and compliance with DoD requirements. This is a 100% remote position supporting national initiatives.