Remote Databricks Data Engineer — Govt Data & Governance

Peraton; Northern (KY); Hybrid; USD 112,000 - 179,000; Full time

Benefits offered by this job

Health insurance

Job summary

Peraton is seeking a Databricks Data Engineer to design and implement a government-owned Databricks workspace and data pipelines, consolidating agency data across core systems. You will enable Unity Catalog governance and MLflow workflows while delivering thorough documentation to sustain the pilot.

The role requires US citizenship and an active DoD Secret clearance, with hands-on Databricks experience and strong PySpark/Python skills for large-scale data processing.

Qualifications

• 8+ years with BS/BA in related field; 6+ years with MS/MA; 3+ years with PhD
• US Citizenship and active DoD Secret clearance
• 2+ years experience on the Databricks platform
• Proficiency in PySpark, Spark SQL, and Python for large-scale data processing
• Unity Catalog administration, data governance and data lineage
• Experience with Airflow or Databricks Workflows
• Delta Lake, schema evolution and time travel
• Experience integrating multiple enterprise systems (legacy/custom)
• Familiarity with Azure/AWS and IaC practices
• DoD 8570 certification

Responsibilities

• Hands-on build-out of a Government Databricks workspace and data pipelines
• Ingest and integrate data from core agency systems (financial, HR, CRM, ITSM)
• Implement Unity Catalog for governance and end-to-end lineage
• Configure MLflow for ML workflows and automate documentation
• Review security controls for CUI/PII/PHI/financial data and improve them
• Produce comprehensive as-built documentation and architecture diagrams

Tools

Databricks

Python

PySpark

Spark SQL

Delta Lake

Airflow

Databricks Workflows

Unity Catalog

CI/CD

Cloud: Azure

Cloud: AWS

IaC

Git

DoD 8570 certification

Databricks Certification

Job description

Peraton is seeking a Databricks Data Engineer to design and implement a government-owned Databricks workspace and data pipelines, consolidating agency data across core systems. You will enable Unity Catalog governance and MLflow workflows while delivering thorough documentation to sustain the pilot.

The role requires US citizenship and an active DoD Secret clearance, with hands-on Databricks experience and strong PySpark/Python skills for large-scale data processing.