Remote Databricks Data Engineer — Government Data Pipelines

Peraton; Reston (VA); On-site; USD 112,000 - 179,000; Full time

Job summary

Peraton is seeking a Databricks Data Engineer to build a government-owned Databricks workspace and data pipelines, implementing Unity Catalog for governance and lineage. You will document architecture and sustainment approaches while collaborating with cross-functional teams.

This 100% remote role requires US citizenship, an active DoD Secret clearance, and at least 2 years of hands-on Databricks experience with PySpark, Spark SQL, Python, and cloud platforms (Azure/AWS).

Qualifications

• 5 years work experience with BS/BA; 3 years with MS/MA
• US Citizenship
• Active DoD Secret clearance
• 2 years working on the Databricks platform
• Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing and pipeline development
• Hands-on experience with Unity Catalog administration, including metastore management, access policies, and data lineage
• Experience with pipeline orchestration tools (Airflow, Databricks Workflows)
• Experience with Delta Lake, schema evolution, time travel, and optimization techniques
• Experience integrating heterogeneous enterprise systems, including legacy/custom integrations
• Familiarity with cloud platforms (Azure/AWS) and infrastructure-as-code practices
• Understanding of data governance principles, compliance frameworks, and CUI/PII handling practices
• Familiarity with financial, HR, CRM, or ITSM data structures
• Git/CI-CD pipeline experience
• DoD 8570 certification

Responsibilities

• Build out and configure a dedicated Government workspace within the existing Databricks environment
• Design and implement data ingestion pipelines from core agency business systems including financial, HR, CRM, and ITSM systems
• Leverage native/built-in connectors where source systems support them; design custom integration approaches for legacy systems
• Normalize and prepare ingested data within Databricks for consumption by downstream visualization/reporting tools
• Implement Databricks Unity Catalog for centralized data governance, metadata management, active auditing, and end-to-end lineage tracking
• Review current configuration, assess security controls for CUI/PII/PHI/financial data, and implement improvements
• Develop comprehensive "as-built" documentation including physical/logical architecture diagrams, automated data dictionaries, and SOPs
• Document data sources, integration methods, and data lake architecture decisions to support sustainment

Skills

PySpark

Spark SQL

Python

Unity Catalog

Airflow

Databricks Workflows

Delta Lake

Schema evolution

Time travel

Data governance

Cloud platforms

CUI/PII handling

Git/CI-CD

DoD 8570

Education

BS/BA

MS/MA

Tools

Azure

AWS

Git

CI/CD

Job description

Peraton is seeking a Databricks Data Engineer to build a government-owned Databricks workspace and data pipelines, implementing Unity Catalog for governance and lineage. You will document architecture and sustainment approaches while collaborating with cross-functional teams.

This 100% remote role requires US citizenship, an active DoD Secret clearance, and at least 2 years of hands-on Databricks experience with PySpark, Spark SQL, Python, and cloud platforms (Azure/AWS).