Remote Databricks Data Engineer — Government Data Pipelines

Peraton; United States; On-site; USD 112,000 - 179,000; Full time

Benefits offered by this job

Medical, dental and vision benefits

401(k) plan

Paid time off (PTO)

Job summary

Peraton is seeking a Databricks Data Engineer to hands-on build a Government-owned Databricks workspace and consolidate agency data. You will design data pipelines from core enterprise systems, implement Unity Catalog for governance, and configure MLflow for workflows, ensuring sustainment beyond the pilot.

The role is 100% remote, with work focusing on secure data handling, documentation, and cross-system integration across DoD‑level data assets.

Qualifications

• BS/BA with 5 years of related experience; MS/MA with 3 years acceptable.
• US Citizenship and active DoD Secret clearance required.
• 2+ years on the Databricks platform.
• Strong PySpark, Spark SQL, and Python for pipelines.
• Unity Catalog administration and data governance experience.
• Experience with Airflow or Databricks Workflows.
• Delta Lake knowledge; schema evolution and optimizations.
• Familiarity with Azure/AWS and IaC practices.
• DoD 8570 certification.

Responsibilities

• Build and configure a Government Databricks workspace.
• Design data ingestion pipelines from core agency systems (finance, HR, CRM, ITSM).
• Use native connectors or custom integration for legacy systems.
• Normalize ingested data for downstream visualization/reporting tools.
• Implement Unity Catalog for centralized governance, metadata, and lineage.
• Assess security controls for CUI/PII/PHI/financial data and implement improvements.
• Create comprehensive as-built documentation and data dictionaries.
• Document data sources, integration methods, and lake architecture decisions.

Skills

PySpark

Spark SQL

Python

Unity Catalog administration

Airflow

Databricks Workflows

Delta Lake

Cloud platforms (Azure/AWS)

Data governance

CI/CD

Education

BS/BA

MS/MA

Tools

Databricks

Airflow

Microsoft Azure

AWS

CI/CD tools

Job description

Peraton is seeking a Databricks Data Engineer to hands-on build a Government-owned Databricks workspace and consolidate agency data. You will design data pipelines from core enterprise systems, implement Unity Catalog for governance, and configure MLflow for workflows, ensuring sustainment beyond the pilot.

The role is 100% remote, with work focusing on secure data handling, documentation, and cross-system integration across DoD‑level data assets.