Remote Databricks Data Engineer – Government

engineeringjobs.net, Inc.; Town of Montana (WI); Remote; USD 112,000 - 179,000; Full time

Benefits offered by this job

100% remote

Job summary

Peraton is seeking a Databricks Data Engineer to hands-on build a Government Databricks workspace, design data pipelines, and implement Unity Catalog for governance. The role involves configuring MLflow for ML workflows and creating thorough sustainment documentation, with a focus on CUI/PII data handling and secure integration of enterprise systems.

The position is 100% remote, requiring US citizenship and a DoD Secret clearance.

Qualifications

• BS/BA with 5 years of work experience; MS/MA with 3 years of work experience.
• U.S. Citizenship required.
• Active DoD Secret clearance required.
• 2 years of hands-on experience on the Databricks platform.
• Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing.
• Hands-on experience with Unity Catalog administration, including metastore management and data lineage.
• Experience with pipeline orchestration tools (Airflow, Databricks Workflows).
• Experience with Delta Lake, schema evolution, time travel, and optimization techniques.
• Experience integrating heterogeneous enterprise systems (legacy/custom integrations).
• Familiarity with cloud platforms (Azure/AWS) and IaC practices.
• Understanding of data governance, CUI/PII handling practices.
• Familiarity with financial, HR, CRM, or ITSM data structures.
• Git/CI-CD pipeline experience.
• DoD 8570 certification.

Responsibilities

• Hands-on build-out of a Government Databricks workspace and data ingestion pipelines.
• Implement Unity Catalog for centralized data governance and data lineage.
• Configure MLflow for ML workflows and document sustainment artifacts.
• Review security controls for CUI/PII/PHI/financial data and implement improvements.
• Develop comprehensive as-built documentation including architecture diagrams and SOPs.
• Document data sources, integration methods, and data lake decisions to support sustainment.
• Collaborate across agency teams to integrate core enterprise systems (financial, HR, CRM, ITSM).
• Ensure robust data normalization for downstream visualization and reporting tools.

Education

BS/BA in a relevant field

MS/MA in a relevant field

Tools

Databricks

PySpark

Spark SQL

Python

Unity Catalog

Airflow

Databricks Workflows

Delta Lake

Azure

AWS

CI/CD

DoD 8570 certification

Job description

Peraton is seeking a Databricks Data Engineer to hands-on build a Government Databricks workspace, design data pipelines, and implement Unity Catalog for governance. The role involves configuring MLflow for ML workflows and creating thorough sustainment documentation, with a focus on CUI/PII data handling and secure integration of enterprise systems.

The position is 100% remote, requiring US citizenship and a DoD Secret clearance.