External Job Posting Title Databricks Data Engineer

Peraton; Northern (KY); Hybrid; USD 112,000 - 179,000; Full time

Benefits offered by this job

Health insurance

Job summary

Peraton is seeking a Databricks Data Engineer to design and implement a government-owned Databricks workspace and data pipelines, consolidating agency data across core systems. You will enable Unity Catalog governance and MLflow workflows while delivering thorough documentation to sustain the pilot.

The role requires US citizenship and an active DoD Secret clearance, with hands-on Databricks experience and strong PySpark/Python skills for large-scale data processing.

Qualifications

• 8+ years with BS/BA in related field; 6+ years with MS/MA; 3+ years with PhD
• US Citizenship and active DoD Secret clearance
• 2+ years experience on the Databricks platform
• Proficiency in PySpark, Spark SQL, and Python for large-scale data processing
• Unity Catalog administration, data governance and data lineage
• Experience with Airflow or Databricks Workflows
• Delta Lake, schema evolution and time travel
• Experience integrating multiple enterprise systems (legacy/custom)
• Familiarity with Azure/AWS and IaC practices
• DoD 8570 certification

Responsibilities

• Hands-on build-out of a Government Databricks workspace and data pipelines
• Ingest and integrate data from core agency systems (financial, HR, CRM, ITSM)
• Implement Unity Catalog for governance and end-to-end lineage
• Configure MLflow for ML workflows and automate documentation
• Review security controls for CUI/PII/PHI/financial data and improve them
• Produce comprehensive as-built documentation and architecture diagrams

Tools

Databricks

Python

PySpark

Spark SQL

Delta Lake

Airflow

Databricks Workflows

Unity Catalog

CI/CD

Cloud: Azure

Cloud: AWS

IaC

Git

DoD 8570 certification

Databricks Certification

Job description

Responsibilities

The Databricks Data Engineer will be responsible for the hands-on build-out of a Government-owned Databricks workspace and the data ingestion/integration work needed to consolidate agency business system data. This includes designing and implementing data pipelines from core enterprise systems, implementing Unity Catalog for data governance, configuring MLflow for machine learning workflows, and developing comprehensive documentation to support sustainment beyond the pilot.

This role is 100% Remote.

Other Responsibilities Include:

• Build out and configure a dedicated Government workspace within the existing Databricks environment
• Design and implement data ingestion pipelines from core agency business systems including financial, HR, CRM, and ITSM systems
• Leverage native/built-in connectors where source systems support them; design custom integration approaches for legacy systems
• Normalize and prepare ingested data within Databricks for consumption by downstream visualization/reporting tools
• Implement Databricks Unity Catalog for centralized data governance, metadata management, active auditing, and end-to-end lineage tracking
• Review current configuration, assess security controls for CUI/PII/PHI/financial data, and implement improvements
• Develop comprehensive "as-built" documentation including physical/logical architecture diagrams, automated data dictionaries, and SOPs
• Document data sources, integration methods, and data lake architecture decisions to support sustainment

Qualifications

Required Qualifications:

• Min 8 years with BS/BA, Min 6 years with MS/MA, Min 3 years with PhD
• US Citizenship
• Active DoD Secret clearance
• 2 years working on the Databricks platform
• Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing and pipeline development
• Hands-on experience with Unity Catalog administration, including metastore management, access policies, and data lineage
• Experience with pipeline orchestration tools (Airflow, Databricks Workflows)
• Experience with Delta Lake, schema evolution, time travel, and optimization techniques
• Experience integrating heterogeneous enterprise systems, including legacy/custom integrations
• Familiarity with cloud platforms (Azure/AWS) and infrastructure-as-code practices
• Understanding of data governance principles, compliance frameworks, and CUI/PII handling practices
• Familiarity with financial, HR, CRM, or ITSM data structures
• Git/CI-CD pipeline experience
• DoD 8570 certification

Preferred Qualifications:

• Databricks Certified Data Engineer Associate or Professional certification

Peraton Overview

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we’re keeping people around the world safe and secure.

Target Salary Range

$112,000 - $179,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.

EEO

EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.