Senior Databricks Data Engineer - DoD Mission-Critical

D&G Support Services, LLC; St. Louis (MO); On-site; USD 125,000 - 150,000; Full time

Job summary

D&G Solutions is seeking a Senior Developer to join our on-site team at Scott AFB, IL. You will design, build, and maintain data pipelines and APIs to support the Joint Petroleum Enterprise, enabling data-driven decision making across the DoD.

The role requires 5+ years in data engineering or software development, strong SQL/Python skills, and experience with Spark, Kafka, and cloud platforms. Active Secret clearance with TS/SCI eligibility is required.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, software development, or a related technical discipline.
• Strong proficiency with SQL and Python.
• Experience developing and maintaining data pipelines using Spark, Kafka, or similar technologies.

Responsibilities

• Develop and maintain data pipelines that ingest data into Databricks and support integration with Palantir Ontology and other enterprise platforms.
• Collaborate with cross-functional teams to support COP development and related data integration efforts.
• Review and analyze Joint Petroleum Enterprise data sources to identify opportunities for data integration and enhancement.
• Design scalable data ingestion processes for enterprise consumption and API development.
• Develop, publish, and maintain APIs that provide standardized access to enterprise data.

Skills

SQL

Python

Apache Spark

Kafka

AWS

Azure

GCP

Data integration

API development

Stakeholder communication

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field

Tools

Databricks

Palantir Ontology

Maven Smart Systems

Job description

D&G Solutions is seeking a Senior Developer to join our on-site team at Scott AFB, IL. You will design, build, and maintain data pipelines and APIs to support the Joint Petroleum Enterprise, enabling data-driven decision making across the DoD.

The role requires 5+ years in data engineering or software development, strong SQL/Python skills, and experience with Spark, Kafka, and cloud platforms. Active Secret clearance with TS/SCI eligibility is required.