Senior Data Engineer - DoD Pipelines & APIs, At Scott AFB

D&G Solutions; Scott Air Force Base (IL); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Competitive salary

Benefits

401(k)

Bonus and profit sharing

Flexible hours

Education reimbursement

PTO

Job summary

D&G Solutions is seeking a Senior Developer at Scott Air Force Base to design, build, and maintain data pipelines and APIs that enable data-driven decisions for Joint Petroleum Enterprise. You will collaborate with cross-functional teams to integrate data across enterprise platforms and support COP development.

This on-site role requires a Bachelor’s degree and 5+ years of data engineering experience, with strong SQL, Python, Spark, and cloud skills, plus an active Secret clearance with

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, software development, or a related technical discipline.
• Strong proficiency with SQL and Python.
• Experience developing and maintaining data pipelines using Apache Spark, Kafka, or similar technologies.
• Experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Ability to communicate effectively with both technical and non-technical stakeholders.
• Active Secret clearance with eligibility to obtain and maintain a TS/SCI.

Responsibilities

• Develop and maintain data pipelines that ingest data into Databricks and support integration with Palantir Ontology and other enterprise platforms.
• Collaborate with cross-functional teams to support Common Operating Picture (COP) development and related data integration efforts.
• Review and analyze Joint Petroleum Enterprise data sources, including applications, websites, programs, and operational systems to identify opportunities for data integration and enhancement.
• Design and implement scalable data ingestion processes that transform source data into structured formats suitable for enterprise consumption and API development.
• Develop, publish, and maintain APIs that provide standardized access to enterprise data across the Joint Petroleum Enterprise.
• Collaborate with stakeholders to manage and maintain enterprise data dictionaries, metadata repositories, and data governance artifacts.
• Administer data structures, data topics, and data engineering processes while implementing industry best practices.
• Participate in technical working groups and stakeholder meetings to support metadata requirements, data modeling, architecture decisions, and tool selection.
• Support the preparation of presentations and technical materials for governance forums.
• Provide technical recommendations and support for enterprise data modernization initiatives.
• Complete additional projects and tasks as assigned by program leadership.

Skills

SQL

Python

Data engineering

Communication

Agile

Education

Bachelor's degree

Tools

Databricks

Palantir Ontology

AWS

Azure

Google Cloud Platform

Kafka

Job description

D&G Solutions is seeking a Senior Developer at Scott Air Force Base to design, build, and maintain data pipelines and APIs that enable data-driven decisions for Joint Petroleum Enterprise. You will collaborate with cross-functional teams to integrate data across enterprise platforms and support COP development.

This on-site role requires a Bachelor’s degree and 5+ years of data engineering experience, with strong SQL, Python, Spark, and cloud skills, plus an active Secret clearance with