DoD Data Integration Engineer - Pipelines & APIs

D&G Solutions; St. Louis (MO); On-site; USD 110,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

Benefits

401(k)

Bonus and profit sharing

Flexible hours

Education reimbursement

PTO

Job summary

D&G Solutions on site at Scott AFB IL seeks a Data Integration Engineer to design, develop, and maintain data pipelines, APIs, and integration solutions enabling bulk fuel data management for the DoD. You will work across enterprise platforms and governance artifacts to support data-driven decision making.

The role requires 5+ years in data engineering with strong SQL/Python skills, and an active Secret clearance.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, software development, or a related technical discipline.
• Strong proficiency with SQL and Python.
• Experience developing and maintaining data pipelines using Apache Spark, Kafka, or similar technologies.
• Experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Experience designing and implementing data integration solutions.
• Ability to communicate effectively with both technical and non-technical stakeholders.
• Active Secret clearance with eligibility to obtain and maintain a TS/SCI.
• Desired: Databricks experience; Palantir Ontology; DoD/DoD-level data mgmt; Agile experience.

Responsibilities

• Develop and maintain data pipelines that ingest data into Databricks and support integration with Palantir Ontology and other enterprise platforms.
• Collaborate with cross-functional teams to support Common Operating Picture (COP) development and related data integration efforts.
• Review and analyze Joint Petroleum Enterprise data sources, including applications, websites, programs, and operational systems to identify opportunities for data integration and enhancement.
• Design and implement scalable data ingestion processes that transform source data into structured formats suitable for enterprise consumption and API development.
• Develop, publish, and maintain APIs that provide standardized access to enterprise data across the Joint Petroleum Enterprise.
• Collaborate with stakeholders to manage and maintain enterprise data dictionaries, metadata repositories, and data governance artifacts.
• Administer data structures, data topics, and data engineering processes while implementing industry best practices.
• Participate in technical working groups and stakeholder meetings to support metadata requirements, data modeling, architecture decisions, and tool selection.
• Support the preparation of presentations and technical materials for governance forums.
• Provide technical recommendations and support for enterprise data modernization initiatives.
• Complete additional projects and tasks as assigned by program leadership.

Skills

SQL

Python

Apache Spark

Kafka

Data integration

Cloud platforms

APIs

Stakeholder comms

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field

Tools

Databricks

Palantir Ontology

RESTful APIs

Job description

D&G Solutions on site at Scott AFB IL seeks a Data Integration Engineer to design, develop, and maintain data pipelines, APIs, and integration solutions enabling bulk fuel data management for the DoD. You will work across enterprise platforms and governance artifacts to support data-driven decision making.

The role requires 5+ years in data engineering with strong SQL/Python skills, and an active Secret clearance.