Senior Data Engineer: DoD Data Pipelines & APIs

D&G Solutions; Illinois; On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

Benefits

401(k)

Bonus and profit sharing

Flexible hours

Education reimbursement

PTO

Job summary

D&G Solutions is seeking a Senior Data Engineer to design, build, and maintain data pipelines, APIs, and integration solutions for the Joint Petroleum Enterprise within USTRANSCOM. This on-site role at Scott AFB, IL requires strong Spark, Python, and SQL skills and experience with Databricks and Palantir Ontology.

The team focuses on delivering a Global Common Operating Picture and data modernization across enterprise systems, supporting mission-critical decision making for the Department of

Qualifications

• Bachelor's degree or higher in CS/DI/IS or related field.
• 5+ years in data engineering, software dev, or related field.
• Strong SQL and Python.
• Experience with data pipelines using Spark/Kafka.
• Cloud experience (AWS/Azure/GCP).
• APIs and RESTful services experience.
• Active Secret clearance; TS/SCI eligibility.

Responsibilities

• Develop and maintain data pipelines ingesting data into Databricks.
• Collaborate with cross-functional teams for COP development and data integration.
• Review DoD data sources for integration opportunities.
• Design scalable ingestion processes for enterprise consumption and APIs.
• Develop, publish, and maintain APIs for enterprise data access.
• Manage data dictionaries, metadata repositories, and governance artifacts.
• Support metadata requirements, data modeling, and architecture decisions.

Skills

Communication with stakeholders

Data modeling

Data integration

Agile development

Problem solving

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field

Tools

Databricks

Palantir Ontology

Apache Spark

Kafka

Maven Smart Systems

Job description

D&G Solutions is seeking a Senior Data Engineer to design, build, and maintain data pipelines, APIs, and integration solutions for the Joint Petroleum Enterprise within USTRANSCOM. This on-site role at Scott AFB, IL requires strong Spark, Python, and SQL skills and experience with Databricks and Palantir Ontology.

The team focuses on delivering a Global Common Operating Picture and data modernization across enterprise systems, supporting mission-critical decision making for the Department of