Senior Data Engineer

D&G Solutions; Illinois; On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

Benefits

401(k)

Bonus and profit sharing

Flexible hours

Education reimbursement

PTO

Job summary

D&G Solutions is seeking a Senior Data Engineer to design, build, and maintain data pipelines, APIs, and integration solutions for the Joint Petroleum Enterprise within USTRANSCOM. This on-site role at Scott AFB, IL requires strong Spark, Python, and SQL skills and experience with Databricks and Palantir Ontology.

The team focuses on delivering a Global Common Operating Picture and data modernization across enterprise systems, supporting mission-critical decision making for the Department of

Qualifications

• Bachelor's degree or higher in CS/DI/IS or related field.
• 5+ years in data engineering, software dev, or related field.
• Strong SQL and Python.
• Experience with data pipelines using Spark/Kafka.
• Cloud experience (AWS/Azure/GCP).
• APIs and RESTful services experience.
• Active Secret clearance; TS/SCI eligibility.

Responsibilities

• Develop and maintain data pipelines ingesting data into Databricks.
• Collaborate with cross-functional teams for COP development and data integration.
• Review DoD data sources for integration opportunities.
• Design scalable ingestion processes for enterprise consumption and APIs.
• Develop, publish, and maintain APIs for enterprise data access.
• Manage data dictionaries, metadata repositories, and governance artifacts.
• Support metadata requirements, data modeling, and architecture decisions.

Skills

Communication with stakeholders

Data modeling

Data integration

Agile development

Problem solving

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field

Tools

Databricks

Palantir Ontology

Apache Spark

Kafka

Maven Smart Systems

Job description

On Site | Scott AFB, IL | Secret Clearance Required If you enjoy building modern data solutions, integrating complex data environments, and supporting mission-critical decision making for the Department of Defense, we would love to talk.

Why This Role Exists

The work we do has real impact, and the people behind it matter just as much.

The SeniorData Engineersupports USTRANSCOM's role as the Single Manager for Global Bulk Fuel Management and Delivery (GBFMD) by helping establish and maintain foundational data capabilities for the Joint Petroleum Enterprise (JPE). This role is responsible for designing, developing, and maintaining data pipelines, APIs, and integration solutions that enable the collection, management, and consumption of bulk fuel data across the Department of Defense. Supporting the development of a Global Common Operating Picture and other critical fuel management systems, this position plays a key role in advancing data-driven decision making across the enterprise.

What You Will Do

• Develop and maintain data pipelines that ingest data into Databricks and support integration with Palantir Ontology and other enterprise platforms.
• Collaborate with cross-functional teams to support Common Operating Picture (COP) development and related data integration efforts.
• Review and analyze Joint Petroleum Enterprise data sources, including applications, websites, programs, and operational systems to identify opportunities for data integration and enhancement.
• Design and implement scalable data ingestion processes that transform source data into structured formats suitable for enterprise consumption and API development.
• Develop, publish, and maintain APIs that provide standardized access to enterprise data across the Joint Petroleum Enterprise.
• Collaborate with stakeholders to manage and maintain enterprise data dictionaries, metadata repositories, and data governance artifacts.
• Administer data structures, data topics, and data engineering processes while implementing industry best practices.
• Participate in technical working groups and stakeholder meetings to support metadata requirements, data modeling, architecture decisions, and tool selection.
• Support the preparation of presentations and technical materials for USTRANSCOM, Joint Staff, and Office of the Secretary of Defense governance forums.
• Provide technical recommendations and support for enterprise data modernization initiatives.
• Complete additional projects and tasks as assigned by program leadership.

What We Are Looking For

Required:

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5 or more years of experience in data engineering, software development, or a related technical discipline.
• Strong proficiency with SQL and Python.
• Experience developing and maintaining data pipelines using Apache Spark, Kafka, or similar technologies.
• Experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Experience designing and implementing data integration solutions.
• Ability to communicate effectively with both technical and non-technical stakeholders.
• Active Secret clearance with eligibility to obtain and maintain a TS/SCI.
• Experience with Databricks.
• Experience with Palantir Ontology.
• Experience with data warehousing, ETL processes, and enterprise data management.
• Experience with API development and RESTful web services.
• Experience with data modeling techniques and metadata management.
• Experience with Maven Smart Systems or similar logistics and supply chain platforms.
• Experience supporting the Department of Defense, Defense Logistics Agency (DLA), or USTRANSCOM.
• Experience working in Agile development environments.

Eligibility Requirements

• Secret with the ability to obtain and maintain a TS/SCI.
• Ability to travel within CONUS up to approximately 10%.
• Restricted to U.S. persons as defined under 8 U.S.C. 1324b(a)(3).

Who We Are

At D&G Solutions, people come first; our teammates, customers, and the communities we serve.

We are one of the fastest growing companies in the Washington, DC area and proud to be recognized nationally as a Best Place to Work. As an 8(a), Service Disabled Veteran Owned, and Women Owned Small Business, we bring ownership, accountability, and care to everything we do. We also deeply believe in giving back and proudly support organizations such as Homes for Our Troops, SemperK9, and Wreaths Across America.

Our teams are known for being welcoming, collaborative, and deeply committed to mission success. We believe great work happens when people feel supported, respected, and trusted, and we work hard to create that environment every day.

What We Offer

• Competitive salary
• Benefits
• 401(k)
• Bonus and profit sharing
• Flexible hours
• Education reimbursement
• PTO

Final Note

If you want to work for a company that cares about its people, contribute to a mission that truly matters, and be part of a team where you are valued for who you are as well as what you do, we would love to hear from you.