Mission-Critical Data Integration Engineer

D&G Support Services; St. Louis (MO); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Competitive salary

Benefits

401(k)

Bonus and profit sharing

Flexible hours

Education reimbursement

PTO

Job summary

D&G Solutions is seeking a Data Integration Engineer to design, develop, and maintain data pipelines, APIs, and integration solutions on-site at Scott AFB, IL. The role supports DoD data initiatives and cross-functional COP development.

The ideal candidate brings 5+ years in data engineering, strong SQL and Python skills, and experience with Databricks, Spark, Kafka, and Palantir Ontology, plus an active Secret clearance. On-site work with no relocation assistance provided.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, software development, or a related technical discipline.
• Strong proficiency with SQL and Python.
• Experience developing and maintaining data pipelines using Apache Spark, Kafka, or similar technologies.
• Experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Experience designing and implementing data integration solutions.
• Ability to communicate effectively with technical and non-technical stakeholders.
• Active Secret clearance with eligibility to obtain and maintain a TS/SCI.
• Experience with Databricks.
• Experience with Palantir Ontology.
• Experience with data warehousing, ETL processes, and enterprise data management.
• Experience with API development and RESTful web services.
• Experience with data modeling techniques and metadata management.
• Experience with Maven Smart Systems or similar logistics and supply chain platforms.
• Experience supporting the Department of Defense, Defense Logistics Agency (DLA), or USTRANSCOM.
• Experience working in Agile development environments.

Responsibilities

• Develop and maintain data pipelines that ingest data into Databricks and support integration with Palantir Ontology and other enterprise platforms.
• Collaborate with cross-functional teams to support Common Operating Picture (COP) development and related data integration efforts.
• Review and analyze Joint Petroleum Enterprise data sources to identify opportunities for data integration and enhancement.
• Design and implement scalable data ingestion processes that transform source data into structured formats for enterprise consumption and API development.
• Develop, publish, and maintain APIs that provide standardized access to enterprise data across the Joint Petroleum Enterprise.
• Collaborate with stakeholders to manage and maintain enterprise data dictionaries, metadata repositories, and data governance artifacts.
• Administer data structures, data topics, and data engineering processes with best practices.
• Participate in technical working groups and stakeholder meetings to support metadata requirements and data architecture decisions.
• Support presentations and technical materials for governance forums.
• Provide technical recommendations and support for enterprise data modernization initiatives.
• Complete additional projects and tasks as assigned by program leadership.

Skills

SQL

Python

Communication

Agile

Data modeling

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Palantir Ontology

Apache Spark

Kafka

REST APIs

Job description

D&G Solutions is seeking a Data Integration Engineer to design, develop, and maintain data pipelines, APIs, and integration solutions on-site at Scott AFB, IL. The role supports DoD data initiatives and cross-functional COP development.

The ideal candidate brings 5+ years in data engineering, strong SQL and Python skills, and experience with Databricks, Spark, Kafka, and Palantir Ontology, plus an active Secret clearance. On-site work with no relocation assistance provided.