Senior Databricks Engineer for DoD Data Solutions

D&G Support Services; St. Louis (MO); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive salary

Benefits

401(k)

Bonus and profit sharing

Flexible hours

Education reimbursement

PTO

Job summary

D&G Solutions on site in the St. Louis area seeks a Senior Data Engineer to design, develop, and maintain data pipelines, APIs, and integration solutions enabling the Joint Petroleum Enterprise to ingest, manage, and consume bulk fuel data across the DoD.

You will collaborate with cross-functional teams on COP development, metadata, and governance while supporting enterprise data modernization initiatives and data-driven decision making.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, software development, or a related technical discipline.
• Strong proficiency with SQL and Python.
• Experience developing and maintaining data pipelines using Apache Spark, Kafka, or similar technologies.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Experience with data warehousing, ETL, and enterprise data management.
• Experience with API development and RESTful web services.
• Experience with data modeling techniques and metadata management.
• Experience with Maven Smart Systems or similar logistics platforms.
• Experience with DoD, DLA, or USTRANSCOM environments and Agile development.

Responsibilities

• Develop and maintain data pipelines that ingest data into Databricks and support integration with Palantir Ontology and other enterprise platforms.
• Collaborate with cross-functional teams to support COP development and data integration efforts.
• Review and analyze Joint Petroleum Enterprise data sources to identify integration opportunities.
• Design scalable data ingestion processes transforming source data for enterprise use and API development.
• Develop, publish, and maintain APIs for enterprise data access across the Joint Petroleum Enterprise.
• Collaborate to manage data dictionaries, metadata repositories, and data governance artifacts.
• Administer data structures, data topics, and data engineering processes with industry best practices.
• Participate in technical groups and stakeholder meetings for metadata, modeling, and architecture decisions.
• Prepare presentations and technical materials for governance forums.
• Provide technical recommendations and support for data modernization initiatives.

Skills

SQL

Python

Databricks

Palantir Ontology

Apache Spark

Kafka

REST APIs

Cloud platforms (AWS/Azure/GCP)

Data integration

Data warehousing

ETL processes

Data modeling

Metadata management

Maven Smart Systems

Agile development

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field

Tools

Databricks

Palantir Ontology

Job description

D&G Solutions on site in the St. Louis area seeks a Senior Data Engineer to design, develop, and maintain data pipelines, APIs, and integration solutions enabling the Joint Petroleum Enterprise to ingest, manage, and consume bulk fuel data across the DoD.

You will collaborate with cross-functional teams on COP development, metadata, and governance while supporting enterprise data modernization initiatives and data-driven decision making.