Senior Databricks Engineer - DoD Data Pipelines & APIs

D&G Solutions; St. Louis (MO); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

Benefits

401(k)

Bonus and profit sharing

Flexible hours

Education reimbursement

PTO

Job summary

At D&G Solutions, we seek a Senior Developer to design, develop, and maintain data pipelines and APIs supporting DoD data ecosystems. This on-site role at Scott AFB, IL requires hands-on experience with Databricks, Palantir Ontology, and enterprise data standards.

The ideal candidate has 5+ years in data engineering or software development, strong SQL/Python skills, and active clearance eligibility for TS/SCI.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field.

Responsibilities

• Develop and maintain data pipelines that ingest data into Databricks and support integration with Palantir Ontology and other enterprise platforms.
• Collaborate with cross-functional teams to support COP development and related data integration efforts.
• Review and analyze Joint Petroleum Enterprise data sources to identify opportunities for data integration and enhancement.
• Design and implement scalable data ingestion processes that transform source data into structured formats for API development.
• Develop, publish, and maintain APIs that provide standardized access to enterprise data across the Joint Petroleum Enterprise.
• Collaborate with stakeholders to manage and maintain enterprise data dictionaries, metadata repositories, and data governance artifacts.
• Administer data structures, data topics, and data engineering processes while implementing industry best practices.
• Participate in technical working groups and stakeholder meetings to support metadata requirements, data modeling, architecture decisions, and tool selection.
• Support the preparation of presentations and technical materials for governance forums.
• Provide technical recommendations and support for enterprise data modernization initiatives.
• Complete additional projects and tasks as assigned by program leadership.

Skills

SQL

Python

Agile development

Communication

DoD experience

Security clearance

Data modeling

Metadata management

Data warehousing

ETL processes

Enterprise data management

API development

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems

Tools

Databricks

Palantir Ontology

Apache Spark

Kafka

AWS

Azure

GCP

Maven Smart Systems

Job description

At D&G Solutions, we seek a Senior Developer to design, develop, and maintain data pipelines and APIs supporting DoD data ecosystems. This on-site role at Scott AFB, IL requires hands-on experience with Databricks, Palantir Ontology, and enterprise data standards.

The ideal candidate has 5+ years in data engineering or software development, strong SQL/Python skills, and active clearance eligibility for TS/SCI.