Hybrid Data Engineer — ETL & Real-Time Pipelines

General Dynamics Information Technology, Inc.; Fort Bragg (NC); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Comprehensive benefits

401K with company match

Paid time off

Military-friendly workplace

Job summary

IronEagleX, a wholly owned subsidiary of General Dynamics Information Technology, seeks a Data Engineer SME with strong ETL focus to design, build, and maintain data pipelines. This hybrid role (3 days on site) at Fort Bragg, NC centers on centralizing data from multiple sources into unified APIs for internal and external use.

Applicants should have extensive Airflow, Python, SQL (Postgres), and experience with Kafka, OpenMetadata, and cloud storage (AWS S3/MinIO). TS/SCI clearance is required.

Qualifications

• Experience with Airflow for workflow orchestration.
• Strong Python programming skills.
• Proficient with Postgres SQL databases.
• Familiarity with Trino for large datasets.
• Experience with ElasticSearch/OpenSearch for indexing.
• Knowledge of vector databases and embedding models.
• Experience in event-driven microservices and cloud (AWS S3/MinIO).
• Proficient Linux knowledge and Git version control.
• Understanding of Parquet file formats and data governance.

Responsibilities

• Design, build, and maintain scalable ETL pipelines using Airflow.
• Develop Kafka-based messaging for real-time streaming.
• Build fast data retrieval using ElasticSearch/OpenSearch.
• Implement Python data processing and batch/streaming integration.
• Deploy and manage AWS S3/MinIO data storage and compute resources.
• Ensure secure processing of classified data and governance compliance.
• Collaborate with cross-functional teams to align data strategies.

Skills

Apache Airflow

Python

Postgres

Trino

ElasticSearch

OpenSearch

FastAPI

AWS S3

MinIO

Reggo

Parquet

Git

Linux

Vector databases

Education

Bachelor's degree

Tools

Kafka

OpenMetaData

Airflow

OpenMetaData

FastAPI

Job description

IronEagleX, a wholly owned subsidiary of General Dynamics Information Technology, seeks a Data Engineer SME with strong ETL focus to design, build, and maintain data pipelines. This hybrid role (3 days on site) at Fort Bragg, NC centers on centralizing data from multiple sources into unified APIs for internal and external use.

Applicants should have extensive Airflow, Python, SQL (Postgres), and experience with Kafka, OpenMetadata, and cloud storage (AWS S3/MinIO). TS/SCI clearance is required.