Senior Data Engineer & Tech Lead – Hybrid

IAMUS Consulting; Columbia (MD); Hybrid; USD 133,000 - 238,000; Full time

Job summary

IAMUS Consulting in Columbia, MD (Hybrid) seeks a Senior Data Engineer / Technical Lead to design, build, and optimize data pipelines transforming complex data into actionable intelligence for national security missions.

You will lead technical direction, mentor team members, and shape data engineering across the program, working with technologies like Kafka, NiFi, AWS, Java, and Python in a DoD/IC context.

Qualifications

• 9+ years of experience in data engineering, software engineering, or related technical fields.
• Hands-on experience with Kafka, NiFi, and AWS (S3, SQS).
• Proficiency in Java and/or Python, with experience in unit and integration testing.
• Solid understanding of data formats (JSON, XML, SQL schemas, compressed formats).
• Experience troubleshooting data pipelines, system performance, and dataflow issues.
• DoD 8570 IAT II certification (or higher).

Responsibilities

• Design and scale data ingestion pipelines for large, complex data sets.
• Integrate new data sources and enhance existing data flows for performance and reliability.
• Lead data integrity, validation, monitoring, and troubleshooting efforts.
• Support mission partners by enabling timely, accurate data for analysis.
• Decompose and solve complex system and dataflow challenges across distributed environments.
• Collaborate with engineers, analysts, and stakeholders across mission teams.
• Provide technical leadership and mentorship to junior and mid-level engineers.
• Drive best practices across ETL development, data modeling, and system architecture.

Skills

ETL pipelines

Kafka

NiFi

AWS S3 SQS

Java

Python

Data formats

Troubleshooting data

DoD 8570 IAT II

Data ingestion frameworks

Education

Degree optional

Tools

Kubernetes

Docker

Apache Airflow

Mage AI

GitLab

Maven

VSCode

IntelliJ

PyCharm

Job description

IAMUS Consulting in Columbia, MD (Hybrid) seeks a Senior Data Engineer / Technical Lead to design, build, and optimize data pipelines transforming complex data into actionable intelligence for national security missions.

You will lead technical direction, mentor team members, and shape data engineering across the program, working with technologies like Kafka, NiFi, AWS, Java, and Python in a DoD/IC context.