Data Engineer - Secure DoD & Gov Data Pipelines

iO Associates; Washington (District of Columbia); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Flexible working arrangements

Unlimited PTO

Job summary

Our Client is a pioneering organisation delivering AI-native readiness solutions for defence and government sectors. The Data Engineer will build robust data pipelines, manage security-compliant datasets, and collaborate with data scientists and platform engineers to enable reliable AI workflows.

Role requires a SECRET or higher clearance, 4+ years of data engineering, and strong Python/SQL skills. Extensive experience with AWS, Spark, and containerized environments (Docker/Kubernetes) is

Qualifications

• Bachelor's degree in Computer Science, Engineering or related field.
• Active US Government Security Clearance (SECRET or higher) is mandatory.
• 4+ years of data engineering and building production data pipelines.
• Proficiency in Python and SQL.

Responsibilities

• Design, develop, and sustain scalable, secure data pipelines for data ingestion, transformation, and delivery in cloud and hybrid environments.
• Manage structured and unstructured data to support AI/ML workflows, analytics, and app development.
• Collaborate with cross-functional teams to productionise data workflows, feature pipelines, and model inputs.
• Enhance automation for data quality, validation, lineage tracing, and monitoring.
• Optimize storage, query performance, and cost-efficiency across relational and object stores.
• Implement data security protocols, access controls, and governance per government standards.
• Support data integration within secure DoD environments and customer settings.
• Troubleshoot data issues to ensure pipeline reliability and performance.
• Work with platform and AI engineers to maintain secure, scalable data architecture.

Skills

Python

SQL

Spark

AWS

Docker

Kubernetes

Terraform

PostgreSQL

Education

Bachelor's degree in CS/Engineering or related

Tools

AWS

Job description

Our Client is a pioneering organisation delivering AI-native readiness solutions for defence and government sectors. The Data Engineer will build robust data pipelines, manage security-compliant datasets, and collaborate with data scientists and platform engineers to enable reliable AI workflows.

Role requires a SECRET or higher clearance, 4+ years of data engineering, and strong Python/SQL skills. Extensive experience with AWS, Spark, and containerized environments (Docker/Kubernetes) is