Data Engineer – TS/SCI Clearance | AWS & Pipelines

M9 Solutions LLC.; Washington (District of Columbia); On-site; USD 150,000 - 164,000; Full time

Job summary

M9 Solutions LLC. is seeking a Data Engineer to support a government contract in Washington, DC. An active Top Secret SCI clearance is required and the role focuses on building scalable data pipelines, ETL artifacts, and cloud-based data services.

You will collaborate with a government product owner and a 7–8 person team to design robust data flows and deploy features, with occasional after-hours deployment support as needed.

Qualifications

• Bachelor's degree or equivalent practical experience.
• Experience with large-scale data processing and distributed frameworks.
• Experience with AWS or other cloud environments.
• Proficient with data stores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch, and SQL.
• Proficient in Python with pandas, PySpark, NiFi, Airflow, AWS Lambda or similar tech.
• Working knowledge of Docker, Kubernetes, JMS/SQS, SNS, and Kafka.
• Familiar with Linux/Unix environments and Agile development.

Responsibilities

• Identify and implement internal process improvements for scalability and automation.
• Develop data pipelines to support end-to-end solutions.
• Maintain artifacts like schemas and data dictionaries for ETL processes.
• Integrate data pipelines with AWS services to extract insights.
• Support data infrastructure needs and resolve data-related issues.
• Design robust data flows for raw and curated data.
• Provide Tier 3 support for deployed applications and dataflows.
• Define a clear product vision aligning with user needs and business goals.
• Create and manage product roadmaps with a government product owner and team of 7–8.
• Collaborate with data engineering to launch new features and document dataflows.
• Coordinate milestones and handle off-hours deployments when needed.

Skills

Top Secret SCI clearance

Distributed computing

AWS cloud

PostgreSQL

S3

Redshift

MongoDB

Redis

Elasticsearch/OpenSearch

Python (pandas, PySpark)

NiFi

Airflow

AWS Lambda

Docker

Kubernetes

JMS/SQS

Kafka

Linux/Unix

Agile methodologies

Jira/Confluence

Education

Bachelor's degree or equivalent practical experience

Tools

Docker

Kubernetes

Jira/Confluence

AWS

Job description

M9 Solutions LLC. is seeking a Data Engineer to support a government contract in Washington, DC. An active Top Secret SCI clearance is required and the role focuses on building scalable data pipelines, ETL artifacts, and cloud-based data services.

You will collaborate with a government product owner and a 7–8 person team to design robust data flows and deploy features, with occasional after-hours deployment support as needed.