Data Engineer: TS/SCI Clearance, Python Pipelines

Worky; McLean (VA); On-site; USD 120,000 - 170,000; Full time

Job summary

M1 Technology, LLC is seeking an experienced Data Engineer to maintain and expand data pipelines that support national security missions. The role emphasizes Python and PySpark expertise and handling both structured and unstructured data (SQL, JSON, XML).

Clearance required: TS/SCI with Polygraph. Prior work in IC environments is preferred, with responsibilities spanning data ingestion, enrichment, governance, and secure data access.

Qualifications

• Bachelor’s degree in CS/Engineering or related field or equivalent experience.
• 5+ years of software development experience with at least one of Python/Java/C#/JavaScript/Ruby.
• 5+ years of experience with databases and applications in IC environments.
• Extensive experience designing and maintaining SQL-based data systems and complex queries.
• Proficiency in technical documentation (ERDs, schemas, architecture diagrams).
• Experience with IC cloud environments and C2E cloud services.
• Experience integrating data systems with visualization and analytics platforms (Tableau/PowerBI/Kibana/Grafana).

Responsibilities

• Maintain and expand data pipelines across multiple environments.
• Enrich datasets using external and under-represented sources.
• Integrate and manage data catalog capabilities for governance.
• Troubleshoot data ingestion, integration, and processing issues.
• Develop scripts/tools using Python and PySpark for structured and unstructured data.
• Interface with cloud storage and RDBMS for analytics platforms.
• Manage data acquisition via secure HTTPS, DB connections, and file transfers.

Skills

Python

Java

C#

JavaScript

Ruby

Education

Bachelor's degree in Computer Science/Engineering

Tools

PySpark

Tableau

PowerBI

Kibana

Grafana

Job description

M1 Technology, LLC is seeking an experienced Data Engineer to maintain and expand data pipelines that support national security missions. The role emphasizes Python and PySpark expertise and handling both structured and unstructured data (SQL, JSON, XML).

Clearance required: TS/SCI with Polygraph. Prior work in IC environments is preferred, with responsibilities spanning data ingestion, enrichment, governance, and secure data access.