Data Engineer

M1 Technology LLC; Warrenton (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

M1 Technology, LLC is seeking an experienced Data Engineer to maintain and expand data pipelines that support national security missions. The ideal candidate has a strong background in Python-based workflows and experience working in classified IC environments.

Clearance Requirement: TS/SCI with Polygraph. 5+ years in software development and SQL-based data systems are expected, with emphasis on secure data handling and governance.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5+ years of software development experience with Python or similar languages.
• 5+ years of experience with databases and applications in classified IC environments.
• Extensive experience designing and maintaining SQL-based data systems and crafting complex queries.
• Proficiency in generating technical docs (ERDs, schemas, architecture diagrams).

Responsibilities

• Maintain and execute data extraction pipelines across environments.
• Enrich datasets using external and under-represented sources.
• Integrate and manage data catalog capabilities for governance and discovery.
• Troubleshoot and resolve data ingestion, integration, and processing issues.
• Develop scripts/tools using Python and PySpark for structured and unstructured data.
• Interface with cloud storage and RDBMS to support analytics platforms.
• Manage data acquisition via secure HTTPS, direct DB connections, and file transfers.

Skills

Python

SQL

Data pipelines

PySpark

Classified IC experience

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Tableau

PowerBI

Kibana

Grafana

SQL Server

Job description

M1 Technology, LLC is a technology consulting firm specializing in delivering software systems that support our clients’ mission needs. We partner with federal and commercial organizations to provide high-impact technology solutions and exceptional service. Founded in 2016, M1 Technology’s vision is simple and unwavering: connect mission-first individuals to deliver meaningful outcomes for government clients while creating an exceptional home for our employees.

We are seeking an experienced Data Engineer. This role is responsible for maintaining and expanding the data pipeline that fuels critical national security missions. The ideal candidate will have a deep background in Python-based data workflows and experience working in classified IC environments.

Clearance Requirement : TS/SCI with Polygraph

Key Responsibilities

• Maintain and execute data extraction pipelines to transport data in and out of multiple environments.
• Enrich existing datasets using external and under-represented data sources.
• Integrate and manage data catalog capabilities for discoverability and governance.
• Troubleshoot and resolve issues related to data ingestion, integration, and processing.
• Develop and enhance scripts and tools using Python and PySpark to process structured (SQL) and unstructured (JSON, XML) data.
• Interface with cloud-based storage solutions (object repositories, RDBMS) to support analytics platforms.
• Manage data acquisition via secure HTTPS requests, direct DB connections, and standalone file transfers.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field; or equivalent experience.
• 5+ years of software development experience with at least one of: Python, Java, C#, JavaScript, or Ruby (Python strongly preferred).
• 5+ years of experience working with databases and applications in classified IC environments.
• Extensive experience designing and maintaining SQL-based data systems and crafting complex queries.
• Proficiency in generating and interpreting technical documentation (e.g., ERDs, schemas, architecture diagrams).
• In-depth knowledge of IC cloud environments and C2E cloud services.
• Experience integrating data systems with visualization and analytics platforms (Tableau, PowerBI, Kibana, Grafana, etc.).

Desired Skills

• Familiarity with IC metrics and assessments: alignment with intelligence needs, responsiveness, and collection discipline utilization.
• Experience building tools to assess and visualize large-scale datasets.
• Proven ability to design and implement secure APIs for data access and integration.

M1 Technology is an equal opportunity employer and values diversity. We do not discriminate in hiring on the basis of race, color, religion, sex, national origin, age, disability, veteran status, or any other characteristic protected by federal, state, or local law.