ETL Data Engineer

Machine Learning Technologies, LLC; Reston (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

Machine Learning Technologies, LLC is seeking an ETL Developer to design and maintain data pipelines supporting national security missions. You will leverage Python-based workflows to extract, transform, and load data across diverse environments, collaborating with cyber analysts to operationalize datasets.

You will build data cleansing routines, apply SQL analytics, and create dashboards in Tableau/Power BI while ensuring security and governance in cloud and on-prem systems.

Qualifications

• ETL development for data pipelines (cyber data) including extraction, cleansing, and preparation for analytics.
• Proficient in data warehousing, data management, programming (Python), and ETL tools (NiFi, Pentaho, Kafka).
• Familiarity with the cyber domain and experience designing SQL-based data systems and complex queries.
• Experience deploying interactive dashboards with Tableau and/or Power BI; cloud environments (GCP, AWS); containerization with Docker/Kubernetes.

Responsibilities

• Develop, maintain, and execute data extraction pipelines across multiple environments.
• Engineer Python-based ETL pipelines to ingest, cleanse, and optimize large datasets.
• Prepare data using Python and SQL for exploratory analysis.
• Design and deploy dashboards and reports in Tableau/Power BI.

Skills

Python programming

SQL queries

Data warehousing

ETL development

Data analysis

Education

Bachelor's degree or higher in related field

Tools

Apache NiFi

Pentaho

Kafka

Google Cloud Platform

AWS

Docker

Kubernetes

GitHub

Tableau

Power BI

Job description

As the ETL Developer, you will analyze client challenges and develop innovative solutions by identifying and applying emerging tools and technologies to design and implement new data repositories. You will be responsible for maintaining and expanding the data pipelines that support critical national security missions, as well as managing data and data flows across both existing and new systems. Working closely with our team and cyber analysts, you will apply data engineering expertise to identify, integrate, and operationalize relevant datasets to support mission objectives.

The ideal candidate will have a strong background in Python-based data workflows and experience working in classified Intelligence Community (IC) environments. Additional experience supporting a broad range of data engineering functions, including data extraction, transformation, and loading (ETL), data mapping, data analysis, analytical support, operational support, database support, and the maintenance of data and associated systems.

Job Responsibilities

• Developing, maintaining, and executing data extraction pipelines to transport data in and out of multiple environments.
• ETL Development and Data Cleansing: Engineering Python-based ETL pipelines to ingest, clean, and optimize large datasets from various sources, refining data quality and processing efficiency.
• Data Preparation: Applying Python and SQL for data cleaning, integration, and exploratory analysis to uncover valuable insights extracted from large volumes of data.
• Data Visualization: Designing and deploying interactive dashboards and reporting in visualization tools (e.g., Tableau, Power BI)
• Improving application performance by optimizing and executing SQL queries to support data handling.
• Loading data into storage systems like databases or data warehouses.
• Building and maintaining data infrastructure (e.g., NiFi, Pentaho, Hevo).
• Maintaining and documenting ETL workflows and recording data movement/changes.
• Working in an Agile environment to rapidly iterate with our clients.
• Cross-functional collaboration: Partner closely with data scientists, data engineers, and application developers to translate complex business requirements into robust technical implementations.

Required Qualifications

• Active Top Secret/SCI (TS/SCI) clearance with a current Polygraph.
• U.S. Citizenship is required.
• Bachelor's degree with 3 years of related experience; OR Master's degree with 1 year of related experience; OR associate's degree with 6 years of related experience; OR High School diploma/GED with 9 years of related experience.
• Experience performing extract, transformation, load (ETL) development for data pipelines (specifically cyber data); to include integrating, cleansing, and preparing data from sources for analytics and reporting.
• Proficient in data warehousing, data management, programming (e.g., Python), and ETL tools (e.g., Apache NiFi, Pentaho, Kafka).
• Familiarity with the cyber domain.
• Experience designing and maintaining SQL-based data systems and crafting complex queries.
• Experience designing and deploying interactive dashboards and integrating data systems with visualization and analytics platforms using Tableau and/or Power BI.
• Experience with a cloud environment (e.g., Google Cloud Platform, AWS), including its security containerization technologies (e.g., Docker, Kubernetes).
• Language experience with Python.
• Experience with Git-based workflows and code repository platforms such as GitHub.
• Ability to perform API service development.

Desired Qualifications

• Experience with Hadoop and Spark
• Experience with Elasticsearch
• Experience with open-source cyber data sets such as Shodan and Censys.IO
• Experience with creating and implementing Artificial Intelligence (AI) models and tools

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.