ETL Data Engineer

Valiant Technologies LLC; Reston (VA); Vor Ort; USD 120.000 - 180.000; Vollzeit

Zusammenfassung

Valiant Technologies LLC is seeking an ETL Developer to analyze client challenges and implement data pipeline solutions that support national security missions. You will design Python-based ETL workflows, cleanse large datasets, and deliver dashboards using Tableau or Power BI.

The role requires hands-on experience with data warehousing, SQL, cloud environments, and tools like NiFi, Pentaho, and Kafka. A TS/SCI clearance is required, with US citizenship.

Qualifikationen

• Experience developing ETL pipelines for cyber data and analytics.
• Proficient in Python, SQL, data modeling, and data workflows.
• Strong background in data warehousing, data management, and visualization.
• Familiarity with cloud environments and security best practices.

Aufgaben

• Develop, maintain, and optimize data extraction pipelines across environments.
• Build Python-based ETL processes to ingest and cleanse large datasets.
• Prepare data using Python/SQL for analytics and reporting.
• Design and deploy dashboards in Tableau or Power BI.
• Tune SQL queries and load data into warehouses or databases.
• Maintain ETL workflows and document data movements.
• Collaborate with data scientists, engineers, and developers in Agile sprints.

Kenntnisse

Python programming

SQL proficiency

ETL development

Data warehousing

Data cleansing

Data visualization

Ausbildung

Bachelor's degree in a related field

Master's degree in a related field

Associate's degree with related experience

High School diploma with related experience

Tools

Apache NiFi

Pentaho

Kafka

Tableau

Power BI

Docker

Kubernetes

GitHub

Jobbeschreibung

As the ETL Developer, you will analyze client challenges and develop innovative solutions by identifying and applying emerging tools and technologies to design and implement new data repositories. You will be responsible for maintaining and expanding the data pipelines that support critical national security missions, as well as managing data and data flows across both existing and new systems. Working closely with our team and cyber analysts, you will apply data engineering expertise to identify, integrate, and operationalize relevant datasets to support mission objectives.

The ideal candidate will have a strong background in Python-based data workflows and experience working in classified Intelligence Community (IC) environments. Additional experience supporting a broad range of data engineering functions, including data extraction, transformation, and loading (ETL), data mapping, data analysis, analytical support, operational support, database support, and the maintenance of data and associated systems.

Job Responsibilities:

• Developing, maintaining, and executing data extraction pipelines to transport data in and out of multiple environments.
• ETL Development and Data Cleansing: Engineering Python-based ETL pipelines to ingest, clean, and optimize large datasets from various sources, refining data quality and processing efficiency.
• Data Preparation: Applying Python and SQL for data cleaning, integration, and exploratory analysis to uncover valuable insights extracted from large volumes of data.
• Data Visualization: Designing and deploying interactive dashboards and reporting in visualization tools (e.g., Tableau, Power BI)
• Improving application performance by optimizing and executing SQL queries to support data handling.
• Loading data into storage systems like databases or data warehouses.
• Building and maintaining data infrastructure (e.g., NiFi, Pentaho, Hevo).
• Maintaining and documenting ETL workflows and recording data movement/changes.
• Working in an Agile environment to rapidly iterate with our clients.
• Cross-functional collaboration: Partner closely with data scientists, data engineers, and application developers to translate complex business requirements into robust technical implementations.

Required Qualifications:

• Active Top Secret/SCI (TS/SCI) clearance with a current Polygraph.
• U.S. Citizenship is required.
• Bachelor's degree with 3 years of related experience; OR Master's degree with 1 year of related experience; OR associate's degree with 6 years of related experience; OR High School diploma/GED with 9 years of related experience.
• Experience performing extract, transformation, load (ETL) development for data pipelines (specifically cyber data); to include integrating, cleansing, and preparing data from sources for analytics and reporting.
• Proficient in data warehousing, data management, programming (e.g., Python), and ETL tools (e.g., Apache NiFi, Pentaho, Kafka).
• Familiarity with the cyber domain.
• Experience designing and maintaining SQL-based data systems and crafting complex queries.
• Experience designing and deploying interactive dashboards and integrating data systems with visualization and analytics platforms using Tableau and/or Power BI.
• Experience with a cloud environment (e.g., Google Cloud Platform, AWS), including its security containerization technologies (e.g., Docker, Kubernetes).
• Language experience with Python.
• Experience with Git-based workflows and code repository platforms such as GitHub.
• Ability to perform API service development.

Desired Qualifications:

• Experience with Hadoop and Spark
• Experience with Elasticsearch
• Experience with open-source cyber data sets such as Shodan and Censys.IO
• Experience with creating and implementing Artificial Intelligence (AI) models and tools

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.