Security-Cleared Data Pipeline Engineer — AWS & Spark

J5 Consulting; Virginia (IL); On-site; USD 90,000 - 130,000; Full time

Benefits offered by this job

Health coverage

401(k) match

Paid time off

Tuition reimbursement

Bonuses

Professional development

Job summary

J5 Consulting, a Maryland-based firm established in 2006, seeks a data engineer to support travel data applications. You will help maintain data pipelines, ETL processes, and backend environments for government and commercial customers.

This onsite role in the Washington Metropolitan Area requires US citizenship and an active Top Secret Full Scope Polygraph clearance. The team delivers secure, compliant cloud-based solutions and ongoing development across the data landscape.

Qualifications

• Experience building and managing data pipelines.
• Proficient in Python and AWS cloud services.
• Experience with Spark and SQL databases.
• Skilled in Linux, shell scripting, and data formats (CSV/JSON/Parquet).
• Experience writing and validating unit tests.

Responsibilities

• Build and maintain data pipelines and ETL processes for travel data.
• Develop and support applications in AWS with Spark workloads.
• Collaborate to ingest travel data into new environments and user apps.
• Provide ongoing support and optimization of travel data models.
• Write and validate unit tests for data pipelines.

Skills

Data pipelines

Python

AWS

Spark

SQL databases

SQL

Linux

Shell scripting

Data formats

Unit tests

Tools

NiFi

Apache Airflow

Java

Scala

EMR

Spark tuning

Hive/Iceberg

Cloud security

CI/CD / Release management

Job description

J5 Consulting, a Maryland-based firm established in 2006, seeks a data engineer to support travel data applications. You will help maintain data pipelines, ETL processes, and backend environments for government and commercial customers.

This onsite role in the Washington Metropolitan Area requires US citizenship and an active Top Secret Full Scope Polygraph clearance. The team delivers secure, compliant cloud-based solutions and ongoing development across the data landscape.