Data Engineer – ETL Pipelines, Spark, AWS, TS/Poly

J5 Consulting; Tysons (VA); On-site; USD 90,000 - 120,000; Full time

Benefits offered by this job

100% employer-paid health coverage

6% 401(k) match

PTO

tuition reimbursement

bonuses

professional development

Job summary

J5 Consulting, based in Tysons, Virginia, is seeking a skilled data engineer to support travel data applications and backend development. Responsibilities include building data pipelines and ensuring robust data processing using tools like Python and AWS. Candidates must be U.S. citizens with an active Top Secret Security Clearance. Comprehensive benefits include fully paid health coverage and a 6% 401(k) match, fostering professional growth in cybersecurity.

Qualifications

• Experience building and managing data pipelines.
• Experience with cloud computing using AWS services.
• Experience processing data using Apache Spark.
• Experience with RDBMS like Postgres, Oracle, or MySQL.

Responsibilities

• Provide operations and maintenance for travel data applications.
• Support travel data applications during transition periods.
• Develop and manage ongoing support for travel data models and ETL pipelines.

Skills

Data pipeline management

Python

AWS services

Apache Spark

SQL

Linux and shell scripting

Data analysis in various formats

Unit testing

Tools

Apache NiFi

Apache AirFlow

Java

Scala

EMR/Spark cluster

Hive

Job description

J5 Consulting, based in Tysons, Virginia, is seeking a skilled data engineer to support travel data applications and backend development. Responsibilities include building data pipelines and ensuring robust data processing using tools like Python and AWS. Candidates must be U.S. citizens with an active Top Secret Security Clearance. Comprehensive benefits include fully paid health coverage and a 6% 401(k) match, fostering professional growth in cybersecurity.