Data Engineer - ETL, AWS & Spark for Travel Data

J5 Consulting; Tysons (VA); On-site; USD 90,000 - 120,000; Full time

Benefits offered by this job

100% employer-paid health coverage

6% 401(k) match

PTO

tuition reimbursement

bonuses

professional development

Job summary

J5 Consulting is seeking candidates for an operations and maintenance team specializing in travel data applications in Tysons, Virginia. The role requires building data pipelines and utilizing AWS services, with a strong focus on Python and Apache Spark. Additionally, a Top Secret Security Clearance with Polygraph and US Citizenship are mandatory. Comprehensive benefits include employer-paid health coverage, 401(k) match, and professional development opportunities.

Qualifications

• Demonstrated experience with US Citizenship verification for federal government security requirements.
• Active U.S. Government Top Secret Security Clearance with Full Scope Polygraph is required.

Responsibilities

• Support travel data applications and backend environment.
• Provide ongoing development to travel data models and ETL pipelines.
• Maintain data pipelines and security solutions.

Skills

Building and managing data pipelines

Python

Cloud computing using AWS services

Processing data using Apache Spark

RDBMS (Postgres, Oracle, MySQL)

SQL queries

Linux and shell scripting

Analyzing data in CSV, XML, JSON, Avro, Parquet

Writing and validating unit tests

Tools

NiFi

Apache Airflow

Java

Scala

EMR/Spark cluster

Hive

Job description

J5 Consulting is seeking candidates for an operations and maintenance team specializing in travel data applications in Tysons, Virginia. The role requires building data pipelines and utilizing AWS services, with a strong focus on Python and Apache Spark. Additionally, a Top Secret Security Clearance with Polygraph and US Citizenship are mandatory. Comprehensive benefits include employer-paid health coverage, 401(k) match, and professional development opportunities.