Data Engineer – ETL, AWS & Spark (Travel Data)

J5 Consulting; Virginia (MN); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health coverage

401(k) match

PTO

Tuition reimbursement

Bonuses

Professional development

Job summary

J5 Consulting seeks a Data Engineer to support travel data applications and ETL pipelines for government and commercial clients. You will build and optimize data pipelines, handle diverse data formats, and work with AWS, Spark, and SQL databases in a Linux environment.

Position requires onsite work in the Washington Metropolitan Area with security clearances and US citizenship considerations. Join an 18+ year cybersecurity focused firm.

Qualifications

• Experience building and managing data pipelines.
• Proficiency in Python and AWS cloud services.
• Experience with Spark processing and SQL/RDBMS.
• Comfort with Linux and shell scripting; handling varied data formats.
• Ability to write and validate unit tests.

Skills

Data pipelines

Python

AWS

Spark

SQL

Linux scripting

Data formats

Unit tests

Tools

PostgreSQL/Oracle/MySQL

Apache Spark

NiFi/Airflow (desirable)

Job description

J5 Consulting seeks a Data Engineer to support travel data applications and ETL pipelines for government and commercial clients. You will build and optimize data pipelines, handle diverse data formats, and work with AWS, Spark, and SQL databases in a Linux environment.

Position requires onsite work in the Washington Metropolitan Area with security clearances and US citizenship considerations. Join an 18+ year cybersecurity focused firm.