Systems Engineer

J5 Consulting; Virginia (MN); On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

100% employer-paid health coverage

6% 401(k) match

PTO

Tuition reimbursement

Bonuses

Professional development

Job summary

J5 Consulting is seeking a skilled data engineer to support operations for travel data applications. Candidates must have experience in building data pipelines, cloud computing, and tools like Apache Spark.

US Citizenship and an active U.S. Government Top Secret Security Clearance are mandatory. The role offers benefits including employer-paid health coverage, a 401(k) match, and professional development opportunities.

Qualifications

• Must have experience building and managing data pipelines.
• Proficient in Python programming.
• Experience with AWS services required.
• Knowledge of Apache Spark for data processing.
• Able to write SQL queries for RDBMS like Postgres or Oracle.
• Familiar with Linux and shell scripting.
• Experience analyzing various file formats like CSV and JSON.
• Must be able to write and validate unit tests.

Responsibilities

• Provide operations and maintenance for existing applications.
• Develop support for travel data applications.
• Support and develop travel data ETL pipelines.
• Assist with analytic capabilities of travel applications.

Skills

Data pipelining

Python

AWS services

Apache Spark

SQL queries

Linux and shell scripting

Data formats (CSV, XML, JSON, Avro, Parquet)

Unit tests

NiFi or Apache AirFlow

Java or Scala

EMR/Spark cluster administration

Performance tuning of Spark jobs

Supporting SQL access technologies

Cloud-based security solutions

Configuration management processes

Job description

Introduction

J5 Consulting is a Maryland based company established in 2006 to provide computing and consulting services for government and commercial entities. Our services improve Information System networking performance and compliance and protect electronic assets from loss and compromise. The Sponsor requires a team to provide operations and maintenance as well as new development work for existing applications. The Sponsor's office is a central data processor and applications developer for applications that utilize travel data. The Sponsor aims to establish support to travel data applications and the associated backend environment while the travel data undergoes a transition period and is ingested into new environments and user applications. As these travel applications analytic capabilities continue to be absorbed, this team will need to provide ongoing support and development to travel data models and travel data ETL pipelines.

Required Skills and Demonstrated Experience

• Demonstrated experience building and managing data pipelines
• Demonstrated experience with Python
• Demonstrated experience with cloud computing using AWS services
• Demonstrated experience processing data using Apache Spark
• Demonstrated experience with an RDBMS (Relational Database Management System) such as Postgres, Oracle, or MySQL and writing SQL queries
• Demonstrated experience with Linux and shell scripting
• Demonstrated experience analyzing data in different file formats such as CSV, XML, JSON, Avro, and Parquet
• Demonstrated experience writing and validating unit tests

Highly Desired Skills and Demonstrated Experience

• Demonstrated experience in NiFi, Apache AirFlow, or equivalent orchestration tools for data pipelines
• Demonstrated experience with Java or Scala
• Demonstrated experience administering an EMR/Spark cluster
• Demonstrated experience conducting performance tuning of Spark jobs
• Demonstrated experience supporting Hive, Iceberg, or similar SQL access technologies
• Demonstrated experience developing cloud-based security solutions
• Demonstrated experience following configuration management processes to review and deploy code as part of releases

US Citizenship

• This position requires US Citizenship. Verification of US Citizenship to meet federal government security requirements will be confirmed

Security Clearance

• The successful candidate must have an active U.S. Government Top Secret Security Clearance with a Full Scope Polygraph
• Clearance Verification: This position requires successful verification of the stated security clearance to meet federal government customer requirements. You will be asked to provide clearance verification information prior to an offer of employment

Travel

• This position is expected to be onsite. The position will be located within the Washington Metropolitan Area (WMA). Local travel/POV will be on an as needed basis, within the local place of performance

Benefits

• 100% employer-paid health coverage
• a 6% 401(k) match
• PTO
• tuition reimbursement
• bonuses
• professional development, and more