Software Data Engineer / Apache Airflow

Gigatec; Annapolis (MD); On-site; USD 90,000 - 120,000; Full time

Benefits offered by this job

100% Paid Healthcare

10% 401k in every paycheck

100% Fully Vested!

Job summary

Gigatec in Annapolis, Maryland is looking for a Data Engineer responsible for building workflow engines and designing reliable Apache Airflow pipelines. Your work ensures efficient data flow for analytics and operational needs.

The ideal candidate will have experience with Linux, Bash scripting, Python, Java, and significant knowledge in Apache Airflow and Distributed Big Data technologies. This role requires a Top Secret clearance and offers excellent benefits.

Qualifications

• Experience using the Linux CLI and tools.
• Experience developing Bash scripts for automation.
• Recent software development experience with Python and Java.
• Experience using Apache Airflow for workflow management.
• Knowledge of Distributed Big Data processing like Apache Spark.
• Experience with containerization technologies like Docker.

Responsibilities

• Build workflow engines and design reliable Apache Airflow pipelines.
• Ensure data is moving cleanly and efficiently for analytics.
• Automate manual processes using Bash scripts.

Skills

Linux CLI

Bash scripting

Python

Java

Apache Airflow

Apache Spark

Docker

Git

Tools

Atlassian Tool Suite (JIRA, Confluence)

AWS Cloud Services

Job description

NOTE – Our positions require a Top Secret clearance, as well as the favorable completion of a polygraph. Applicants must be authorized to work in the U.S. We are unable to sponsor an employment Visa.

What You’ll Be Doing (We don’t love the bullet points, but we love the work!)

In this key Data Engineering role, you'll get to build the workflow engines behind the curtain, designing reliable Apache Airflow pipelines that keep data moving cleanly, efficiently, and on schedule for analytics and operational needs.

Perks and Benefits

• 100% Paid Healthcare
• 10% 401k in every paycheck
• 100% Fully Vested!

Required Skills

• Experience using the Linux CLI and Linux tools
• Experience developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience using Distributed Big Data processing engines including Apache Spark
• Experience with containerization technologies such as Docker, containerd, and Podman
• Experience with Git Source Control System

Desired Skills

• Experience using the Atlassian Tool Suite (JIRA, Confluence)
• Familiar with AWS Cloud Services and Infrastructure
• Appreciates a sense of humor and the occasional well-timed joke.