Security-Cleared Data Engineer: Airflow Pipelines & Big Data

Gigatec; Annapolis (MD); On-site; USD 90,000 - 120,000; Full time

Benefits offered by this job

100% Paid Healthcare

10% 401k in every paycheck

100% Fully Vested!

Job summary

Gigatec in Annapolis, Maryland is looking for a Data Engineer responsible for building workflow engines and designing reliable Apache Airflow pipelines. Your work ensures efficient data flow for analytics and operational needs.

The ideal candidate will have experience with Linux, Bash scripting, Python, Java, and significant knowledge in Apache Airflow and Distributed Big Data technologies. This role requires a Top Secret clearance and offers excellent benefits.

Qualifications

• Experience using the Linux CLI and tools.
• Experience developing Bash scripts for automation.
• Recent software development experience with Python and Java.
• Experience using Apache Airflow for workflow management.
• Knowledge of Distributed Big Data processing like Apache Spark.
• Experience with containerization technologies like Docker.

Responsibilities

• Build workflow engines and design reliable Apache Airflow pipelines.
• Ensure data is moving cleanly and efficiently for analytics.
• Automate manual processes using Bash scripts.

Skills

Linux CLI

Bash scripting

Python

Java

Apache Airflow

Apache Spark

Docker

Git

Tools

Atlassian Tool Suite (JIRA, Confluence)

AWS Cloud Services

Job description

Gigatec in Annapolis, Maryland is looking for a Data Engineer responsible for building workflow engines and designing reliable Apache Airflow pipelines. Your work ensures efficient data flow for analytics and operational needs.

The ideal candidate will have experience with Linux, Bash scripting, Python, Java, and significant knowledge in Apache Airflow and Distributed Big Data technologies. This role requires a Top Secret clearance and offers excellent benefits.