Senior Dataflow Engineer — Linux, Python, Airflow, Spark

Captivation; Maryland; On-site; USD 130,000 - 270,000; Full time

Benefits offered by this job

Annual salary $130k–$270k

20% 401k contribution

HSA contribution

6 weeks paid time off

Comprehensive insurance

Job summary

Captivation is seeking a senior software engineer to design, implement, and optimize data ingress/egress pathways for analytics workloads. You will work with Python and Java, leveraging Apache Spark and Airflow to build scalable data pipelines.

Applicants must hold a Top Secret/SCI clearance and be a U.S. citizen. This direct-hire role requires strong Linux, scripting, and data processing experience in a mission-focused environment.

Qualifications

• Master's degree in Computer Science or related field with 5+ years SWE experience.
• Bachelor's degree in Computer Science or related field with 7+ years SWE experience.
• 9+ years of SWE experience in similar scope and complexity.

Responsibilities

• Design, implement, and optimize data ingress/egress pathways for analytics workloads.
• Develop and maintain data processing pipelines using Spark and Airflow.

Skills

Linux CLI

Bash scripting

Python

Java

Apache Airflow

Apache Spark

SQL (MySQL/MariaDB/PostgreSQL)

Jupyter Notebook

Pandas/NumPy

Git

Data wrangling

Parquet/JSON/CSV/XML

Education

Master's degree in Computer Science

Bachelor's degree in Computer Science

Tools

Linux

Airflow DAG design

Spark processing

Job description

Captivation is seeking a senior software engineer to design, implement, and optimize data ingress/egress pathways for analytics workloads. You will work with Python and Java, leveraging Apache Spark and Airflow to build scalable data pipelines.

Applicants must hold a Top Secret/SCI clearance and be a U.S. citizen. This direct-hire role requires strong Linux, scripting, and data processing experience in a mission-focused environment.