Senior Data Engineer - Linux, Python, Airflow & Spark

Captivation Software LLC; Maryland; On-site; USD 130,000 - 270,000; Full time

Job summary

Captivation Software LLC in Annapolis Junction, MD is seeking a Senior Software Engineer with Linux/Bash/Python expertise to design and optimize data ingress/egress pipelines for analytics workloads.

Responsibilities include building distributed processing with Apache Spark and Airflow, data wrangling with Pandas/NumPy, and working with JSON/Parquet data. Must hold TS/SCI clearance; US citizenship required; salary ranges from $130k to $270k per year depending on experience.

Qualifications

• Must hold Top Secret/SCI clearance with favorable polygraph; US citizen.
• Master's degree in CS or related field plus 5 years SWE experience.
• Bachelor's degree in CS or related field plus 7 years SWE experience.

Responsibilities

• Design, implement, and optimize data ingestion/egress pipelines for analytics workloads.
• Develop and optimize dataflow using Spark and Airflow; ensure scalable processing.
• Collaborate with teams to meet mission requirements.

Skills

Linux CLI

Bash scripting

Python

Java

Apache Airflow

Apache Spark

SQL databases

Jupyter Notebook

pandas

NumPy

JSON

Parquet

CSV

XML

Git

Education

Master's degree in Computer Science or related

Bachelor's degree in Computer Science or related

Tools

Git

Job description

Captivation Software LLC in Annapolis Junction, MD is seeking a Senior Software Engineer with Linux/Bash/Python expertise to design and optimize data ingress/egress pipelines for analytics workloads.

Responsibilities include building distributed processing with Apache Spark and Airflow, data wrangling with Pandas/NumPy, and working with JSON/Parquet data. Must hold TS/SCI clearance; US citizenship required; salary ranges from $130k to $270k per year depending on experience.