Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON

Captivation Software; Maryland; On-site; USD 130,000 - 270,000; Full time

Job summary

Captivation Software LLC in Annapolis Junction, MD is seeking a Senior Software Engineer with Linux/Bash/Python expertise to design and optimize data ingress/egress pipelines for analytics workloads.

Responsibilities include building distributed processing with Apache Spark and Airflow, data wrangling with Pandas/NumPy, and working with JSON/Parquet data. Must hold TS/SCI clearance; US citizenship required; salary ranges from $130k to $270k per year depending on experience.

Qualifications

• Must hold Top Secret/SCI clearance with favorable polygraph; US citizen.
• Master's degree in CS or related field plus 5 years SWE experience.
• Bachelor's degree in CS or related field plus 7 years SWE experience.

Responsibilities

• Design, implement, and optimize data ingestion/egress pipelines for analytics workloads.
• Develop and optimize dataflow using Spark and Airflow; ensure scalable processing.
• Collaborate with teams to meet mission requirements.

Skills

Linux CLI

Bash scripting

Python

Java

Apache Airflow

Apache Spark

SQL databases

Jupyter Notebook

pandas

NumPy

JSON

Parquet

CSV

XML

Git

Education

Master's degree in Computer Science or related

Bachelor's degree in Computer Science or related

Tools

Git

Job description

Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON

Annapolis Junction, MD

Build to something to be proud of.

Captivation has built a reputation on providing customers exactly what is needed in a timely manner. Our team of engineers take pride in what they develop and constantly innovate to provide the best solution. Captivation is looking for software developers who can get stuff done while making a difference in support of the mission to protect our country.

Description

Captivation Software is looking for a senior level software engineer who shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing. In this role, the Software Engineer shall be responsible for designing, implementing, and optimizing data ingress/egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.

Requirements

Security Clearance:

• Must currently hold a Top Secret/SCI U.S. Government security clearance with a favorable Polygraph, therefore all candidates must be a U.S. citizen

Minimum Qualifications:

• Master's degree in Computer Science or related discipline from an accredited college or university, plus five (5) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
• Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus seven (7) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity
• Nine (9) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.

Required Skills:

• Experience using the Linux CLI and Linux tools
• Experience developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience with Distributed Big Data processing engines including Apache Spark
• Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
• Experience using Jupyter Notebook
• Experience with data wrangling and preprocessing using tools such as pandas, NumPy
• Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
• Familiarity with data quality concepts, data validation, and anomaly detection
• Experience with Git Source Control System

Desired Skills:

• Familiar with HPC Job Scheduling tools including Slurm
• Experience with the Atlassian Tool Suite including Jira and Confluence

This position is open for direct hires only. We will not consider candidates from third party staffing/recruiting firms.

• Annual Salary: $130,000 - $270,000 (Depends on the Years of Experience)
• Up to 20% 401k contribution (No Matching Required and Vested from Day 1)
• Above Market Hourly Rates
• $3,600 HSA Contribution
• Company Paid Employee Medical/Dental/Vision Insurance/Life Insurance/Short-Term & Long-Term Disability/AD&D

U.S. Standard Demographic Questions

We invite applicants to share their demographic background. If you choose to complete this survey, your responses may be used to identify areas of improvement in our hiring process.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Captivation Software’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A \"disabled veteran\" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A \"recently separated veteran\" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An \"active duty wartime or campaign badge veteran\" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An \"Armed forces service medal veteran\" means a veteran who, while serving on active duty in the U.S. military, ground, naval or arm service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.