Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON

Captivation-Software

Maryland

On-site

USD 130,000 - 270,000

Full time

6 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Up to 20% 401k contribution
HSA contribution $3,600
Company paid medical/dental/vision/HR/

Job summary

Captivation Software is seeking a senior software engineer to design, implement, and optimize data ingress/egress pathways for analytics workloads using Spark and Airflow. You will work on distributed processing pipelines and leverage Python, Bash, and SQL technologies to ensure scalable performance.

The role requires a Top Secret/SCI clearance, U.S. citizenship, and advanced degree with substantial SWE experience in similar contracts.

Qualifications

  • Must currently hold a Top Secret/SCI U.S. Government security clearance with a favorable Polygraph, therefore all candidates must be a U.S. citizen
  • Master's degree in Computer Science or related discipline from an accredited college or university, plus five (5) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity
  • Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus seven (7) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity

Responsibilities

  • Design, implement, and optimize data ingress/egress pathways to ensure efficient, scalable analytics workloads.
  • Develop and maintain Apache Spark-based distributed processing pipelines for large datasets.
  • Automate manual processes using Bash scripts and manage Linux environments.

Skills

Linux CLI
Bash scripting
Python
Java
Apache Airflow
Apache Spark
SQL
MySQL
MariaDB
PostgreSQL
Jupyter Notebook
pandas
NumPy
JSON
CSV
XML
Data quality
Git
Jira
Confluence
Slurm

Education

Master's degree in Computer Science or related discipline
Bachelor's degree in Computer Science or related discipline
Nine years of SWE experience

Tools

Jira
Confluence
Slurm

Job description

Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON

Annapolis Junction, MD

Build to something to be proud of.

Captivation has built a reputation on providing customers exactly what is needed in a timely manner. Our team of engineers take pride in what they develop and constantly innovate to provide the best solution. Captivation is looking for software developers who can get stuff done while making a difference in support of the mission to protect our country.

Description

Captivation Software is looking for a senior level software engineer who shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing. In this role, the Software Engineer shall be responsible for designing, implementing, and optimizing data ingress/egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.

Requirements
Security Clearance:
  • Must currently hold a Top Secret/SCI U.S. Government security clearance with a favorable Polygraph, therefore all candidates must be a U.S. citizen
Minimum Qualifications:
  • Master's degree in Computer Science or related discipline from an accredited college or university, plus five (5) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
  • Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus seven (7) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity
  • Nine (9) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
Required Skills:
  • Experience using the Linux CLI and Linux tools
  • Experience developing Bash scripts to automate manual processes
  • Recent software development experience using Python and Java
  • Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
  • Experience with Distributed Big Data processing engines including Apache Spark
  • Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
  • Experience using Jupyter Notebook
  • Experience with data wrangling and preprocessing using tools such as pandas, NumPy
  • Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
  • Familiarity with data quality concepts, data validation, and anomaly detection
  • Experience with Git Source Control System
Desired Skills:
  • Familiar with HPC Job Scheduling tools including Slurm
  • Experience with the Atlassian Tool Suite including Jira and Confluence

This position is open for direct hires only. We will not consider candidates from third party staffing/recruiting firms.

  • Annual Salary: $130,000 - $270,000 (Depends on the Years of Experience)
  • Up to 20% 401k contribution (No Matching Required and Vested from Day 1)
  • Above Market Hourly Rates
  • $3,600 HSA Contribution
  • Company Paid Employee Medical/Dental/Vision Insurance/Life Insurance/Short-Term & Long-Term Disability/AD&D
Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Captivation Software’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

We invite applicants to share their demographic background. If you choose to complete this survey, your responses may be used to identify areas of improvement in our hiring process.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Voluntary Self-Identification of Disability

Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 07/31/2029

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability.

Disabilities include, but are not limited to:
  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Software Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWS
Software Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWS

Captivation-Software • Maryland

Hybrid
USD 130,000 - 270,000
Annual salary: $130,000–$270,000
Up to 20% 401k contribution
Above Market Hourly Rates
+2
Software Engineer 3 - C++/Python/DevOps/Kubernetes/GPU
Software Engineer 3 - C++/Python/DevOps/Kubernetes/GPU

Captivation Software • Maryland

On-site
USD 130,000 - 270,000
Up to 20% 401k contribution
$3,600 HSA contribution
Company-paid health/vision/dental/Life
Software Engineer 2 - Linux/Bash/Python/IAM/CI/CD/Git
Software Engineer 2 - Linux/Bash/Python/IAM/CI/CD/Git

Captivation-Software • Maryland

Hybrid
USD 130,000 - 270,000
401(k) plan
HSA contribution
Medical/dental/vision insurance
+1
Software Engineer 2 - Linux/Bash/Python/Rust/HPC/CI/CD/Git/Agile
Software Engineer 2 - Linux/Bash/Python/Rust/HPC/CI/CD/Git/Agile

Linuxconfig • Annapolis (MD)

On-site
USD 130,000 - 270,000
Up to 20% 401k contribution
$3,600 HSA contribution
Company-paid Employee Medical/Dental/V
+2
Full-Stack Developer (Mid/Senior) (On Call) - Java/C/C++/Python/Bash/Elasticsearch/Oracle/Spring Boot/Linux
Full-Stack Developer (Mid/Senior) (On Call) - Java/C/C++/Python/Bash/Elasticsearch/Oracle/Spring Boot/Linux

Captivation Software • Maryland

On-site
USD 130,000 - 270,000
401k contribution up to 20%
HSA contribution
Company paid medical/dental/vision
+1
Software Engineer 1 - Java/Confluence/Jira/AWS/Maven/MapReduce
Software Engineer 1 - Java/Confluence/Jira/AWS/Maven/MapReduce

Captivation Software • Maryland

On-site
USD 130,000 - 270,000
Systems Engineer 3 - DevOps
Systems Engineer 3 - DevOps

Captivation-Software • Maryland

On-site
USD 130,000 - 270,000
401k with employer contribution
Comprehensive health/vision/dental/AD&
Life and disability insurance
Software Integration Engineer 2 (On-Call) - Linux/Bash/Python/Docker/Kubernetes/IaC/Helm/Promet[...]
Software Integration Engineer 2 (On-Call) - Linux/Bash/Python/Docker/Kubernetes/IaC/Helm/Promet[...]

Captivation-Software • Maryland

On-site
USD 130,000 - 270,000
Up to 20% 401k contribution
HSA contribution
Company-paid medical/dental/vision
+1
Software Engineer 2 - Python/PySpark/AWS
Software Engineer 2 - Python/PySpark/AWS

Captivation Software • Maryland

On-site
USD 130,000 - 270,000
401k
Health Insurance
Dental Insurance
+3
Systems Engineer 2 - Confluence/Jira/Kibana/Grafana
Systems Engineer 2 - Confluence/Jira/Kibana/Grafana

Captivation-Software • Maryland

On-site
USD 130,000 - 270,000
401k contribution up to 20%
Above market hourly rates
HSA contribution $3,600
+3