Senior Software Engineer – Spark & Airflow Data Pipelines

Ctrl +

Fort Meade (MD)

On-site

USD 170,000 - 188,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

10% employer 401(k) non-elective
Employer-paid life insurance
Disability insurance
Medical, dental and vision coverage
Professional development reimbursement
Equipment reimbursement
Referral programs
Paid team events

Job summary

Ctrl+ is seeking a data engineer to design data pathways, build Spark jobs, and orchestrate Airflow workflows at Fort Meade, MD. This in-person position emphasizes hands-on development with Linux, Python, and SQL in distributed processing environments.

Eligible candidates must meet TS/SCI with polygraph requirements and reside within commuting distance to Fort Meade. Role involves wrangling diverse data formats and ensuring data quality while choosing from compensation models with pay between

Qualifications

  • 7 years of relevant experience with a Bachelor’s degree in Computer Science or related discipline (5 years with a Master’s; 9 years without a degree).

Responsibilities

  • Design and optimize data ingress and egress pathways
  • Build and tune Apache Spark distributed processing jobs
  • Orchestrate and monitor workflows with Apache Airflow
  • Wrangle structured, semi-structured and unstructured data
  • Apply data quality, validation and anomaly detection practices

Skills

Linux command-line tools
Bash scripting
Python development
Java development
Apache Airflow
Apache Spark
SQL (MySQL/MariaDB/PostgreSQL)
Jupyter/Pandas/NumPy
Git

Education

Bachelor’s degree in Computer Science or related discipline

Tools

Apache Airflow
Apache Spark
MySQL/MariaDB/PostgreSQL
Jupyter/Pandas/NumPy
Git

Job description

Work location: Fort Meade, MD

Work arrangement: On-site

Required Clearance: TS/SCI with polygraph

Applicants must currently hold an active TS/SCI with polygraph. Ctrl+ does not sponsor new security clearances or clearance upgrades. Applicants who do not meet this requirement cannot be considered.

Location & In-Person Requirement

All positions require in-person work. Applicants must live within commuting distance of the listed work location to be considered. Some roles may allow limited telework, but regular on-site attendance is required. These are not fully remote positions.

Your next challenge

Design the data pathways that keep analytics moving. Build reliable ingest and egress flows powered by Spark and Airflow.

The mission

Support distributed data processing and analytics workloads that help mission teams work with large, varied datasets.

What you’ll do
  • Design and optimize data ingress and egress pathways
  • Build and tune Apache Spark distributed processing jobs
  • Orchestrate and monitor workflows with Apache Airflow
  • Wrangle structured, semi-structured and unstructured data
  • Apply data quality, validation and anomaly detection practices
What you’ll bring
  • 7 years of relevant experience with a Bachelor’s degree in Computer Science or a related discipline (5 years with a Master’s, or 9 years without a degree).
  • Linux command-line tools
  • Bash scripting
  • Recent Python and Java development
  • Apache Airflow DAG design, scheduling, operators and sensors
  • Apache Spark or similar distributed processing engines
  • SQL with MySQL, MariaDB or PostgreSQL
  • Jupyter, pandas and NumPy
  • Parquet, JSON, CSV and XML data
  • Git
Preferred qualifications
  • Slurm or other HPC job schedulers
  • Jira and Confluence
Compensation and flexibility

$123.63–$136.51 per hour in approximate pay; employer 401(k) contribution is additional.

Compensation: The listed range reflects approximate hourly pay across our compensation models and excludes Ctrl+’s employer 401(k) contribution. Your hourly pay will vary based on qualifications, experience, and the compensation model you select. The lower end reflects a no-bonus option with five weeks of PTO; the upper end reflects the Max Rate option without bonus or PTO.

Choose from three compensation models: Max Rate, With Bonus, or With Bonus and PTO. Offers include a projected five-year compensation comparison and a package comparison sheet. PTO and bonuses depend on the selected model and role eligibility.

Why Ctrl+?

Ctrl+ is a software engineering and staffing firm based in Elkridge, Maryland, supporting Department of Defense missions in the Fort Meade area and other listed locations. Founded by two college roommates, Brad and Bhavin, Ctrl+ brings a close-knit team approach, with founders who work on contracts alongside employees.

Benefits include:
  • 10% employer 401(k) non-elective contribution
  • Employer-paid life insurance and short- and long-term disability insurance
  • Medical, dental and vision coverage options
  • Employee Assistance Program
  • Professional development and certification reimbursement
  • Technology and ergonomic equipment reimbursement, subject to eligibility
  • Referral and retention bonus programs, subject to eligibility
  • Paid social and team events
Equal Opportunity Employer

Ctrl+ is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex (including pregnancy, sexual orientation, and gender identity), national origin, age, disability, genetic information, marital status, military or veteran status, or any other characteristic protected by applicable law. Hiring decisions are based on qualifications, experience, and job requirements. Reasonable accommodations are available to qualified applicants with disabilities during the application and hiring process.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead DevOps Engineer – AWS & Kubernetes
Lead DevOps Engineer – AWS & Kubernetes

Ctrl + • Corridor North (MD)

On-site
USD 167,000 - 185,000
401(k) contribution
Life insurance
Disability insurance
+8
Senior Java Software Engineer – Cloud Modernization
Senior Java Software Engineer – Cloud Modernization

CTRL + LLC • Corridor North (MD)

On-site
USD 146,000 - 190,000
401(k) match
Life insurance
Health benefits
+1
Python Software Engineer – HPC Infrastructure
Python Software Engineer – HPC Infrastructure

CTRL + LLC • Corridor North (MD)

On-site
USD 125,000 - 164,000
10% employer 401(k) non-elective
Employer-paid life insurance
Disability insurance
+5
Senior DevOps Engineer
Senior DevOps Engineer

Ctrl + • Corridor North (MD)

On-site
USD 116,000 - 150,000
401(k) matching
Life Insurance
Disability Insurance
+7
Senior Software Integration Engineer – Mission Operations Liaison
Senior Software Integration Engineer – Mission Operations Liaison

Ctrl + • Fort Meade (MD)

On-site
USD 154,000 - 170,000
401(k) employer contribution
Life insurance
Disability insurance
+6
Senior DevOps Engineer
Senior DevOps Engineer

CTRL + LLC • Maryland

Hybrid
USD 116,000 - 150,000
401(k) employer contribution
Life and disability insurance
Medical/dental/vision coverage
+5
Java Software Engineer Enterprise Data Applications
Java Software Engineer Enterprise Data Applications

CTRL + LLC • Corridor North (MD)

On-site
USD 6,700 - 8,800
10% employer 401(k) non-elective
Employer-paid life insurance and short
Medical, dental and vision coverage
+5
Software Engineer – Developer Platforms & Automation
Software Engineer – Developer Platforms & Automation

CTRL + LLC • Maryland

On-site
USD 125,000 - 164,000
Senior Software Engineer – Privileged Access
Senior Software Engineer – Privileged Access

CTRL + LLC • Maryland

On-site
USD 145,000 - 188,000
401(k) employer contribution
Life insurance
Short-term & long-term disability
+6
Systems Engineer
Systems Engineer

CTRL + LLC • Maryland

On-site
USD 83,000 - 107,000
401(k) non-elective contribution
Life insurance
Disability insurance
+6