Senior Data Engineer: Spark & Airflow (On-Site, TS/SCI)

Ctrl +; Fort Meade (MD); On-site; USD 170,000 - 188,000; Full time

Benefits offered by this job

10% employer 401(k) non-elective

Employer-paid life insurance

Disability insurance

Medical, dental and vision coverage

Professional development reimbursement

Equipment reimbursement

Referral programs

Paid team events

Job summary

Ctrl+ is seeking a data engineer to design data pathways, build Spark jobs, and orchestrate Airflow workflows at Fort Meade, MD. This in-person position emphasizes hands-on development with Linux, Python, and SQL in distributed processing environments.

Eligible candidates must meet TS/SCI with polygraph requirements and reside within commuting distance to Fort Meade. Role involves wrangling diverse data formats and ensuring data quality while choosing from compensation models with pay between

Qualifications

• 7 years of relevant experience with a Bachelor’s degree in Computer Science or related discipline (5 years with a Master’s; 9 years without a degree).

Responsibilities

• Design and optimize data ingress and egress pathways
• Build and tune Apache Spark distributed processing jobs
• Orchestrate and monitor workflows with Apache Airflow
• Wrangle structured, semi-structured and unstructured data
• Apply data quality, validation and anomaly detection practices

Skills

Linux command-line tools

Bash scripting

Python development

Java development

Apache Airflow

Apache Spark

SQL (MySQL/MariaDB/PostgreSQL)

Jupyter/Pandas/NumPy

Git

Education

Bachelor’s degree in Computer Science or related discipline

Tools

Apache Airflow

Apache Spark

MySQL/MariaDB/PostgreSQL

Jupyter/Pandas/NumPy

Git

Job description

Ctrl+ is seeking a data engineer to design data pathways, build Spark jobs, and orchestrate Airflow workflows at Fort Meade, MD. This in-person position emphasizes hands-on development with Linux, Python, and SQL in distributed processing environments.

Eligible candidates must meet TS/SCI with polygraph requirements and reside within commuting distance to Fort Meade. Role involves wrangling diverse data formats and ensuring data quality while choosing from compensation models with pay between