Senior Data Platform Engineer

Shield Consulting Solutions, Inc.; Maryland; Hybrid; USD 205,000 - 215,000; Full time

Benefits offered by this job

25 days PTO and 11 paid holidays

100% employer-paid healthcare for you

8% 401(k) employer match

Job summary

Shield Consulting Solutions, Inc. is seeking a Software Engineer with an active TS/SCI w/Polygraph clearance to design and maintain data workflows using Apache Airflow, Python, and Spark.

The role focuses on secure, scalable, and observable pipelines with collaboration across data engineering and platform teams. The position offers 16 hours of telework per week and is a full-time role based in Maryland, requiring 5 years of software engineering experience and a technical degree.

Qualifications

• 5 years of software engineering experience required.
• Bachelor’s degree in a technical discipline, or 2 additional years of experience in lieu of a degree.
• Active TS/SCI w/Polygraph clearance required.

Responsibilities

• Create and maintain data workflows and automation pipelines using Apache Airflow.
• Build reliable, scalable, and observable workflow orchestration solutions for data engineering, analytics and operations.
• Collaborate with data engineers, platform teams, and stakeholders to ensure workflows are secure and production-ready.

Skills

5 years software engineer experience

Active TS/SCI w/Polygraph

Education

Bachelor’s degree in a technical discipline

Tools

Linux CLI

Bash scripting

Python

Java

Apache Airflow

Apache Spark

Docker/Podman/containerd

Git

Job description

Security Clearance

Active TS/SCI w/Polygraph REQUIRED** Please do not apply if you do not currently possess this level of clearance.

Telework

Telework: 16 hours/week

Basic Requirements

• 5 years of experience as a software engineer
• Bachelor’s degree in a technical discipline
• 2 additional years of experience as a software engineer may be substituted for a degree

Job Description

• The Software Engineer shall be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow.
• This role focuses on building reliable, scalable, and observable workflow orchestration solutions that support data engineering, analytics, and operational use cases.
• The engineer will collaborate closely with data engineers, platform teams, and stakeholders to ensure workflows are efficient, secure, and production ready.

Required Experience

• Experience using the Linux CLI and Linux tools
• Experience developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience using Distributed Big Data processing engines including Apache Spark
• Experience with containerization technologies such as Docker, containerd, and Podman
• Experience with Git Source Control System

Desired Experience

• Experience using the Atlassian Tool Suite (JIRA, Confluence)
• Familiar with AWS Cloud Services and Infrastructure

Salary

Salary: $205,000 - $215,000 annually

Benefits

• Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents – available day 1, 8% 401(k) employer match – immediate vesting.

Disclaimer

Disclaimer: The salary range provided is an estimate based on current market conditions and may be adjusted based on factors such as experience, skills, and qualifications. The final salary offer will be determined after a thorough review of the candidate's background and alignment with the role. Please note that this range is subject to change and should be considered as a guideline rather than a definitive figure.

Equal Opportunity

Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

Position Type

This is a full time position