Data Workflow Engineer - Airflow, Spark & Python

redarchsolutions; Maryland; On-site; USD 160,000 - 185,000; Full time

Benefits offered by this job

Health benefits

PTO

401K match

Annual bonus

Job summary

Red Arch Solutions is seeking a Software Engineer in Maryland to create and maintain data workflows and automation pipelines using Apache Airflow. You will build reliable, scalable, and observable workflow orchestration solutions supporting data engineering, analytics, and operations.

The role requires strong Python/Java development, Linux & Bash scripting, and experience with Airflow, Spark, and containerization.

Qualifications

• Experience with Linux CLI and scripting for automation.
• Professional software development with Python and Java.
• Airflow DAG design, scheduling, operators and sensors.
• Experience with Spark for distributed data processing.
• Containerization with Docker/Podman; Git for source control.

Responsibilities

• Create and maintain data workflows and automation pipelines.
• Collaborate with data engineers, platform teams and stakeholders.
• Ensure workflows are reliable, scalable, observable, and production-ready.
• Develop, test, and optimize Airflow DAGs and monitoring.

Skills

Linux CLI

Bash scripting

Python

Java

Apache Airflow

Spark

Docker/Podman

Git

Education

Master's degree in computer science or related discipline

Bachelor's degree in computer science or related discipline

Seven years of SWE experience

Tools

JIRA

Confluence

AWS

Job description

Red Arch Solutions is seeking a Software Engineer in Maryland to create and maintain data workflows and automation pipelines using Apache Airflow. You will build reliable, scalable, and observable workflow orchestration solutions supporting data engineering, analytics, and operations.

The role requires strong Python/Java development, Linux & Bash scripting, and experience with Airflow, Spark, and containerization.