Staff Data Platform Engineer - Airflow & DevOps Lead (Remote)

WEX; United States; Remote; USD 141,000 - 173,000; Full time

Benefits offered by this job

Health insurance

Job summary

WEX is seeking a Staff Software Engineer (Semantic Foundationa) to join the Data Platform Engineering Team as a core platform engineer and DevOps specialist. The role focuses on orchestration, containerization, and production-grade cloud automation across AWS and Azure.

You will own Airflow clusters, CI/CD pipelines, and data governance initiatives while collaborating with Data Engineering, Infra, and Operations to optimize cost, reliability, and developer experience.

Qualifications

• 6+ years of hands-on professional experience in Data Platform Engineering, DevOps, or Site Reliability Engineering (SRE) supporting big data environments.
• Airflow Subject Matter Expertise: Deep production experience managing, tuning, dynamic scaling, and troubleshooting Apache Airflow infrastructure (Celery/Kubernetes Executors, DAG parsing performance, dynamic configurations).
• Container & Infrastructure Automation: Expert-level skills in Kubernetes, Helm, Terraform, Docker, ArgoCD, and GitHub Actions (including custom runner configurations).
• Observability & Monitoring: Proven track record of configuring production alerting, metrics collection, and log aggregation using Grafana, Prometheus, and Loki.

Responsibilities

• Architecture & End-to-End Ownership: Take full technical ownership of data platform modules from architectural design through deployment, production operations, and incident management.
• Infrastructure-as-Code & GitOps: Drive DevOps practices using Terraform, Helm Charts, and ArgoCD to automate platform deployments and enforce GitOps workflows.
• CI/CD & Automation: Architect and manage robust CI/CD pipelines utilizing GitHub Actions for seamless deployment of data pipelines, infrastructure components, and DAGs.
• Container & Cluster Management: Provision and manage scalable Kubernetes (EKS/AKS) clusters, Docker containers, and underlying cloud infrastructure across AWS and Azure.

Skills

Airflow expertise

Kubernetes

Terraform

Docker

Go/Python/SQL

CI/CD

Observability

Tools

Helm

ArgoCD

GitHub Actions

Spark

AWS

Azure

Job description

WEX is seeking a Staff Software Engineer (Semantic Foundationa) to join the Data Platform Engineering Team as a core platform engineer and DevOps specialist. The role focuses on orchestration, containerization, and production-grade cloud automation across AWS and Azure.

You will own Airflow clusters, CI/CD pipelines, and data governance initiatives while collaborating with Data Engineering, Infra, and Operations to optimize cost, reliability, and developer experience.