Phoenix-Based Senior Data Platform Engineer (Airflow, Spark, FastAPI)

Eitacies Inc; Phoenix (AZ); On-site; USD 110,000 - 130,000; Full time

Job summary

A data engineering firm based in Phoenix, AZ, is seeking a Senior Data Platform Engineer. This role involves designing and maintaining Airflow DAGs for data workflows, optimizing Spark jobs, and developing APIs using FastAPI. The ideal candidate should have over 6 years of experience in data engineering, proficient Python skills, and familiarity with GCP. An excellent opportunity for professionals looking to enhance data quality and operational efficiencies in a collaborative environment.

Qualifications

• 6+ years of data engineering experience.
• Strong Python programming skills.
• Production experience with Apache Spark and PySpark.
• Hands-on experience with GCP preferred.

Responsibilities

• Design and maintain Airflow DAGs for production data workflows.
• Develop and optimize Spark / PySpark jobs on Dataproc.
• Monitor pipeline performance, retries, and SLA compliance.

Skills

Python programming

Apache Spark / PySpark

Airflow DAG development

SQL transformation

Data modeling

API development using FastAPI

Tools

GCP (Dataproc, BigQuery, Cloud Storage)

Job description

A data engineering firm based in Phoenix, AZ, is seeking a Senior Data Platform Engineer. This role involves designing and maintaining Airflow DAGs for data workflows, optimizing Spark jobs, and developing APIs using FastAPI. The ideal candidate should have over 6 years of experience in data engineering, proficient Python skills, and familiarity with GCP. An excellent opportunity for professionals looking to enhance data quality and operational efficiencies in a collaborative environment.