Senior Data Platform Engineer
Eitacies Inc
14 days+
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
A data engineering firm based in Phoenix, AZ, is seeking a Senior Data Platform Engineer. This role involves designing and maintaining Airflow DAGs for data workflows, optimizing Spark jobs, and developing APIs using FastAPI. The ideal candidate should have over 6 years of experience in data engineering, proficient Python skills, and familiarity with GCP. An excellent opportunity for professionals looking to enhance data quality and operational efficiencies in a collaborative environment.
Qualifications
- 6+ years of data engineering experience.
- Strong Python programming skills.
- Production experience with Apache Spark and PySpark.
- Hands-on experience with GCP preferred.
Responsibilities
- Design and maintain Airflow DAGs for production data workflows.
- Develop and optimize Spark / PySpark jobs on Dataproc.
- Monitor pipeline performance, retries, and SLA compliance.
Skills
Python programming
Apache Spark / PySpark
Airflow DAG development
SQL transformation
Data modeling
API development using FastAPI
Tools
GCP (Dataproc, BigQuery, Cloud Storage)
Job description
Overview
Senior Data Platform Engineer — Onsite Phoenix, AZ
Responsibilities
- Design and maintain Airflow DAGs for production data workflows
- Develop and optimize Spark / PySpark jobs on Dataproc
- Build and optimize complex SQL transformations
- Develop REST APIs using FastAPI Python to support data services
- Implement robust data quality and validation frameworks
- Monitor pipeline performance, retries, and SLA compliance
Qualifications
- 6+ years of data engineering experience
- Strong Python programming skills
- Production experience with Apache Spark PySpark
- Experience with Airflow DAG development
- Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
- Experience building APIs using FastAPI
- Strong SQL and data modeling knowledge
- Experience implementing data quality checks (schema validation, row count checks, anomaly detection)
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
