Senior Data Platform Engineer — Onsite Phoenix, GCP/PySpark
EITACIES Inc.
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
EITACIES Inc. is seeking a Senior Data Platform Engineer for an onsite position in Phoenix, AZ. In this role, you will leverage your expertise to design and maintain Airflow DAGs for production data workflows and develop robust Spark/PySpark jobs on Dataproc.
The ideal candidate will have at least 6 years of data engineering experience with strong Python programming skills, and hands-on experience with Google Cloud Platform. Excellent problem-solving skills and experience building APIs using FastAPI are essential.
Qualifications
- 6+ years of data engineering experience.
- Strong Python programming skills.
- Production experience with Apache Spark PySpark.
- Experience with Airflow DAG development.
- Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred).
- Experience building APIs using FastAPI.
- Strong SQL and data modeling knowledge.
- Experience implementing data quality checks.
Responsibilities
- Design and maintain Airflow DAGs for production data workflows.
- Develop and optimize Spark / PySpark jobs on Dataproc.
- Build and optimize complex SQL transformations.
- Develop REST APIs using FastAPI Python to support data services.
- Implement robust data quality and validation frameworks.
- Monitor pipeline performance, retries, and SLA compliance.
Skills
Job description
EITACIES Inc. is seeking a Senior Data Platform Engineer for an onsite position in Phoenix, AZ. In this role, you will leverage your expertise to design and maintain Airflow DAGs for production data workflows and develop robust Spark/PySpark jobs on Dataproc.
The ideal candidate will have at least 6 years of data engineering experience with strong Python programming skills, and hands-on experience with Google Cloud Platform. Excellent problem-solving skills and experience building APIs using FastAPI are essential.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
